I have been using Cloudera's hadoop (0.20.2). With this version, if I put a file into the file system, but the directory structure did not exist, it automatically created the parent directories: ...

How to write data in the dataframe into single .parquet file(both data & metadata in single file) in HDFS? df.show() --> 2 rows +------+--------------+----------------+ | name|favorite_colo...