How to rename file within a partition in HIVE

Question

I have a date partitioned data in hive. However the file within a certain partition has a name like 000112_0. Is there a way to rename this file

Answer 1

There is no configuration property to do this but you can write your custom reducer class like OutputFormat to achieve this.

OutputFormat describes the output-specification for a Map-Reduce job. The Map-Reduce framework relies on the OutputFormat of the job to:

• Validate the output-specification of the job. For eg check that the output directory doesn't already exist.
• Provide the RecordWriter implementation to be used to write out the output files of the job. Output files are stored in a FileSystem .

Answer 2

You can. Run:

hadoop fs -mv /path_to_file/old_name /path_to_file/new_name