Write custom Java to create LZO files
You may also write java that creates LZO files from text-formatted Hive query output.
- Create text files as the output of the Hive query.
- Write custom Java code to convert Hive query generated text files to .lzo files and generate lzo.index files for the .lzo files.
-
Prefix the query string with these parameters:Table 1. Hive Query Parameters Parameter Value SET hive.exec.compress.output false SET mapreduce.output.fileoutputformat.compress false hive -e "SET hive.exec.compress.output=false;SET mapreduce.output.fileoutputformat.compress=false;<query-string>"