Use GZipCodec with a one-time job
You can configure GZipcodec
to compress the output of a MapReduce
job.
To use
GzipCodec
with a one-time only job, add the options to
configure compression for the MapReduce job and configure GZipCodec
for the output of the job.
hadoop jar hadoop-examples-1.1.0-SNAPSHOT.jar sort sbr"-Dmapred.compress.map.output=true"
sbr"-Dmapred.map.output.compression.codec=org.apache.hadoop.io.compress.GzipCodec"
sbr "-Dmapred.output.compress=true"
sbr"-Dmapred.output.compression.codec=org.apache.hadoop.io.compress.GzipCodec"sbr -outKey org.apache.hadoop.io.Textsbr
-outValue org.apache.hadoop.io.Text input output