MapReduce on YARN
Recommendation: Make
/apps/history
a single encryption zone. History files are moved
between the intermediate
and done
directories, and
HDFS encryption will not allow you to move encrypted files across encryption
zones.
Steps
On a cluster with MapReduce over YARN installed, create the
/apps/history
directory and make it an encryption zone.
If /apps/history
already exists and is not empty:
Create an empty
/apps/history-tmp
directoryMake
/apps/history-tmp
an encryption zoneCopy (
distcp
) all data from/apps/history
into/apps/history-tmp
Remove
/apps/history
Rename
/apps/history-tmp
to/apps/history