Configure YARN for HDFS Encryption
How to configure YARN for HDFS encryption.
Recommendation: Make /apps/history
a single encryption zone.
History files are moved between the intermediate
and
done
directories, and HDFS encryption will not allow
you to move encrypted files across encryption zones.
- On a cluster with MapReduce over YARN installed, create the
/apps/history
directory and make it an encryption zone. - If
/apps/history
already exists and is not empty:-
Create an empty
/apps/history-tmp
directory. -
Make
/apps/history-tmp
an encryption zone. -
Copy (
distcp
) all data from/apps/history
into/apps/history-tmp
. -
Remove
/apps/history
. -
Rename
/apps/history-tmp
to/apps/history
.
-
Create an empty