HDFS Administration Guide
Also available as:
PDF
loading table of contents...

MapReduce on YARN

Recommendation: Make /apps/history a single encryption zone. History files are moved between the intermediate and done directories, and HDFS encryption will not allow you to move encrypted files across encryption zones.

Steps

On a cluster with MapReduce over YARN installed, create the /apps/history directory and make it an encryption zone.

If /apps/history already exists and is not empty:

  1. Create an empty /apps/history-tmp directory

  2. Make /apps/history-tmp an encryption zone

  3. Copy (distcp) all data from /apps/history into /apps/history-tmp

  4. Remove /apps/history

  5. Rename /apps/history-tmp to /apps/history