HDFS Administration Guide
Also available as:
PDF
loading table of contents...

Contents

1. HDFS Administration
Configuring ACLs on HDFS
Using CLI Commands to Create and List ACLs
ACL Examples
ACLS on HDFS Features
Use Cases for ACLs on HDFS
2. Archival Storage
Introduction
HDFS Storage Types
Storage Policies: Hot, Warm, and Cold
Configuring Archival Storage
3. Centralized Cache Management in HDFS
Overview
Caching Use Cases
Caching Architecture
Caching Terminology
Configuring Centralized Caching
Using Cache Pools and Directives
4. Configuring HDFS Compression
5. Configuring Rack Awareness On HDP
Create a Rack Topology Script
Add the Topology Script Property to core-site.xml
Restart HDFS and MapReduce
Verify Rack Awareness
6. Customizing HDFS
Customize the HDFS Home Directory
Set the Size of the NameNode Edits Directory
7. Hadoop Archives
Introduction
Hadoop Archive Components
Creating a Hadoop Archive
Looking Up Files in Hadoop Archives
Hadoop Archives and MapReduce
8. JMX Metrics APIs for HDFS Daemons
9. Memory as Storage (Technical Preview)
Introduction
HDFS Storage Types
The LAZY_PERSIST Memory Storage Policy
Configuring Memory as Storage
10. Running DataNodes as Non-Root
Introduction
Configuring DataNode SASL
11. Short Circuit Local Reads On HDFS
Prerequisites
Configuring Short-Circuit Local Reads on HDFS
Short-Circuit Local Read Properties in hdfs-site.xml
12. WebHDFS Administrator Guide
13. HDFS "Data at Rest" Encryption
HDFS Encryption Overview
Configuring and Starting the Ranger Key Management Service (Ranger KMS)
Configuring and Using HDFS Data at Rest Encryption
Prepare the Environment
Create an Encryption Key
Create an Encryption Zone
Copy Files from/to an Encryption Zone
Read and Write Files from/to an Encryption Zone
Delete Files from an Encryption Zone
Configuring HDP Services for HDFS Encryption
Hive
HBase
Sqoop
MapReduce on YARN
Oozie
WebHDFS
Appendix: Creating an HDFS Admin User
14. Backing Up HDFS Metadata
Introduction to HDFS Metadata Files and Directories
Files and Directories
HDFS Commands
Backing Up HDFS Metadata
Get Ready to Backup the HDFS Metadata
Perform a Backup the HDFS Metadata

List of Figures

13.1. HDFS Encryption Components