Cloudera Docs
»
2.3.0
»
HDFS Administration Guide
HDFS Administration Guide
Also available as:
Contents
1. HDFS Administration
Configuring ACLs on HDFS
Using CLI Commands to Create and List ACLs
ACL Examples
ACLS on HDFS Features
Use Cases for ACLs on HDFS
2. Archival Storage
Introduction
HDFS Storage Types
Storage Policies: Hot, Warm, and Cold
Configuring Archival Storage
3. Centralized Cache Management in HDFS
Overview
Caching Use Cases
Caching Architecture
Caching Terminology
Configuring Centralized Caching
Using Cache Pools and Directives
4. Configuring HDFS Compression
5. Configuring Rack Awareness On HDP
Create a Rack Topology Script
Add the Topology Script Property to core-site.xml
Restart HDFS and MapReduce
Verify Rack Awareness
6. Customizing HDFS
Customize the HDFS Home Directory
Set the Size of the NameNode Edits Directory
7. Hadoop Archives
Introduction
Hadoop Archive Components
Creating a Hadoop Archive
Looking Up Files in Hadoop Archives
Hadoop Archives and MapReduce
8. JMX Metrics APIs for HDFS Daemons
9. Memory as Storage (Technical Preview)
Introduction
HDFS Storage Types
The LAZY_PERSIST Memory Storage Policy
Configuring Memory as Storage
10. Running DataNodes as Non-Root
Introduction
Configuring DataNode SASL
11. Short Circuit Local Reads On HDFS
Prerequisites
Configuring Short-Circuit Local Reads on HDFS
Short-Circuit Local Read Properties in hdfs-site.xml
12. WebHDFS Administrator Guide
13. HDFS "Data at Rest" Encryption
HDFS Encryption Overview
Configuring and Starting the Ranger Key Management Service (Ranger KMS)
Configuring and Using HDFS Data at Rest Encryption
Prepare the Environment
CPU Support for AES-NI optimization
Library Support for AES-NI optimization
Verifying AES-NI Support
Create an Encryption Key
Create an Encryption Zone
Copy Files from/to an Encryption Zone
Read and Write Files from/to an Encryption Zone
Delete Files from an Encryption Zone
Configuring HDP Services for HDFS Encryption
Hive
Configuring Hive Tables for HDFS Encryption
Loading Data into an Encrypted Table
Encrypting Other Hive Directories
Additional Changes in Behavior with HDFS-Encrypted Tables
HBase
Recommendations
Steps
Changes in Behavior after HDFS Encryption is Enabled
Sqoop
Recommendations
MapReduce on YARN
Steps
Oozie
Recommendations
WebHDFS
Recommendations
Steps
Appendix: Creating an HDFS Admin User
14. Backing Up HDFS Metadata
Introduction to HDFS Metadata Files and Directories
Files and Directories
Namenodes
Journalnodes
Datanodes
HDFS Commands
Configuration Properties
Backing Up HDFS Metadata
Get Ready to Backup the HDFS Metadata
Perform a Backup the HDFS Metadata
« Prev
Next »
Backing Up HDFS Metadata
You can backup of HDFS metadata without taking down either HDFS or the NameNodes.
© 2012–2021 by Cloudera, Inc.
Document licensed under the
Creative Commons Attribution ShareAlike 4.0 License
.
Cloudera.com
|
Documentation
|
Support
|
Community