Managing Clusters
Accessing the Cloudera Manager Admin Console
Adding and Deleting Clusters
Adding a Compute Cluster and Data Context
Adding a Cluster Using New Hosts
Step 1: Welcome (Add Cluster - Installation)
Step 2: Cluster Basics
Step 3: Setup Auto-TLS
Step 4: Specify Hosts
Step 5: Select Repository
Step 6: Select JDK
Step 7: Enter Login Credentials
Step 8: Install Agents
Step 9: Install Parcels
Step 11: Inspect Cluster
Adding a Cluster Using Currently Managed Hosts
Step 1: Welcome (Add Cluster - Installation)
Step 2: Cluster Basics
Step 3: Setup Auto-TLS
Step 4: Specify Hosts
Step 5: Select Repository
Step 6: Install Parcels
Step 8: Inspect Cluster
Deleting a Cluster
Starting, Stopping, Refreshing, and Restarting a Cluster
Pausing a Cluster in AWS
Shutting Down and Starting Up the Cluster
Renaming a Cluster
Managing Hosts
Viewing Host Status
Adding a Host to a Cluster
Parcels
Configuring Hosts
Viewing Host Role Assignments
Host Templates
Creating a Host Template
Editing a Host Template
Applying a Host Template to a Host
Hosts Disks Overview
Deleting Hosts
Deleting a Host from Cloudera Manager
Removing a Host From a Cluster
Stopping All the Roles on a Host
Starting All the Roles on a Host
Changing Hostnames
Moving a Host Between Clusters
Configuring Upgrade Domains
Configuring Upgrade Domains
Changing the Upgrade Domain for hosts
Putting all Hosts in an Upgrade Domain group into Maintenance Mode
Specifying Racks for Hosts
Performing Maintenance on a Cluster Host
Decommissioning Hosts
Recommissioning Hosts
Tuning and Troubleshooting Host Decommissioning
Tuning HDFS Prior to Decommissioning DataNodes
Tuning HBase Prior to Decommissioning DataNodes
Performance Considerations
Troubleshooting Performance of Decommissioning
Maintenance Mode
Viewing the Maintenance Mode Status of a Cluster
Managing Roles
Role Instances
Adding a Role Instance
Starting, Stopping, and Restarting Role Instances
Decommissioning Role Instances
Recommissioning Role Instances
Deleting Role Instances
Configuring Roles to Use a Custom Garbage Collection Parameter
Role Groups
Creating a Role Group
Managing Role Groups
Backing up databases
Managing Cloudera Runtime Services
Adding a Service
Comparing Configurations for a Service Between Clusters
Starting a Cloudera Runtime Service on All Hosts
Stopping a Cloudera Runtime Service on All Hosts
Restarting a Cloudera Runtime Service
Rolling Restart
Aborting a Pending Command
Deleting Services
Renaming a Service
Configuring Maximum File Descriptors
Extending Cloudera Manager
Add-on Services
Configuring Services to Use LZO Compression
Core Configuration Service
Managing Cloudera Manager
Automatic Logout
Starting, Stopping, and Restarting the Cloudera Manager Server
Configuring Cloudera Manager
Configuring Cloudera Manager Server Ports
Configuring Network Settings for a Proxy Server
Moving the Cloudera Manager Server to a New Host
Migrating Embedded PostgreSQL Database to External PostgreSQL Database
Step 1: Identify Roles that Use the Embedded Database Server
Step 2: Migrate Databases from the Embedded Database Server to the External PostgreSQL Database Server
Migrating from PostgreSQL Database Server to MySQL/Oracle Database Server
Migrate from the Cloudera Manager External PostgreSQL Database Server to a MySQL/Oracle Database Server
Managing Cloudera Manager Server Logs
Cloudera Manager Agents
Starting, Stopping, and Restarting Cloudera Manager Agents
Configuring Cloudera Manager Agents
Managing the Cloudera Manager Agent Logs
Overview of Parcels
Advantages of Parcels
Parcel Life Cycle
Parcel Locations
Managing Parcels
Viewing Parcel Usage
Parcel Configuration Settings
Managing Licenses
Accessing the License Page
Ending a CDP Private Cloud Base Trial
Upgrading from a CDP Private Cloud Base Trial to CDP Private Cloud Base
Renewing a License
Default User Roles
Other Tasks and Settings
Cloudera Management Service
Starting the Cloudera Management Service
Stopping the Cloudera Management Service
Restarting the Cloudera Management Service
Starting and Stopping Cloudera Management Service Roles
Configuring Management Service Database Limits
Performance Management
Optimizing Performance in Cloudera Runtime
Disabling Transparent Hugepages (THP)
Setting the vm.swappiness Linux Kernel Parameter
Improving Performance in Shuffle Handler and IFile Reader
Tips and Best Practices for Jobs
Decrease Reserve Space
Choosing and Configuring Data Compression
Resource Management
Static Service Pools
Enabling and Configuring Static Service Pools
Disabling Static Service Pools
Linux Control Groups (cgroups)
Enabling Resource Management with Control Groups
Configuring Resource Parameters
Configuring Custom Cgroups
Data Storage for Monitoring Data
Configuring Service Monitor Data Storage
Configuring Host Monitor Data Storage
Viewing Host and Service Monitor Data Storage
Data Granularity and Time-Series Metric Data
Moving Monitoring Data on an Active Cluster
Host Monitor and Service Monitor Memory Configuration
Configuring Memory Allocations
Accessing Storage Using Amazon S3
Referencing S3 Credentials for YARN, MapReduce, or Spark Clients
Referencing Amazon S3 in URIs
Using Fast Upload with Amazon S3
Enabling Fast Upload using Cloudera Manager
Configuring and Managing S3Guard
Configuring S3Guard for Cluster Access to S3
Editing the S3Guard Configuration
Running the Prune Command Using Cloudera Manager Admin Console
Running the Prune Command Using the Cloudera Manager API
How to Configure a MapReduce Job to Access S3 with an HDFS Credstore
Importing Data into Amazon S3 Using Sqoop
Authentication
Using a Credential Provider to Secure S3 Credentials
Sqoop Import into Amazon S3
Import Data from RDBMS into an S3 Bucket
Import Data into S3 Bucket in Incremental Mode
Import Data into an External Hive Table Backed by S3
S3Guard with Sqoop
Accessing Storage Using Microsoft ADLS
Configuring OAuth in Data Hub
Configuring OAuth with core-site.xml
Configuring OAuth with the Hadoop CredentialProvider
Configuring Native TLS Acceleration
Importing Data into Microsoft Azure Data Lake Store (Gen1 and Gen2) Using Sqoop
Prerequisites
Authentication
Sqoop Import into ADLS