Cloudera Manager ▶︎ Release Notes ▶︎ Cloudera Manager 7.6.5 Release Notes What's New in Cloudera Manager 7.6.5 Fixed Issues in Cloudera Manager 7.6.5 Known Issues in Cloudera Manager 7.6.5 ▶︎ Cumulative hotfixes Cloudera Manager 7.6.5 Cumulative hotfix 1 Cloudera Manager 7.6.5 Cumulative hotfix 2 Cloudera Manager 7.6.5 Cumulative hotfix 3 Cloudera Manager 7.6.5 Cumulative hotfix 4 Cloudera Manager 7.6.5 Cumulative hotfix 5 ▶︎ Overview Overview Terminology Architecture State Management ▶︎ Cloudera Manager Admin Console Home Page Automatic Logout Software Distribution Management Process Management Host Management Cloudera Manager Agents Resource Management User Management Security Management Monitoring a Cluster Using Cloudera Manager Cloudera Management Service Cluster Configuration Overview Server and Client Configuration Cloudera Manager API ▶︎ Virtual Private Clusters and Cloudera SDX Advantages of Separating Compute and Data Resources Architecture Performance Trade Offs Compatibility Considerations for Virtual Private Clusters Networking Considerations for Virtual Private Clusters ▶︎ Security Overview Overview Authentication Overview ▶︎ Encryption Overview Encryption Mechanisms Authorization Overview Using metadata for cluster governance ▶︎ Installation & Upgrade ▶︎ Installing CDP Private Cloud Base CDP Private Cloud Base Installation Guide ▶︎ Version and Download Information Cloudera Manager Version Information Cloudera Manager Download Information Cloudera Runtime Version Information Cloudera Runtime Download Information Cloudera Manager support for Cloudera Runtime and CDH CDP Private Cloud Base Trial Download Information ▶︎ CDP Private Cloud Base Requirements and Supported Versions ▶︎ Hardware Requirements ▶︎ Cloudera Manager Cloudera Manager Server Service Monitor Requirements Host Monitor Reports Manager Agent Hosts Event Server Alert Publisher ▶︎ Cloudera Runtime Atlas Data Analytics Studio (DAS) HDFS HBase Hive Hue Impala Kafka Key Trustee Server Key Trustee KMS Kudu Oozie Ozone Phoenix Ranger Search Spark YARN ZooKeeper Operating System Requirements Database Requirements Java Requirements Networking and Security Requirements Data at Rest Encryption Requirements ▶︎ Third-party filesystems IBM Spectrum Scale Dell EMC PowerScale ▶︎ Trial Installation ▶︎ Installing a Trial Cluster Before You Begin a Trial Installation Download the Trial version of CDP Private Cloud Base Run the Cloudera Manager Server Installer Install Cloudera Runtime Set Up a Cluster Using the Wizard Stopping the Embedded PostgreSQL Database Starting the Embedded PostgreSQL Database Changing Embedded PostgreSQL Database Passwords ▶︎ Migrating from the Cloudera Manager Embedded PostgreSQL Database Server to an External PostgreSQL Database Prerequisites Identify Roles that Use the Embedded Database Server Migrate Databases from the Embedded Database Server to the External PostgreSQL Database Server ▶︎ Installing and Configuring CDP with FIPS Overview Prerequisites Configure Cloudera Manager for FIPS Install and configure additional required components ▶︎ Production Installation ▶︎ Before You Install ▶︎ Storage Space Planning for Cloudera Manager Cluster Lifecycle Management with Cloudera Manager Configure Network Names Setting SELinux Mode Disabling the Firewall Enable an NTP Service Impala Requirements Runtime Cluster Hosts and Role Assignments Allocating Hosts for Key Trustee Server and Key Trustee KMS ▶︎ Configuring Local Package and Parcel Repositories ▶︎ Understanding Package Management Repository Configuration Files Listing Repositories ▶︎ Configuring a Local Package Repository ▶︎ Creating a Permanent Internal Repository Setting Up a Web Server Downloading and Publishing the Package Repository Creating a Temporary Internal Repository Configuring Hosts to Use the Internal Repository ▶︎ Configuring a Local Parcel Repository ▶︎ Using an Internally Hosted Remote Parcel Repository Setting Up a Web Server Downloading and Publishing the Parcel Repository Configuring Cloudera Manager to Use an Internal Remote Parcel Repository Using a Local Parcel Repository Configuring /tmp directory for cluster hosts Installing Cloudera Manager, Cloudera Runtime, and Managed Services Step 1: Configure a Repository for Cloudera Manager ▶︎ Step 2: Install Java Development Kit Installing OpenJDK on Cloudera Manager Installing OpenJDK for CDP Runtime Installing Oracle JDK for CDP Runtime Tuning JVM Garbage Collection Configuring a Custom Java Home Location ▶︎ Step 3: Install Cloudera Manager Server Install Cloudera Manager Packages ▶︎ Step 4. Install and Configure Databases Required Databases ▶︎ Install and Configure PostgreSQL for CDP Installing Postgres JDBC Driver Installing PostgreSQL Server Installing the psycopg2 Python package for PostgreSQL-backed Hue Configuring and Starting the PostgreSQL Server Install and Configure MySQL Install and Configure MariaDB ▶︎ Install and Configure Oracle Database Configuring the Hue Server to Store Data in the Oracle database ▶︎ Configuring a database for Ranger or Ranger KMS Configuring a Ranger or Ranger KMS Database: MySQL/MariaDB Configuring a Ranger or Ranger KMS Database: Oracle Configuring a Ranger or Ranger KMS Database: Oracle using /ServiceName format Configuring a PostgreSQL Database for Ranger or Ranger KMS Configure Ranger with SSL/TLS enabled PostgreSQL Database ▶︎ Configuring the Database for Streaming Components Configure PostgreSQL for Streaming Components Configuring MySQL for Streaming Components ▶︎ Step 5: Set up and configure the Cloudera Manager database Syntax for scm_prepare_database.sh ▶︎ Step 6: Install Runtime and Other Software Installation Wizard ▶︎ Step 7: Set Up a Cluster Using the Wizard Select Services Assign Roles Setup Database Enter Required Parameters Review Changes Command Details Summary (Recommended) Enable Auto-TLS Additional Steps for Apache Ranger ▶︎ Installing Apache Knox Apache Knox Install Role Parameters ▶︎ Setting Up Data at Rest Encryption for HDFS Installing Ranger KMS backed by a Database and HA Installing Ranger KMS backed with a Key Trustee Server and HA Installing a Java Keystore KMS Installing Cloudera Navigator Encrypt Installing Cloudera Navigator Key HSM Installing Ranger RMS ▶︎ Custom Installation Solutions ▶︎ Privileged commands for Cloudera Manager installation Prerequisites and exceptions for the example configuration Example configuration to add to the sudoers file ▶︎ Creating Virtual Images of Cluster Hosts Creating a Pre-Deployed Cloudera Manager Host Instantiating a Cloudera Manager Image Creating a Pre-Deployed Worker Host Instantiating a worker host ▶︎ Manually Install Cloudera Software Packages Install Cloudera Manager Packages Manually Install Cloudera Manager Agent Packages ▶︎ Installation Reference ▶︎ Ports Ports Used by Cloudera Manager Ports Used by Cloudera Navigator Key Trustee Server Ports Used by Cloudera Runtime Components Ports Used by DistCp Ports Used by Third-Party Components Service Dependencies in Cloudera Manager Cloudera Manager sudo command options Introduction to Parcels ▶︎ After You Install Deploying Clients Testing the Installation Checking Host Heartbeats Running a MapReduce Job Testing with Hue Deploying Atlas service Secure Your Cluster Installing the GPL Extras Parcel Configuring HDFS properties to optimize log collection Troubleshooting Installation Problems ▶︎ Uninstalling Cloudera Manager and Managed Software Record User Data Paths Stop all Services Deactivate and Remove Parcels Delete the Cluster Uninstall the Cloudera Manager Server Uninstall Cloudera Manager Agent and Managed Software Remove Cloudera Manager, User Data, and Databases Uninstalling a Runtime Component From a Single Host ▶︎ Custom Installation Scenarios Installing a Kafka-centric cluster ▶︎ Quick Start Deployment for a Streams Cluster Create a Streams Cluster on CDP Private Cloud Base ▶︎ Before You Install System Requirements for POC Streams Cluster Disable the Firewall Enable an NTP Service ▶︎ Installing a Trial Streaming Cluster Download the Trial version of CDP Private Cloud Base Run the Cloudera Manager Server Installer Install Cloudera Runtime Set Up a Streaming Cluster ▶︎ Getting Started on your Streams Cluster Create a Kafka Topic to Store your Events Write a few Events into the Topic Read the Events Monitor your Cluster from the SMM UI After Evaluating Trial Software Getting Started with CDP Upgrade and Migration ▶︎ Managing Clusters Accessing the Cloudera Manager Admin Console ▶︎ Adding and Deleting Clusters Adding a Compute Cluster and Data Context ▶︎ Adding a Cluster Using New Hosts Step 1: Welcome (Add Cluster - Installation) Step 2: Cluster Basics Step 3: Setup Auto-TLS Step 4: Specify Hosts Step 5: Select Repository Step 6: Select JDK Step 7: Enter Login Credentials Step 8: Install Agents Step 9: Install Parcels Step 11: Inspect Cluster ▶︎ Adding a Cluster Using Currently Managed Hosts Step 1: Welcome (Add Cluster - Installation) Step 2: Cluster Basics Step 3: Setup Auto-TLS Step 4: Specify Hosts Step 5: Select Repository Step 6: Install Parcels Step 8: Inspect Cluster Deleting a Cluster ▶︎ Tutorial: Using Impala, Hive and Hue with Virtual Private Clusters Set Up an Environment Using impala-shell and Hive View HDFS directory structure of Compute clusters Insert data in test_table through Spark Hue in a Virtual Private Cluster Environment Starting, Stopping, Refreshing, and Restarting a Cluster ▶︎ Pausing a Cluster in AWS Shutting Down and Starting Up the Cluster Renaming a Cluster ▶︎ Managing Hosts Viewing Host Status Adding a Host to a Cluster Parcels Configuring Hosts Viewing Host Role Assignments ▶︎ Host Templates Creating a Host Template Editing a Host Template Applying a Host Template to a Host Hosts Disks Overview ▶︎ Deleting Hosts Deleting a Host from Cloudera Manager Removing a Host From a Cluster Stopping All the Roles on a Host Starting All the Roles on a Host Changing Hostnames Moving a Host Between Clusters ▶︎ Configuring Upgrade Domains Configuring Upgrade Domains Changing the Upgrade Domain for hosts Putting all Hosts in an Upgrade Domain group into Maintenance Mode Specifying Racks for Hosts ▶︎ Performing Maintenance on a Cluster Host Decommissioning Hosts Recommissioning Hosts ▶︎ Tuning and Troubleshooting Host Decommissioning Tuning HDFS Prior to Decommissioning DataNodes Tuning HBase Prior to Decommissioning DataNodes Performance Considerations Troubleshooting Performance of Decommissioning Maintenance Mode Viewing the Maintenance Mode Status of a Cluster ▶︎ Managing Roles ▶︎ Role Instances Adding a Role Instance Starting, Stopping, and Restarting Role Instances Decommissioning Role Instances Recommissioning Role Instances Deleting Role Instances Configuring Roles to Use a Custom Garbage Collection Parameter ▶︎ Role Groups Creating a Role Group Managing Role Groups Default User Roles Backing up databases ▶︎ Managing Cloudera Runtime Services ▶︎ Adding a Service Prerequisites for installing Atlas Installing Atlas using Add Service Installing Ranger using Add Service Comparing Configurations for a Service Between Clusters Starting a Cloudera Runtime Service on All Hosts Stopping a Cloudera Runtime Service on All Hosts Restarting a Cloudera Runtime Service Rolling Restart Aborting a Pending Command Deleting Services Renaming a Service Configuring Maximum File Descriptors ▶︎ Extending Cloudera Manager Add-on Services Configuring Services to Use LZO Compression Core Configuration Service ▶︎ Performance Management ▶︎ Optimizing Performance in Cloudera Runtime Disabling Transparent Hugepages (THP) Setting the vm.swappiness Linux Kernel Parameter Improving Performance in Shuffle Handler and IFile Reader Tips and Best Practices for Jobs Decrease Reserve Space Choosing and Configuring Data Compression ▶︎ Managing Cloudera Manager Automatic Logout Starting, Stopping, and Restarting the Cloudera Manager Server ▶︎ Configuring Cloudera Manager Configuring Cloudera Manager Server Ports Configuring Network Settings for a Proxy Server Moving the Cloudera Manager Server to a New Host ▶︎ Migrating Embedded PostgreSQL Database to External PostgreSQL Database Step 1: Identify Roles that Use the Embedded Database Server Step 2: Migrate Databases from the Embedded Database Server to the External PostgreSQL Database Server ▶︎ Migrating from PostgreSQL Database Server to MySQL/Oracle Database Server Migrate from the Cloudera Manager External PostgreSQL Database Server to a MySQL/Oracle Database Server Managing Cloudera Manager Server Logs ▶︎ Cloudera Manager Agents Starting, Stopping, and Restarting Cloudera Manager Agents Configuring Cloudera Manager Agents Managing the Cloudera Manager Agent Logs ▶︎ Overview of Parcels Advantages of Parcels Parcel Life Cycle Parcel Locations Managing Parcels Viewing Parcel Usage Parcel Configuration Settings ▶︎ Managing Licenses Accessing the License Page Ending a CDP Private Cloud Base Trial Upgrading from a CDP Private Cloud Base Trial to CDP Private Cloud Base Renewing a License Cloudera Manager User Roles Other Tasks and Settings ▶︎ Cloudera Management Service Starting the Cloudera Management Service Stopping the Cloudera Management Service Restarting the Cloudera Management Service Starting and Stopping Cloudera Management Service Roles Configuring Management Service Database Limits Configuring a Secure Credential Storage Provider for Cloudera Manager (Technical Preview) ▶︎ Resource Management ▶︎ Static Service Pools Enabling and Configuring Static Service Pools Disabling Static Service Pools ▶︎ Linux Control Groups (cgroups) Enabling Resource Management with Control Groups Configuring Resource Parameters Configuring Custom Cgroups ▶︎ Data Storage for Monitoring Data Configuring Service Monitor Data Storage Configuring Host Monitor Data Storage Viewing Host and Service Monitor Data Storage Data Granularity and Time-Series Metric Data Moving Monitoring Data on an Active Cluster ▶︎ Host Monitor and Service Monitor Memory Configuration Configuring Memory Allocations ▶︎ Accessing Storage Using Amazon S3 Referencing S3 Credentials for YARN, MapReduce, or Spark Clients Referencing Amazon S3 in URIs Using Fast Upload with Amazon S3 Enabling Fast Upload using Cloudera Manager ▶︎ Configuring and Managing S3Guard Configuring S3Guard for Cluster Access to S3 Editing the S3Guard Configuration Running the Prune Command Using Cloudera Manager Admin Console Running the Prune Command Using the Cloudera Manager API How to Configure a MapReduce Job to Access S3 with an HDFS Credstore ▶︎ Importing Data into Amazon S3 Using Sqoop ▶︎ Authentication Using a Credential Provider to Secure S3 Credentials ▶︎ Sqoop Import into Amazon S3 Import Data from RDBMS into an S3 Bucket Import Data into S3 Bucket in Incremental Mode Import Data into an External Hive Table Backed by S3 S3Guard with Sqoop ▶︎ Accessing Storage Using Microsoft ADLS Configuring OAuth in Data Hub Configuring OAuth with core-site.xml Configuring OAuth with the Hadoop CredentialProvider Configuring Built-in TLS Acceleration ▶︎ Importing Data into Microsoft Azure Data Lake Store (Gen1 and Gen2) Using Sqoop Prerequisites Authentication Sqoop Import into ADLS ▶︎ Configuring Clusters Accessing the Cloudera Manager Admin Console ▶︎ Modifying Configuration Properties Using Cloudera Manager ▶︎ Changing the Configuration of a Service or Role Instance Searching for Properties Validation of Configuration Properties Overriding Configuration Properties Viewing and Editing Overridden Configuration Properties Resetting Configuration Properties to the Default Value Viewing and Editing Host Overrides Restarting Services and Instances after Configuration Changes ▶︎ Suppressing Configuration and Parameter Validation Warnings Suppressing a Configuration Validation in Cloudera Manager Managing Suppressed Validations Suppressing Configuration Validations Before They Trigger Warnings Viewing a List of All Suppressed Validations Cluster-Wide Configuration Custom Configuration Setting an Advanced Configuration Snippet for a Cloudera Runtime Service Setting an Advanced Configuration Snippet for a Cluster Stale Configurations ▶︎ Client Configuration Files How Client Configurations are Deployed Downloading Client Configuration Files Manually Redeploying Client Configuration Files ▶︎ Viewing and Reverting Configuration Changes Changes for a service, role, or host Changes for a cluster Autoconfiguration ▶︎ Using the Cloudera Manager API ▶︎ Using the Cloudera Manager API to backup and restore clusters Backing up the Cloudera Manager configuration Restoring the Cloudera Manager configuration ▶︎ Using the Cloudera Manager API to Manage and Configure Clusters Using the Cloudera Manager API for Cluster Automation Using the Cloudera Manager API to Obtain Configuration Files Using the Cloudera Manager API to Set Advanced Configuration Snippets (Safety Valves) Using Tags in Cloudera Manager Initiating HDFS failover using the Cloudera Manager API ▶︎ Creating a Runtime Cluster Using a Cloudera Manager Template Exporting the Cluster Configuration Preparing a New Cluster Creating the Template Importing the Template to a New Cluster Sample Python Code Disabling Redaction of sensitive information when using the Cloudera Manager API ▶︎ Monitoring and Diagnostics Accessing the Cloudera Manager Admin Console Monitoring and Diagnostics ▶︎ Time Line Selecting a Point In Time or a Time Range ▶︎ Health Tests Viewing Health Test Results Suppressing Health Test Results Suppressing a Health Test Configuring Suppression of Health Tests Before Tests Run Viewing a List of Suppressed Health Tests Unsuppressing Health Tests ▶︎ Viewing Charts for Cluster, Service, Role, and Host Instances Exporting Data from Charts Adding and Removing Charts from a Dashboard Creating Triggers from Charts ▶︎ Configuring Monitoring Settings Configuring Health Monitoring Configuring Service Monitoring Configuring Host Monitoring Configuring Directory Monitoring Configuring YARN Application Monitoring Configuring Impala Query Monitoring Configuring Impala Query Data Store Maximum Size Enabling Configuration Change Alerts Filtering Metrics ▶︎ Configuring Log Events Configuring Logs Configuring Logging Thresholds Configuring Log Directories Enabling and Disabling Log Event Capture Configuring Which Log Messages Become Events Configuring Log Alerts Monitoring Clusters ▶︎ Cluster Utilization Report overview Enable the Cluster Utilization Report Configure the Cluster Utilization Report ▶︎ Use the Cluster Utilization Report to manage resources Overview Tab YARN Tab Impala Tab Download the Cluster Utilization Report ▶︎ Creating a Custom Cluster Utilization Report Metrics and queries Impala query counter metrics Calculations for reports Retrieving metric data Querying metric data Inspecting Network Performance ▶︎ Monitoring Services ▶︎ Monitoring Service Status Viewing the URLs of the Client Configuration Files Viewing the Status of a Service Instance Viewing the Health and Status of a Role Instance Viewing the Maintenance Mode Status of a Cluster ▶︎ Viewing Service Status Viewing Past Status Status Summary Service Summary Health Tests and Health History ▶︎ Viewing Service Instance Details Role Instance Reference ▶︎ Viewing Role Instance Status The Actions Menu Viewing Past Status Summary Health Tests and Health History Status Summary Charts The Processes Tab Running Diagnostic Commands for Roles ▶︎ Periodic Stacks Collection Configuring Periodic Stacks Collection Viewing and Downloading Stacks Logs ▶︎ Viewing Running and Recent Commands Viewing Running and Recent Commands For a Cluster Viewing Running and Recent Commands for a Service or Role Command Details ▶︎ Monitoring Hosts Viewing All Hosts Role Assignments Viewing the Disks Overview Viewing the Hosts in a Cluster Viewing Individual Hosts ▶︎ Host Details Viewing Host Details Status Processes Resources Commands Configuration Components Audits Charts Library ▶︎ Host Inspector Running the Host Inspector Viewing Past Host Inspector Results ▶︎ Monitoring Activities Selecting Columns to Show in the Activities List Sorting the Activities List Filtering the Activities List Activity Charts Viewing the Jobs in a Pig, Oozie, or Hive Activity ▶︎ Task Attempts Viewing a Job's Task Attempts Selecting Columns to Show in the Tasks List Sorting the Tasks List Filtering the Tasks List Viewing Activity Details in a Report Format Comparing Similar Activities ▶︎ Viewing the Distribution of Task Attempts The Task Distribution Chart TaskTracker Hosts ▶︎ Monitoring Impala Queries Viewing Queries Configuring Impala Query Monitoring Impala Best Practices Results Tab Filtering Queries Filter Expressions Filter Attributes Choosing and Running a Filter Query Details ▶︎ Monitoring YARN Applications Viewing Jobs Configuring YARN Application Monitoring Results Tab Filtering Jobs Filter Expressions Choosing and Running a Filter Filter Attributes Sending Diagnostic Data to Cloudera for YARN Applications ▶︎ Monitoring Spark Applications Viewing and Debugging Spark Applications Using Logs Managing Spark Driver Logs Visualizing Spark Applications Using the Web Application UI Accessing the Web UI of a Running Spark Application Accessing the Web UI of a Completed Spark Application ▶︎ Events Viewing Events ▶︎ Filtering Events Adding an Event Filter Removing an Event Filter ▶︎ Alerts Managing Alerts Configuring Alert Email Delivery Configuring Alert SNMP Delivery ▶︎ Configuring Custom Alert Scripts Sample Custom Alert Script Enabling Configuration Change Alerts Enabling HBase Alerts Enabling Health Alerts Modifying the Health Threshold Configuring Alerts Transitioning Out of Alerting Health Threshold Configuring Log Alerts Configuring Alert Delivery ▶︎ Triggers Creating a Trigger Using the Expression Editor Editing, Deleting, Suppressing, or Deleting a Trigger ▶︎ Cloudera Manager Trigger Use Cases Creating a Trigger for Memory Capacity Creating a Trigger for CPU Capacity ▶︎ Lifecycle and Security Auditing Viewing Audit Events ▶︎ Filtering Audit Events Adding a Filter Removing a Filter Downloading Audit Events ▶︎ Charting Time-Series Data Terminology Building a Chart with Time-Series Data Configuring Time-Series Query Results Using Context-Sensitive Variables in Charts ▶︎ Chart Properties Changing the Chart Type Grouping (Faceting) Time Series Displaying Chart Details Editing a Chart Saving a Chart Obtaining Time-Series Data Using the API ▶︎ Dashboards Dashboard Types Creating a Dashboard Managing Dashboards Configuring Dashboards Saving Charts to Dashboards Saving Charts to a New Dashboard Saving Charts to an Existing Dashboard Adding a New Chart to the Custom Dashboard Removing a Chart from a Custom Dashboard Moving and Resizing Charts ▶︎ tsquery Language tsquery Syntax Metric Expressions Metric Expression Functions Predicates Discovering possible predicates Filtering by Day of Week or Hour of Day Time Series Attributes Time Series Entities and their Attributes FAQ ▶︎ Metric Aggregation Presentation of Aggregate Data Accessing Aggregate Statistics Through tsquery Filtering Metrics ▶︎ Logs Viewing Logs Logs List Filtering Logs Log Details ▶︎ Viewing the Cloudera Manager Server Log Viewing Cloudera Manager Server Logs in the Logs Page Viewing the Cloudera Manager Server Log ▶︎ Viewing the Cloudera Manager Agent Logs Viewing Cloudera Manager Agent Logs in the Logs Page Viewing the Cloudera Manager Agent Log Managing Disk Space for Log Files ▶︎ Reports ▶︎ Directory Usage Report Accessing the Directory Usage Report ▶︎ Using the Directory Usage Report Filters Disk Usage Reports ▶︎ Disk Usage Reports Viewing Current Disk Usage by User, Group, or Directory Viewing Historical Disk Usage by User, Group, or Directory Downloading Reports as CSV and XLS Files Activity, Application, and Query Reports ▶︎ The File Browser Searching Within the File System Enabling Snapshots Setting Quotas Designating Directories to Include in Disk Usage Reports Downloading HDFS Directory Access Permission Reports Cluster Support Tokens using Cloudera Manager ▶︎ Sending Usage and Diagnostic Data to Cloudera Configuring a Proxy Server Managing Anonymous Usage Data Collection Diagnostic Data Collection Configuring the Frequency of Diagnostic Data Collection Configuring collection of Cloudera Manager table data Specifying the Diagnostic Data Directory Redaction of Sensitive Information from Diagnostic Bundles Disabling the Automatic Sending of Diagnostic Data from a Manually Triggered Collection Manually Triggering Collection and Transfer of Diagnostic Data to Cloudera ▶︎ Troubleshooting Cluster Configuration and Operation Solutions to Common Problems Logs and Events ▶︎ Replication Manager Replication Manager in CDP Private Cloud Base Support matrix for Replication Manager on CDP Private Cloud Base Port requirements for Replication Manager on CDP Private Cloud Base ▶︎ Data replication Cloudera license requirements for Replication Manager Replicating directories with thousands of files and subdirectories Replication Manager log retention Replicating from unsecure to secure clusters ▶︎ Designating a replication source Configuring a peer Modifying peers Configuring peers with SAML authentication ▶︎ HDFS replication policies ▶︎ HDFS replication policy considerations Source data during replication Network latency during replication Performance and scalability limitations for HDFS replication policies Guidelines for using snapshot diff-based replication HDFS replication from Sentry-enabled clusters Creating HDFS replication policy Limiting replication hosts Viewing replication policies Viewing replication history Monitoring the performance of HDFS replication policies ▶︎ Hive/Impala replication policies ▶︎ Hive replication policy considerations Specifying hosts to improve Hive replication policy performance Hive tables and DDL commands Replication of parameters Hive external table replication in dynamic environments Creating a Hive/Impala replication policy Sentry to Ranger replication Replication of Impala and Hive User Defined Functions (UDFs) Monitoring the performance of Hive/Impala replication policies Enabling, disabling, or deleting a replication policy Replicating data to Impala clusters ▶︎ Enabling replication between clusters with Kerberos Authentication Ports Considerations for realm names HDFS, Hive, and Impala replication Kerberos connectivity test ▶︎ Replication of encrypted data Encrypting data in transit between clusters Security considerations ▶︎ Snapshots ▶︎ Cloudera Manager snapshot policies Managing snapshot policies Snapshots history Orphaned snapshots ▶︎ Managing HDFS snapshots Browsing HDFS directories Enabling and disabling HDFS snapshots Taking and deleting HDFS snapshots Restoring Snapshots ▶︎ Using snapshots with replication Hive/Impala replication with snapshots ▶︎ Security ▶︎ Configuring Authentication in Cloudera Manager Overview Kerberos Security Artifacts Overview Kerberos Configuration Strategies for CDP ▶︎ Configuring Authentication in Cloudera Manager Cloudera Manager user accounts ▶︎ Configuring external authentication and authorization for Cloudera Manager Configuring PAM authentication with LDAP and SSSD Configuring PAM authentication with Linux users Configuring PAM authentication using Apache Knox Configure authentication using Active Directory Configure authentication using an LDAP-compliant identity service Configure authentication using Kerberos (SPNEGO) Configure authentication using an external program Configure authentication using SAML ▶︎ Enabling Kerberos Authentication for CDP Step 1: Install Cloudera Manager and CDP Step 2: Install JCE policy files for AES-256 encryption Step 3: Create the Kerberos Principal for Cloudera Manager Server Step 4: Enable Kerberos using the wizard Step 5: Create the HDFS superuser Step 6: Get or create a Kerberos principal for each user account Step 7: Prepare the cluster for each user Step 8: Verify that Kerberos security is working Step 9: (Optional) Enable authentication for HTTP web consoles for Hadoop roles Kerberos authentication for non-default users ▶︎ Customizing Kerberos principals Configuring custom Kerberos principal for Atlas Configuring custom Kerberos principal for Cruise Control Configuring custom Kerberos principal for Apache Flink Configuring custom Kerberos principal for HBase Configuring custom Kerberos principal for HDFS Configuring custom Kerberos principal for Hive and Hive-on-Tez Configuring custom Kerberos principal for HttpFS Configuring custom Kerberos principal for Hue Configuring Kerberos Authentication Configuring the Kerberos principal used by Kafka Configuring custom Kerberos principal for Knox Configuring custom Kerberos principal for Kudu Configuring custom Kerberos principal for Livy Configuring custom Kerberos principal for NiFi and NiFi Registry Configuring custom Kerberos principal for Omid Configuring custom Kerberos principal for Oozie Configuring custom Kerberos principal for Ozone Configuring custom Kerberos principal for Phoenix Customizing the Kerberos principal for Schema Registry Configuring custom Kerberos principals and custom system users for Solr Configuring custom Kerberos principal for Spark Configuring custom Kerberos principal for Streams Messaging Manager Configuring custom Kerberos principal for SQL Stream Builder Configuring the Kerberos principal used by SRM Enabling custom Kerberos principal support in YARN Enabling custom Kerberos principal support in a Queue Manager cluster Configuring custom Kerberos principal for Zeppelin Configuring custom Kerberos principal for ZooKeeper Managing Kerberos credentials using Cloudera Manager Using a custom Kerberos keytab retrieval script Adding trusted realms to the cluster Using auth-to-local rules to isolate cluster users Configuring a dedicated MIT KDC for cross-realm trust Integrating MIT Kerberos and Active Directory Hadoop Users (user:group) and Kerberos Principals Mapping Kerberos Principals to Short Names ▶︎ Cloudera Authorization Overview Configuring LDAP Group Mappings Using Ranger to Provide Authorization in CDP ▶︎ Encrypting Data in Transit Encrypting Data in Transit Understanding Keystores and Truststores Choosing manual TLS or Auto-TLS SAN Certificates ▶︎ Configuring TLS Encryption for Cloudera Manager Using Auto-TLS Use case 1: Use Cloudera Manager to generate internal CA and corresponding certificates Use case 2: Enabling Auto-TLS with an intermediate CA signed by an existing Root CA Use case 3: Enabling Auto-TLS with Existing Certificates Manually Configuring TLS Encryption for Cloudera Manager ▶︎ Configuring TLS/SSL encryption manually for CDP Services Configuring TLS encryption manually for Apache Atlas Enable security for Cruise Control Configuring TLS/SSL encryption manually for DAS using Cloudera Manager Enabling security for Apache Flink ▶︎ Configuring TLS/SSL for HBase Prerequisites to configure TLS/SSL for HBase Configuring TLS/SSL for HBase Web UIs Configuring TLS/SSL for HBase REST Server Configuring TLS/SSL for HBase Thrift Server Enabling TLS/SSL for HiveServer ▶︎ Configuring TLS/SSL for Hue Creating a truststore file in PEM format Configuring Hue as a TLS/SSL client Enabling Hue as a TLS/SSL client Configuring Hue as a TLS/SSL server Enabling Hue as a TLS/SSL server using Cloudera Manager Enabling TLS/SSL for Hue Load Balancer Enabling TLS/SSL communication with HiveServer2 Enabling TLS/SSL communication with Impala Securing database connections with TLS/SSL Configuring Impala TLS/SSL ▶︎ Channel encryption Configure Kafka brokers Configure Kafka MirrorMaker Configuring TLS/SSL encryption Configure Kafka clients Configure Zookeeper TLS/SSL support for Kafka ▶︎ Authentication ▶︎ TLS/SSL client authentication Configure Kafka brokers Configure Kafka clients Principal name mapping Inter-broker security Configuring multiple listeners ▶︎ Configuring TLS/SSL encryption manually for Key Trustee Server Key Trustee Server Properties for TLS ▶︎ Configuring TLS/SSL encryption manually for Apache Knox Knox Properties for TLS Configuring TLS/SSL encryption for Kudu using Cloudera Manager Configure Lily HBase Indexer to use TLS/SSL Configuring TLS/SSL encryption manually for Livy ▶︎ Configuring TLS/SSL manually TLS/SSL certificate requirements and recommendations Configuring TLS/SSL encryption manually for NiFi and NiFi Registry NiFi TLS/SSL properties NiFi Registry TLS/SSL Properties Configure TLS/SSL for Oozie Configure TLS encryption manually for Phoenix Query Server Configure TLS/SSL encryption manually for Apache Ranger ▶︎ Configure TLS/SSL encryption manually for Ranger KMS Overriding custom keystore alias on a Ranger KMS Server Configure TLS/SSL encryption manually for Ranger RMS Configure TLS encryption manually for Schema Registry ▶︎ Configure TLS/SSL encryption for Solr Using a load balancer Configuring TLS/SSL encryption manually for Spark Encryption in SSB Enabling TLS/SSL for the SRM service ▶︎ Enabling TLS Encryption for SMM on CDP Private Cloud TLS/SSL settings for Streams Messaging Manager ▶︎ Configure TLS/SSL for Core Hadoop Services Configure TLS/SSL for HDFS Configure TLS/SSL for YARN Configuring TLS/SSL encryption manually for Zeppelin Configure ZooKeeper TLS/SSL using Cloudera Manager Manually Configuring TLS Encryption on the Agent Listening Port ▶︎ Encrypting Data at Rest Encrypting Data at Rest Data at Rest Encryption Reference Architecture Data at Rest Encryption Requirements Resource Planning for Data at Rest Encryption ▶︎ HDFS Transparent Encryption ▶︎ Key Concepts and Architecture Keystores and the Key Management Server Data Encryption Components and Solutions Encryption Zones and Keys Accessing Files Within an Encryption Zone Optimizing Performance for HDFS Transparent Encryption ▶︎ Managing Encryption Keys and Zones Validating Hadoop Key Operations Creating Encryption Zones Adding Files to an Encryption Zone Deleting Encryption Zones Backing Up Encryption Keys Rolling Encryption Keys ▶︎ Re-encrypting Encrypted Data Encryption Keys (EDEKs) Benefits and Capabilities Prerequisites and Assumptions Limitations Re-encrypting an EDEK Managing Re-encryption Operations ▶︎ Securing the Key Management System (KMS) Enabling Kerberos Authentication for the KMS Configuring TLS/SSL for the KMS Migrating Keys from a Java KeyStore to Cloudera Navigator Key Trustee Server ▶︎ Migrating Ranger Key Management Server Role Instances to a New Host Migrate the Ranger Admin role instance to a new host Migrate the Ranger KMS db role instance to a new host Migrate the Ranger KMS KTS role instance to a new host ▶︎ Migrating ACLs from Key Trustee KMS to Ranger KMS Key Trustee KMS operations not supported by Ranger KMS ACLs supported by Ranger KMS and Ranger KMS Mapping ▶︎ Configuring CDP Services for HDFS Encryption Transparent Encryption Recommendations for HBase ▶︎ Transparent Encryption Recommendations for Hive Changed Behavior after HDFS Encryption is Enabled KMS ACL Configuration for Hive Transparent Encryption Recommendations for Hue Transparent Encryption Recommendations for Impala Transparent Encryption Recommendations for MapReduce and YARN Transparent Encryption Recommendations for Search Transparent Encryption Recommendations for Spark Transparent Encryption Recommendations for Sqoop ▶︎ Integrating Components for Encrypting Data at Rest Set up Luna 7 HSM for Ranger KMS w/database Set up Luna 6 HSM for Ranger KMS, KTS, and KeyHSM Set up Luna 7 HSM for Ranger KMS, KTS, and KeyHSM Set up GCP Cloud HSM for Ranger KMS, KTS, and KeyHSM Set up CipherTrust HSM for Ranger KMS, KTS, and KeyHSM Configuring the Key HSM ▶︎ Using the Ranger Key Management Service Accessing the Ranger KMS Web UI List and Create Keys Roll Over an Existing Key Delete a Key ▶︎ Navigator Key Trustee Server ▶︎ Cloudera Navigator Key Trustee Server Overview Key Trustee Server System Requirements Cloudera Navigator Key Trustee Server ▶︎ Backing up Key Trustee Server and clients Back up Key Trustee Server using Cloudera Manager Back up Key Trustee Server using the ktbackup.sh script Back up Key Trustee Server manually Back up Key Trustee Server clients ▶︎ Restoring Navigator Key Trustee Server Restore Key Trustee Server in parcel-based installations Restore Key Trustee Server in package-based installations Restore Key Trustee Server from ktbackup.sh backups ▶︎ Initializing Standalone Key Trustee Server Initializing Standalone Key Trustee Server Using Cloudera Manager Specifying TLS/SSL Minimum Allowed Version and Ciphers Configuring a Mail Transfer Agent for Key Trustee Server Verifying Cloudera Navigator Key Trustee Server Operations Managing Key Trustee Server Organizations ▶︎ Managing Key Trustee Server Certificates Generating a New Certificate Replacing Key Trustee Server Certificates ▶︎ Setting Up Key Trustee Server High Availability Configuring Key Trustee Server High Availability Using Cloudera Manager Recovering a Key Trustee Server ▶︎ Navigator Encrypt Navigator Encrypt Overview Registering Cloudera Navigator Encrypt with Key Trustee Server Preparing for Encryption Using Cloudera Navigator Encrypt Encrypting and Decrypting Data Using Cloudera Navigator Encrypt Converting from Device Names to UUIDs for Encrypted Devices Navigator Encrypt Access Control List Maintaining Cloudera Navigator Encrypt ▶︎ Navigator Key HSM Cloudera Navigator Key HSM Overview Initializing Navigator Key HSM HSM-Specific Setup for Cloudera Navigator Key HSM Validating Key HSM Settings Managing the Navigator Key HSM Service Integrating Key HSM with Key Trustee Server Apache Ranger Access Control and Auditing Apache Knox Authentication ▶︎ Additional Security Topics How to Add Root and Intermediate CAs to Truststore for TLS/SSL Amazon S3 Security How to Authenticate Kerberos Principals Using Java Check Cluster Security Settings Configure Antivirus Software on CDP Hosts Configure Browser-based Interfaces to Require Authentication (SPNEGO) Configure Browsers for Kerberos Authentication (SPNEGO) Configure Cluster to Use Kerberos Authentication Convert DER, JKS, PEM Files for TLS/SSL Artifacts Configure Authentication for Amazon S3 Configure Encryption for Amazon S3 Configure AWS Credentials Enable Sensitive Data Redaction Log a Security Support Case Obtain and Deploy Keys and Certificates for TLS/SSL Renew and Redistribute Certificates Set Up a Gateway Host to Restrict Access to the Cluster Set Up Access to Cloudera EDH (Microsoft Azure Marketplace) Use Self-Signed Certificates for TLS Configuring Infra Solr Governance ▶︎ Troubleshooting Security Issues Troubleshooting Security Issues Error Messages and Various Failures Authentication and Kerberos Issues HDFS Encryption Issues Key Trustee KMS Encryption Issues TLS/SSL Issues ▶︎ YARN, MRv1, and Linux OS Security TaskController Error Codes (MRv1) ContainerExecutor Error Codes (YARN) ▼ Configuration Properties Reference ▼ Cloudera Manager Configuration Properties Reference for Cloudera Runtime 7.1.7 ADLS Connector Properties in Cloudera Runtime 7.1.7 Atlas Properties in Cloudera Runtime 7.1.7 Core Configuration Properties in Cloudera Runtime 7.1.7 Data Analytics Studio Properties in Cloudera Runtime 7.1.7 Data Context Connector Properties in Cloudera Runtime 7.1.7 HBase Properties in Cloudera Runtime 7.1.7 HDFS Properties in Cloudera Runtime 7.1.7 Hive Properties in Cloudera Runtime 7.1.7 Hive LLAP Properties in Cloudera Runtime 7.1.7 Hive on Tez Properties in Cloudera Runtime 7.1.7 Hue Properties in Cloudera Runtime 7.1.7 Impala Properties in Cloudera Runtime 7.1.7 Java KeyStore KMS Properties in Cloudera Runtime 7.1.7 Kafka Properties in Cloudera Runtime 7.1.7 Key Trustee KMS Properties in Cloudera Runtime 7.1.7 Key Trustee Server Properties in Cloudera Runtime 7.1.7 Key-Value Store Indexer Properties in Cloudera Runtime 7.1.7 Knox Properties in Cloudera Runtime 7.1.7 Kudu Properties in Cloudera Runtime 7.1.7 Livy Properties in Cloudera Runtime 7.1.7 Livy for Spark 3 Properties in Cloudera Runtime 7.1.7 Oozie Properties in Cloudera Runtime 7.1.7 Ozone Properties in Cloudera Runtime 7.1.7 Phoenix Properties in Cloudera Runtime 7.1.7 Ranger Properties in Cloudera Runtime 7.1.7 S3 Connector Properties in Cloudera Runtime 7.1.7 Schema Registry Properties in Cloudera Runtime 7.1.7 Solr Properties in Cloudera Runtime 7.1.7 Spark Properties in Cloudera Runtime 7.1.7 Spark 3 Properties in Cloudera Runtime 7.1.7 SQOOP_CLIENT Properties in Cloudera Runtime 7.1.7 Streams Messaging Manager Properties in Cloudera Runtime 7.1.7 Streams Replication Manager Properties in Cloudera Runtime 7.1.7 Tez Properties in Cloudera Runtime 7.1.7 YARN Properties in Cloudera Runtime 7.1.7 YARN Queue Manager Properties in Cloudera Runtime 7.1.7 Zeppelin Properties in Cloudera Runtime 7.1.7 ZooKeeper Properties in Cloudera Runtime 7.1.7 Host Configuration Properties Cloudera Manager Server Properties Cloudera Management Service ▶︎ Metrics Reference ▶︎ Cloudera Manager Metrics Metric Aggregation Accumulo Metrics Active Database Metrics Active Key Trustee Server Metrics Activity Metrics Activity Monitor Metrics Agent Metrics Alert Publisher Metrics Atlas Metrics Atlas Server Metrics Attempt Metrics Authentication Server Metrics Authentication Server Load Balancer Metrics Authentication Service Metrics Cloudera Management Service Metrics Cloudera Manager Server Metrics Cluster Metrics Core Configuration Metrics Cruise Control Metrics Cruise Control Server Metrics Data Analytics Studio Metrics Data Analytics Studio Eventprocessor Metrics Data Analytics Studio Webapp Server Metrics Data Discovery Service Agent Metrics DataNode Metrics Directory Metrics Disk Metrics Docker Server Metrics Ecs Agent Metrics Ecs Server Metrics Event Server Metrics Failover Controller Metrics Filesystem Metrics Flume Metrics Flume Channel Metrics Flume Sink Metrics Flume Source Metrics Garbage Collector Metrics HBase Metrics HBase REST Server Metrics HBase RegionServer Replication Peer Metrics HBase Thrift Server Metrics HDFS Metrics HDFS Cache Directive Metrics HDFS Cache Pool Metrics HRegion Metrics HTable Metrics History Server Metrics Hive Metrics Hive Execution Metrics Hive LLAP Metrics Hive Metastore Server Metrics Hive Table Metrics Hive on Tez Metrics HiveServer2 Metrics Host Metrics Host Monitor Metrics HttpFS Metrics Hue Metrics Hue Server Metrics Impala Metrics Impala Catalog Server Metrics Impala Daemon Metrics Impala Daemon Resource Pool Metrics Impala Llama ApplicationMaster Metrics Impala Pool Metrics Impala Pool User Metrics Impala Query Metrics Impala StateStore Metrics Isilon Metrics Java KeyStore KMS Metrics JobHistory Server Metrics JobTracker Metrics JournalNode Metrics Kafka Metrics Kafka Broker Metrics Kafka Broker Log Directory Metrics Kafka Broker Topic Metrics Kafka Broker Topic Partition Metrics Kafka Connect Metrics Kafka Connect Connector Sink Task Metrics Metrics Kafka Connect Connector Source Task Metrics Metrics Kafka Connect Connector Task Error Metrics Metrics Kafka Connect Connector Task Metrics Metrics Kafka Consumer Group Metrics Kafka MirrorMaker Metrics Kafka Producer Metrics Kafka Replica Metrics Kerberos Ticket Renewer Metrics Key Management Server Metrics Key Management Server Proxy Metrics Key Trustee KMS Metrics Key Trustee Server Metrics Key-Value Store Indexer Metrics Knox Metrics Knox Gateway Metrics Knox IDBroker Metrics Kudu Metrics Kudu Replica Metrics LLAP Proxy Metrics Lily HBase Indexer Metrics Livy Metrics Livy Server Metrics Livy Server for Spark 3 Metrics Livy for Spark 3 Metrics Load Balancer Metrics MapReduce Metrics Master Metrics Monitor Metrics NFS Gateway Metrics NameNode Metrics Navigator Audit Server Metrics Navigator HSM KMS backed by SafeNet Luna HSM Metrics Navigator HSM KMS backed by Thales HSM Metrics Navigator Luna KMS Metastore Metrics Navigator Luna KMS Proxy Metrics Navigator Metadata Server Metrics Navigator Thales KMS Metastore Metrics Navigator Thales KMS Proxy Metrics Network Interface Metrics NodeManager Metrics Omid Metrics Omid tso server Metrics Oozie Metrics Oozie Server Metrics Ozone Metrics Ozone DataNode Metrics Ozone Manager Metrics Ozone Prometheus Metrics Ozone Recon Metrics Passive Database Metrics Passive Key Trustee Server Metrics Phoenix Metrics Profiler Admin Agent Metrics Profiler Manager Metrics Profiler Metrics Agent Metrics Profiler Scheduler Metrics Profiler Scheduler Agent Metrics Query Processor Metrics Query Server Metrics Ranger Metrics Ranger Admin Metrics Ranger KMS Metrics Ranger KMS Server Metrics Ranger KMS Server with KTS Metrics Ranger KMS with Key Trustee Server Metrics Ranger RMS Metrics Ranger RMS Server Metrics Ranger Raz Metrics Ranger Raz Server Metrics Ranger Tagsync Metrics Ranger Usersync Metrics RegionServer Metrics Reports Manager Metrics ResourceManager Metrics S3 Gateway Metrics SRM Distributed Herder metrics Metrics SRM Driver Metrics SRM Service Metrics Schema Registry Metrics Schema Registry Server Metrics SecondaryNameNode Metrics Sentry Metrics Sentry Server Metrics Server Metrics Service Monitor Metrics Solr Metrics Solr Replica Metrics Solr Server Metrics Solr Shard Metrics Spark Metrics Spark 3 Metrics Storage Container Manager Metrics Streams Messaging Manager Metrics Streams Messaging Manager Rest Admin Server Metrics Streams Messaging Manager UI Server Metrics Streams Replication Manager Metrics Tablet Server Metrics TaskTracker Metrics Telemetry Publisher Metrics Tez Metrics Time Series Table Metrics Tracer Metrics User Metrics WebHCat Server Metrics YARN Metrics YARN Pool Metrics YARN Pool User Metrics YARN Queue Manager Metrics YARN Queue Manager Store Metrics YARN Queue Manager Webapp Metrics Zeppelin Metrics Zeppelin Server Metrics ZooKeeper Metrics common.service.type.docker Metrics common.service.type.ecs Metrics ▶︎ Health Tests Reference ▶︎ Cloudera Manager Health Tests Active Database Health Tests Active Key Trustee Server Health Tests Activity Monitor Health Tests Alert Publisher Health Tests Atlas Health Tests Atlas Server Health Tests Authentication Server Health Tests Authentication Server Load Balancer Health Tests Authentication Service Health Tests Cloudera Management Service Health Tests Cruise Control Health Tests Cruise Control Server Health Tests DOCKER Health Tests Data Analytics Studio Eventprocessor Health Tests Data Analytics Studio Webapp Server Health Tests Data Discovery Service Agent Health Tests DataNode Health Tests Docker Server Health Tests ECS Health Tests Ecs Agent Health Tests Ecs Server Health Tests Event Server Health Tests Failover Controller Health Tests Flume Health Tests Flume Agent Health Tests Garbage Collector Health Tests HBase Health Tests HBase REST Server Health Tests HBase Thrift Server Health Tests HDFS Health Tests History Server Health Tests Hive Health Tests Hive Execution Health Tests Hive LLAP Health Tests Hive Metastore Server Health Tests Hive on Tez Health Tests HiveServer2 Health Tests Host Health Tests Host Monitor Health Tests HttpFS Health Tests Hue Health Tests Hue Server Health Tests Impala Health Tests Impala Catalog Server Health Tests Impala Daemon Health Tests Impala Llama ApplicationMaster Health Tests Impala StateStore Health Tests JobHistory Server Health Tests JobTracker Health Tests JournalNode Health Tests Kafka Health Tests Kafka Broker Health Tests Kafka Connect Health Tests Kafka MirrorMaker Health Tests Kerberos Ticket Renewer Health Tests Key Management Server Health Tests Key Management Server Proxy Health Tests Key-Value Store Indexer Health Tests Knox Health Tests Knox Gateway Health Tests Knox IDBroker Health Tests Kudu Health Tests LLAP Proxy Health Tests Lily HBase Indexer Health Tests Livy Health Tests Livy Server Health Tests Livy Server for Spark 3 Health Tests Livy for Spark 3 Health Tests Load Balancer Health Tests MapReduce Health Tests Master Health Tests Monitor Health Tests NFS Gateway Health Tests NameNode Health Tests Navigator Audit Server Health Tests Navigator Luna KMS Metastore Health Tests Navigator Luna KMS Proxy Health Tests Navigator Metadata Server Health Tests Navigator Thales KMS Metastore Health Tests Navigator Thales KMS Proxy Health Tests NodeManager Health Tests Omid Health Tests Omid tso server Health Tests Oozie Health Tests Oozie Server Health Tests Ozone DataNode Health Tests Ozone Manager Health Tests Ozone Prometheus Health Tests Ozone Recon Health Tests Passive Database Health Tests Passive Key Trustee Server Health Tests Phoenix Health Tests Profiler Admin Agent Health Tests Profiler Metrics Agent Health Tests Profiler Scheduler Agent Health Tests Query Processor Health Tests Query Server Health Tests Ranger Health Tests Ranger Admin Health Tests Ranger KMS Health Tests Ranger KMS Server Health Tests Ranger KMS Server with KTS Health Tests Ranger KMS with Key Trustee Server Health Tests Ranger RMS Health Tests Ranger RMS Server Health Tests Ranger Raz Health Tests Ranger Raz Server Health Tests Ranger Tagsync Health Tests Ranger Usersync Health Tests RegionServer Health Tests Reports Manager Health Tests ResourceManager Health Tests S3 Gateway Health Tests SRM Driver Health Tests SRM Service Health Tests Schema Registry Health Tests Schema Registry Server Health Tests SecondaryNameNode Health Tests Sentry Health Tests Sentry Server Health Tests Service Monitor Health Tests Solr Health Tests Solr Server Health Tests Spark Health Tests Spark 3 Health Tests Sqoop 2 Health Tests Sqoop 2 Server Health Tests Storage Container Manager Health Tests Streams Messaging Manager Health Tests Streams Messaging Manager Rest Admin Server Health Tests Streams Messaging Manager UI Server Health Tests Streams Replication Manager Health Tests Tablet Server Health Tests TaskTracker Health Tests Telemetry Publisher Health Tests Tracer Health Tests WebHCat Server Health Tests YARN Health Tests YARN Queue Manager Store Health Tests YARN Queue Manager Webapp Health Tests Zeppelin Health Tests Zeppelin Server Health Tests ZooKeeper Health Tests ZooKeeper Server Health Tests ▶︎ Event Schema Reference AUDIT_EVENT Category HBASE Category HEALTH_CHECK Category LOG_MESSAGE Category ACTIVITY_EVENT Category SYSTEM Category ▶︎ Entities Reference ▶︎ Cloudera Manager Entity Types and Attributes Cloudera Manager Entity Types Cloudera Manager Entity Type Attributes Encryption Reference (Recommended) Enable Auto-TLS Aborting a Pending Command Accessing Aggregate Statistics Through tsquery Accessing Files Within an Encryption Zone Accessing Storage Using Amazon S3 Accessing Storage Using Microsoft ADLS Accessing the Cloudera Manager Admin Console Accessing the Cloudera Manager Admin Console Accessing the Cloudera Manager Admin Console Accessing the Directory Usage Report Accessing the License Page Accessing the Ranger KMS Web UI Accessing the Web UI of a Completed Spark Application Accessing the Web UI of a Running Spark Application Accumulo Metrics ACLs supported by Ranger KMS and Ranger KMS Mapping Active Database Health Tests Active Database Metrics Active Key Trustee Server Health Tests Active Key Trustee Server Metrics Activity Charts Activity Metrics Activity Monitor Health Tests Activity Monitor Metrics Activity, Application, and Query Reports ACTIVITY_EVENT Category Add-on Services Adding a Cluster Using Currently Managed Hosts Adding a Cluster Using New Hosts Adding a Compute Cluster and Data Context Adding a Filter Adding a Host to a Cluster Adding a New Chart to the Custom Dashboard Adding a Role Instance Adding a Service Adding an Event Filter Adding and Deleting Clusters Adding and Removing Charts from a Dashboard Adding Files to an Encryption Zone Adding trusted realms to the cluster Additional Security Topics Additional Steps for Apache Ranger ADLS Connector Properties in Cloudera Runtime 7.1.7 Advantages of Parcels Advantages of Separating Compute and Data Resources After Evaluating Trial Software After You Install Agent Hosts Agent Metrics Alert Publisher Alert Publisher Health Tests Alert Publisher Metrics Alerts Allocating Hosts for Key Trustee Server and Key Trustee KMS Amazon S3 Security Apache Knox Install Role Parameters Applying a Host Template to a Host Architecture Architecture Assign Roles Atlas Atlas Health Tests Atlas Metrics Atlas Properties in Cloudera Runtime 7.1.7 Atlas Server Health Tests Atlas Server Metrics Attempt Metrics Audits AUDIT_EVENT Category Authentication Authentication Authentication Authentication and Kerberos Issues Authentication Overview Authentication Server Health Tests Authentication Server Load Balancer Health Tests Authentication Server Load Balancer Metrics Authentication Server Metrics Authentication Service Health Tests Authentication Service Metrics Authorization Overview Autoconfiguration Automatic Logout Automatic Logout Back up Key Trustee Server clients Back up Key Trustee Server manually Back up Key Trustee Server using Cloudera Manager Back up Key Trustee Server using the ktbackup.sh script Backing up databases Backing Up Encryption Keys Backing up Key Trustee Server and clients Backing up the Cloudera Manager configuration Before You Begin a Trial Installation Before You Install Before You Install Benefits and Capabilities Browsing HDFS directories Building a Chart with Time-Series Data Calculations for reports CDP Private Cloud Base Installation Guide CDP Private Cloud Base Requirements and Supported Versions CDP Private Cloud Base Trial Download Information Changed Behavior after HDFS Encryption is Enabled Changes for a cluster Changes for a service, role, or host Changing Embedded PostgreSQL Database Passwords Changing Hostnames Changing the Chart Type Changing the Configuration of a Service or Role Instance Changing the Upgrade Domain for hosts Channel encryption Chart Properties Charting Time-Series Data Charts Charts Library Check Cluster Security Settings Checking Host Heartbeats Choosing and Configuring Data Compression Choosing and Running a Filter Choosing and Running a Filter Choosing manual TLS or Auto-TLS Client Configuration Files Cloudera Authorization Cloudera license requirements for Replication Manager Cloudera Management Service Cloudera Management Service Cloudera Management Service Cloudera Management Service Health Tests Cloudera Management Service Metrics Cloudera Manager Cloudera Manager Cloudera Manager 7.6.5 Cumulative hotfix 1 Cloudera Manager 7.6.5 Cumulative hotfix 2 Cloudera Manager 7.6.5 Cumulative hotfix 3 Cloudera Manager 7.6.5 Cumulative hotfix 4 Cloudera Manager 7.6.5 Cumulative hotfix 5 Cloudera Manager 7.6.5 Release Notes Cloudera Manager Admin Console Cloudera Manager Agents Cloudera Manager Agents Cloudera Manager API Cloudera Manager Configuration Properties Reference for Cloudera Runtime 7.1.7 Cloudera Manager Download Information Cloudera Manager Entity Type Attributes Cloudera Manager Entity Types Cloudera Manager Entity Types and Attributes Cloudera Manager Health Tests Cloudera Manager Metrics Cloudera Manager Server Cloudera Manager Server Metrics Cloudera Manager Server Properties Cloudera Manager snapshot policies Cloudera Manager sudo command options Cloudera Manager support for Cloudera Runtime and CDH Cloudera Manager Trigger Use Cases Cloudera Manager user accounts Cloudera Manager User Roles Cloudera Manager Version Information Cloudera Navigator Key HSM Overview Cloudera Navigator Key Trustee Server Cloudera Navigator Key Trustee Server Overview Cloudera Runtime Cloudera Runtime Download Information Cloudera Runtime Version Information Cluster Configuration Overview Cluster Lifecycle Management with Cloudera Manager Cluster Metrics Cluster Support Tokens using Cloudera Manager Cluster Utilization Report overview Cluster-Wide Configuration Command Details Command Details Commands common.service.type.docker Metrics common.service.type.ecs Metrics Comparing Configurations for a Service Between Clusters Comparing Similar Activities Compatibility Considerations for Virtual Private Clusters Components Configuration Configuration Properties Reference Configure Antivirus Software on CDP Hosts Configure Authentication for Amazon S3 Configure authentication using Active Directory Configure authentication using an external program Configure authentication using an LDAP-compliant identity service Configure authentication using Kerberos (SPNEGO) Configure authentication using SAML Configure AWS Credentials Configure Browser-based Interfaces to Require Authentication (SPNEGO) Configure Browsers for Kerberos Authentication (SPNEGO) Configure Cloudera Manager for FIPS Configure Cluster to Use Kerberos Authentication Configure Encryption for Amazon S3 Configure Kafka brokers Configure Kafka brokers Configure Kafka clients Configure Kafka clients Configure Kafka MirrorMaker Configure Lily HBase Indexer to use TLS/SSL Configure Network Names Configure PostgreSQL for Streaming Components Configure Ranger with SSL/TLS enabled PostgreSQL Database Configure the Cluster Utilization Report Configure TLS encryption manually for Phoenix Query Server Configure TLS encryption manually for Schema Registry Configure TLS/SSL encryption for Solr Configure TLS/SSL encryption manually for Apache Ranger Configure TLS/SSL encryption manually for Ranger KMS Configure TLS/SSL encryption manually for Ranger RMS Configure TLS/SSL for Core Hadoop Services Configure TLS/SSL for HDFS Configure TLS/SSL for Oozie Configure TLS/SSL for YARN Configure Zookeeper TLS/SSL support for Kafka Configure ZooKeeper TLS/SSL using Cloudera Manager Configuring /tmp directory for cluster hosts Configuring a Custom Java Home Location Configuring a database for Ranger or Ranger KMS Configuring a dedicated MIT KDC for cross-realm trust Configuring a Local Package Repository Configuring a Local Parcel Repository Configuring a Mail Transfer Agent for Key Trustee Server Configuring a peer Configuring a PostgreSQL Database for Ranger or Ranger KMS Configuring a Proxy Server Configuring a Ranger or Ranger KMS Database: MySQL/MariaDB Configuring a Ranger or Ranger KMS Database: Oracle Configuring a Ranger or Ranger KMS Database: Oracle using /ServiceName format Configuring a Secure Credential Storage Provider for Cloudera Manager (Technical Preview) Configuring Alert Delivery Configuring Alert Email Delivery Configuring Alert SNMP Delivery Configuring Alerts Transitioning Out of Alerting Health Threshold Configuring and Managing S3Guard Configuring and Starting the PostgreSQL Server Configuring Authentication in Cloudera Manager Configuring Authentication in Cloudera Manager Configuring Built-in TLS Acceleration Configuring CDP Services for HDFS Encryption Configuring Cloudera Manager Configuring Cloudera Manager Agents Configuring Cloudera Manager Server Ports Configuring Cloudera Manager to Use an Internal Remote Parcel Repository Configuring Clusters Configuring collection of Cloudera Manager table data Configuring Custom Alert Scripts Configuring Custom Cgroups Configuring custom Kerberos principal for Apache Flink Configuring custom Kerberos principal for Atlas Configuring custom Kerberos principal for Cruise Control Configuring custom Kerberos principal for HBase Configuring custom Kerberos principal for HDFS Configuring custom Kerberos principal for Hive and Hive-on-Tez Configuring custom Kerberos principal for HttpFS Configuring custom Kerberos principal for Hue Configuring custom Kerberos principal for Knox Configuring custom Kerberos principal for Kudu Configuring custom Kerberos principal for Livy Configuring custom Kerberos principal for NiFi and NiFi Registry Configuring custom Kerberos principal for Omid Configuring custom Kerberos principal for Oozie Configuring custom Kerberos principal for Ozone Configuring custom Kerberos principal for Phoenix Configuring custom Kerberos principal for Spark Configuring custom Kerberos principal for SQL Stream Builder Configuring custom Kerberos principal for Streams Messaging Manager Configuring custom Kerberos principal for Zeppelin Configuring custom Kerberos principal for ZooKeeper Configuring custom Kerberos principals and custom system users for Solr Configuring Dashboards Configuring Directory Monitoring Configuring external authentication and authorization for Cloudera Manager Configuring HDFS properties to optimize log collection Configuring Health Monitoring Configuring Host Monitor Data Storage Configuring Host Monitoring Configuring Hosts Configuring Hosts to Use the Internal Repository Configuring Hue as a TLS/SSL client Configuring Hue as a TLS/SSL server Configuring Impala Query Data Store Maximum Size Configuring Impala Query Monitoring Configuring Impala Query Monitoring Configuring Impala TLS/SSL Configuring Kerberos Authentication Configuring Key Trustee Server High Availability Using Cloudera Manager Configuring LDAP Group Mappings Configuring Local Package and Parcel Repositories Configuring Log Alerts Configuring Log Alerts Configuring Log Directories Configuring Log Events Configuring Logging Thresholds Configuring Logs Configuring Management Service Database Limits Configuring Maximum File Descriptors Configuring Memory Allocations Configuring Monitoring Settings Configuring multiple listeners Configuring MySQL for Streaming Components Configuring Network Settings for a Proxy Server Configuring OAuth in Data Hub Configuring OAuth with core-site.xml Configuring OAuth with the Hadoop CredentialProvider Configuring PAM authentication using Apache Knox Configuring PAM authentication with LDAP and SSSD Configuring PAM authentication with Linux users Configuring peers with SAML authentication Configuring Periodic Stacks Collection Configuring Resource Parameters Configuring Roles to Use a Custom Garbage Collection Parameter Configuring S3Guard for Cluster Access to S3 Configuring Service Monitor Data Storage Configuring Service Monitoring Configuring Services to Use LZO Compression Configuring Suppression of Health Tests Before Tests Run Configuring the Database for Streaming Components Configuring the Frequency of Diagnostic Data Collection Configuring the Hue Server to Store Data in the Oracle database Configuring the Kerberos principal used by Kafka Configuring the Kerberos principal used by SRM Configuring the Key HSM Configuring Time-Series Query Results Configuring TLS Encryption for Cloudera Manager Using Auto-TLS Configuring TLS encryption manually for Apache Atlas Configuring TLS/SSL encryption Configuring TLS/SSL encryption for Kudu using Cloudera Manager Configuring TLS/SSL encryption manually for Apache Knox Configuring TLS/SSL encryption manually for CDP Services Configuring TLS/SSL encryption manually for DAS using Cloudera Manager Configuring TLS/SSL encryption manually for Key Trustee Server Configuring TLS/SSL encryption manually for Livy Configuring TLS/SSL encryption manually for NiFi and NiFi Registry Configuring TLS/SSL encryption manually for Spark Configuring TLS/SSL encryption manually for Zeppelin Configuring TLS/SSL for HBase Configuring TLS/SSL for HBase REST Server Configuring TLS/SSL for HBase Thrift Server Configuring TLS/SSL for HBase Web UIs Configuring TLS/SSL for Hue Configuring TLS/SSL for the KMS Configuring TLS/SSL manually Configuring Upgrade Domains Configuring Upgrade Domains Configuring Which Log Messages Become Events Configuring YARN Application Monitoring Configuring YARN Application Monitoring Considerations for realm names ContainerExecutor Error Codes (YARN) Convert DER, JKS, PEM Files for TLS/SSL Artifacts Converting from Device Names to UUIDs for Encrypted Devices Core Configuration Metrics Core Configuration Properties in Cloudera Runtime 7.1.7 Core Configuration Service Create a Kafka Topic to Store your Events Create a Streams Cluster on CDP Private Cloud Base Creating a Custom Cluster Utilization Report Creating a Dashboard Creating a Hive/Impala replication policy Creating a Host Template Creating a Permanent Internal Repository Creating a Pre-Deployed Cloudera Manager Host Creating a Pre-Deployed Worker Host Creating a Role Group Creating a Runtime Cluster Using a Cloudera Manager Template Creating a Temporary Internal Repository Creating a Trigger for CPU Capacity Creating a Trigger for Memory Capacity Creating a Trigger Using the Expression Editor Creating a truststore file in PEM format Creating Encryption Zones Creating HDFS replication policy Creating the Template Creating Triggers from Charts Creating Virtual Images of Cluster Hosts Cruise Control Health Tests Cruise Control Metrics Cruise Control Server Health Tests Cruise Control Server Metrics Cumulative hotfixes Custom Configuration Custom Installation Scenarios Custom Installation Solutions Customizing Kerberos principals Customizing the Kerberos principal for Schema Registry Dashboard Types Dashboards Data Analytics Studio (DAS) Data Analytics Studio Eventprocessor Health Tests Data Analytics Studio Eventprocessor Metrics Data Analytics Studio Metrics Data Analytics Studio Properties in Cloudera Runtime 7.1.7 Data Analytics Studio Webapp Server Health Tests Data Analytics Studio Webapp Server Metrics Data at Rest Encryption Reference Architecture Data at Rest Encryption Requirements Data at Rest Encryption Requirements Data Context Connector Properties in Cloudera Runtime 7.1.7 Data Discovery Service Agent Health Tests Data Discovery Service Agent Metrics Data Encryption Components and Solutions Data Granularity and Time-Series Metric Data Data replication Data Storage for Monitoring Data Database Requirements DataNode Health Tests DataNode Metrics Deactivate and Remove Parcels Decommissioning Hosts Decommissioning Role Instances Decrease Reserve Space Default User Roles Delete a Key Delete the Cluster Deleting a Cluster Deleting a Host from Cloudera Manager Deleting Encryption Zones Deleting Hosts Deleting Role Instances Deleting Services Dell EMC PowerScale Deploying Atlas service Deploying Clients Designating a replication source Designating Directories to Include in Disk Usage Reports Diagnostic Data Collection Directory Metrics Directory Usage Report Disable the Firewall Disabling Redaction of sensitive information when using the Cloudera Manager API Disabling Static Service Pools Disabling the Automatic Sending of Diagnostic Data from a Manually Triggered Collection Disabling the Firewall Disabling Transparent Hugepages (THP) Discovering possible predicates Disk Metrics Disk Usage Reports Disk Usage Reports Displaying Chart Details DOCKER Health Tests Docker Server Health Tests Docker Server Metrics Download the Cluster Utilization Report Download the Trial version of CDP Private Cloud Base Download the Trial version of CDP Private Cloud Base Downloading and Publishing the Package Repository Downloading and Publishing the Parcel Repository Downloading Audit Events Downloading Client Configuration Files Downloading HDFS Directory Access Permission Reports Downloading Reports as CSV and XLS Files Ecs Agent Health Tests Ecs Agent Metrics ECS Health Tests Ecs Server Health Tests Ecs Server Metrics Editing a Chart Editing a Host Template Editing the S3Guard Configuration Editing, Deleting, Suppressing, or Deleting a Trigger Enable an NTP Service Enable an NTP Service Enable security for Cruise Control Enable Sensitive Data Redaction Enable the Cluster Utilization Report Enabling and Configuring Static Service Pools Enabling and disabling HDFS snapshots Enabling and Disabling Log Event Capture Enabling Configuration Change Alerts Enabling Configuration Change Alerts Enabling custom Kerberos principal support in a Queue Manager cluster Enabling custom Kerberos principal support in YARN Enabling Fast Upload using Cloudera Manager Enabling HBase Alerts Enabling Health Alerts Enabling Hue as a TLS/SSL client Enabling Hue as a TLS/SSL server using Cloudera Manager Enabling Kerberos Authentication for CDP Enabling Kerberos Authentication for the KMS Enabling replication between clusters with Kerberos Authentication Enabling Resource Management with Control Groups Enabling security for Apache Flink Enabling Snapshots Enabling TLS Encryption for SMM on CDP Private Cloud Enabling TLS/SSL communication with HiveServer2 Enabling TLS/SSL communication with Impala Enabling TLS/SSL for HiveServer Enabling TLS/SSL for Hue Load Balancer Enabling TLS/SSL for the SRM service Enabling, disabling, or deleting a replication policy Encrypting and Decrypting Data Using Cloudera Navigator Encrypt Encrypting Data at Rest Encrypting Data at Rest Encrypting Data in Transit Encrypting Data in Transit Encrypting data in transit between clusters Encryption in SSB Encryption Mechanisms Encryption Overview Encryption Zones and Keys Ending a CDP Private Cloud Base Trial Enter Required Parameters Entities Reference Error Messages and Various Failures Event Schema Reference Event Server Event Server Health Tests Event Server Metrics Events Example configuration to add to the sudoers file Exporting Data from Charts Exporting the Cluster Configuration Extending Cloudera Manager Failover Controller Health Tests Failover Controller Metrics FAQ Filesystem Metrics Filter Attributes Filter Attributes Filter Expressions Filter Expressions Filtering Audit Events Filtering by Day of Week or Hour of Day Filtering Events Filtering Jobs Filtering Logs Filtering Metrics Filtering Metrics Filtering Queries Filtering the Activities List Filtering the Tasks List Filters Fixed Issues in Cloudera Manager 7.6.5 Flume Agent Health Tests Flume Channel Metrics Flume Health Tests Flume Metrics Flume Sink Metrics Flume Source Metrics Garbage Collector Health Tests Garbage Collector Metrics Generating a New Certificate Getting Started on your Streams Cluster Grouping (Faceting) Time Series Guidelines for using snapshot diff-based replication Hadoop Users (user:group) and Kerberos Principals Hardware Requirements HBase HBASE Category HBase Health Tests HBase Metrics HBase Properties in Cloudera Runtime 7.1.7 HBase RegionServer Replication Peer Metrics HBase REST Server Health Tests HBase REST Server Metrics HBase Thrift Server Health Tests HBase Thrift Server Metrics HDFS HDFS Cache Directive Metrics HDFS Cache Pool Metrics HDFS Encryption Issues HDFS Health Tests HDFS Metrics HDFS Properties in Cloudera Runtime 7.1.7 HDFS replication from Sentry-enabled clusters HDFS replication policies HDFS replication policy considerations HDFS Transparent Encryption HDFS, Hive, and Impala replication Health Tests Health Tests and Health History Health Tests and Health History Health Tests Reference HEALTH_CHECK Category History Server Health Tests History Server Metrics Hive Hive Execution Health Tests Hive Execution Metrics Hive external table replication in dynamic environments Hive Health Tests Hive LLAP Health Tests Hive LLAP Metrics Hive LLAP Properties in Cloudera Runtime 7.1.7 Hive Metastore Server Health Tests Hive Metastore Server Metrics Hive Metrics Hive on Tez Health Tests Hive on Tez Metrics Hive on Tez Properties in Cloudera Runtime 7.1.7 Hive Properties in Cloudera Runtime 7.1.7 Hive replication policy considerations Hive Table Metrics Hive tables and DDL commands Hive/Impala replication policies Hive/Impala replication with snapshots HiveServer2 Health Tests HiveServer2 Metrics Home Page Host Configuration Properties Host Details Host Health Tests Host Inspector Host Management Host Metrics Host Monitor Host Monitor and Service Monitor Memory Configuration Host Monitor Health Tests Host Monitor Metrics Host Templates Hosts Disks Overview How Client Configurations are Deployed How to Add Root and Intermediate CAs to Truststore for TLS/SSL How to Authenticate Kerberos Principals Using Java How to Configure a MapReduce Job to Access S3 with an HDFS Credstore HRegion Metrics HSM-Specific Setup for Cloudera Navigator Key HSM HTable Metrics HttpFS Health Tests HttpFS Metrics Hue Hue Health Tests Hue in a Virtual Private Cluster Environment Hue Metrics Hue Properties in Cloudera Runtime 7.1.7 Hue Server Health Tests Hue Server Metrics IBM Spectrum Scale Identify Roles that Use the Embedded Database Server Impala Impala Best Practices Impala Catalog Server Health Tests Impala Catalog Server Metrics Impala Daemon Health Tests Impala Daemon Metrics Impala Daemon Resource Pool Metrics Impala Health Tests Impala Llama ApplicationMaster Health Tests Impala Llama ApplicationMaster Metrics Impala Metrics Impala Pool Metrics Impala Pool User Metrics Impala Properties in Cloudera Runtime 7.1.7 Impala query counter metrics Impala Query Metrics Impala Requirements Impala StateStore Health Tests Impala StateStore Metrics Impala Tab Import Data from RDBMS into an S3 Bucket Import Data into an External Hive Table Backed by S3 Import Data into S3 Bucket in Incremental Mode Importing Data into Amazon S3 Using Sqoop Importing Data into Microsoft Azure Data Lake Store (Gen1 and Gen2) Using Sqoop Importing the Template to a New Cluster Improving Performance in Shuffle Handler and IFile Reader Initializing Navigator Key HSM Initializing Standalone Key Trustee Server Initializing Standalone Key Trustee Server Using Cloudera Manager Initiating HDFS failover using the Cloudera Manager API Insert data in test_table through Spark Inspecting Network Performance Install and configure additional required components Install and Configure MariaDB Install and Configure MySQL Install and Configure Oracle Database Install and Configure PostgreSQL for CDP Install Cloudera Manager Packages Install Cloudera Manager Packages Install Cloudera Runtime Install Cloudera Runtime Installation Reference Installation Wizard Installing a Java Keystore KMS Installing a Kafka-centric cluster Installing a Trial Cluster Installing a Trial Streaming Cluster Installing and Configuring CDP with FIPS Installing Apache Knox Installing Atlas using Add Service Installing CDP Private Cloud Base Installing Cloudera Manager, Cloudera Runtime, and Managed Services Installing Cloudera Navigator Encrypt Installing Cloudera Navigator Key HSM Installing OpenJDK for CDP Runtime Installing OpenJDK on Cloudera Manager Installing Oracle JDK for CDP Runtime Installing Postgres JDBC Driver Installing PostgreSQL Server Installing Ranger KMS backed by a Database and HA Installing Ranger KMS backed with a Key Trustee Server and HA Installing Ranger RMS Installing Ranger using Add Service Installing the GPL Extras Parcel Installing the psycopg2 Python package for PostgreSQL-backed Hue Instantiating a Cloudera Manager Image Instantiating a worker host Integrating Components for Encrypting Data at Rest Integrating Key HSM with Key Trustee Server Integrating MIT Kerberos and Active Directory Inter-broker security Introduction to Parcels Isilon Metrics Java KeyStore KMS Metrics Java KeyStore KMS Properties in Cloudera Runtime 7.1.7 Java Requirements JobHistory Server Health Tests JobHistory Server Metrics JobTracker Health Tests JobTracker Metrics JournalNode Health Tests JournalNode Metrics Kafka Kafka Broker Health Tests Kafka Broker Log Directory Metrics Kafka Broker Metrics Kafka Broker Topic Metrics Kafka Broker Topic Partition Metrics Kafka Connect Connector Sink Task Metrics Metrics Kafka Connect Connector Source Task Metrics Metrics Kafka Connect Connector Task Error Metrics Metrics Kafka Connect Connector Task Metrics Metrics Kafka Connect Health Tests Kafka Connect Metrics Kafka Consumer Group Metrics Kafka Health Tests Kafka Metrics Kafka MirrorMaker Health Tests Kafka MirrorMaker Metrics Kafka Producer Metrics Kafka Properties in Cloudera Runtime 7.1.7 Kafka Replica Metrics Kerberos authentication for non-default users Kerberos Configuration Strategies for CDP Kerberos connectivity test Kerberos Security Artifacts Overview Kerberos Ticket Renewer Health Tests Kerberos Ticket Renewer Metrics Key Concepts and Architecture Key Management Server Health Tests Key Management Server Metrics Key Management Server Proxy Health Tests Key Management Server Proxy Metrics Key Trustee KMS Key Trustee KMS Encryption Issues Key Trustee KMS Metrics Key Trustee KMS operations not supported by Ranger KMS Key Trustee KMS Properties in Cloudera Runtime 7.1.7 Key Trustee Server Key Trustee Server Metrics Key Trustee Server Properties for TLS Key Trustee Server Properties in Cloudera Runtime 7.1.7 Key Trustee Server System Requirements Key-Value Store Indexer Health Tests Key-Value Store Indexer Metrics Key-Value Store Indexer Properties in Cloudera Runtime 7.1.7 Keystores and the Key Management Server KMS ACL Configuration for Hive Known Issues in Cloudera Manager 7.6.5 Knox Gateway Health Tests Knox Gateway Metrics Knox Health Tests Knox IDBroker Health Tests Knox IDBroker Metrics Knox Metrics Knox Properties for TLS Knox Properties in Cloudera Runtime 7.1.7 Kudu Kudu Health Tests Kudu Metrics Kudu Properties in Cloudera Runtime 7.1.7 Kudu Replica Metrics Lifecycle and Security Auditing Lily HBase Indexer Health Tests Lily HBase Indexer Metrics Limitations Limiting replication hosts Linux Control Groups (cgroups) List and Create Keys Listing Repositories Livy for Spark 3 Health Tests Livy for Spark 3 Metrics Livy for Spark 3 Properties in Cloudera Runtime 7.1.7 Livy Health Tests Livy Metrics Livy Properties in Cloudera Runtime 7.1.7 Livy Server for Spark 3 Health Tests Livy Server for Spark 3 Metrics Livy Server Health Tests Livy Server Metrics LLAP Proxy Health Tests LLAP Proxy Metrics Load Balancer Health Tests Load Balancer Metrics Log a Security Support Case Log Details Logs Logs and Events Logs List LOG_MESSAGE Category Maintaining Cloudera Navigator Encrypt Maintenance Mode Managing Alerts Managing Anonymous Usage Data Collection Managing Cloudera Manager Managing Cloudera Manager Server Logs Managing Cloudera Runtime Services Managing Clusters Managing Dashboards Managing Disk Space for Log Files Managing Encryption Keys and Zones Managing HDFS snapshots Managing Hosts Managing Kerberos credentials using Cloudera Manager Managing Key Trustee Server Certificates Managing Key Trustee Server Organizations Managing Licenses Managing Parcels Managing Re-encryption Operations Managing Role Groups Managing Roles Managing snapshot policies Managing Spark Driver Logs Managing Suppressed Validations Managing the Cloudera Manager Agent Logs Managing the Navigator Key HSM Service Manually Configuring TLS Encryption for Cloudera Manager Manually Configuring TLS Encryption on the Agent Listening Port Manually Install Cloudera Manager Agent Packages Manually Install Cloudera Software Packages Manually Redeploying Client Configuration Files Manually Triggering Collection and Transfer of Diagnostic Data to Cloudera Mapping Kerberos Principals to Short Names MapReduce Health Tests MapReduce Metrics Master Health Tests Master Metrics Metric Aggregation Metric Aggregation Metric Expression Functions Metric Expressions Metrics and queries Metrics Reference Migrate Databases from the Embedded Database Server to the External PostgreSQL Database Server Migrate from the Cloudera Manager External PostgreSQL Database Server to a MySQL/Oracle Database Server Migrate the Ranger Admin role instance to a new host Migrate the Ranger KMS db role instance to a new host Migrate the Ranger KMS KTS role instance to a new host Migrating ACLs from Key Trustee KMS to Ranger KMS Migrating Embedded PostgreSQL Database to External PostgreSQL Database Migrating from PostgreSQL Database Server to MySQL/Oracle Database Server Migrating from the Cloudera Manager Embedded PostgreSQL Database Server to an External PostgreSQL Database Migrating Keys from a Java KeyStore to Cloudera Navigator Key Trustee Server Migrating Ranger Key Management Server Role Instances to a New Host Modifying Configuration Properties Using Cloudera Manager Modifying peers Modifying the Health Threshold Monitor Health Tests Monitor Metrics Monitor your Cluster from the SMM UI Monitoring a Cluster Using Cloudera Manager Monitoring Activities Monitoring and Diagnostics Monitoring and Diagnostics Monitoring Clusters Monitoring Hosts Monitoring Impala Queries Monitoring Service Status Monitoring Services Monitoring Spark Applications Monitoring the performance of HDFS replication policies Monitoring the performance of Hive/Impala replication policies Monitoring YARN Applications Moving a Host Between Clusters Moving and Resizing Charts Moving Monitoring Data on an Active Cluster Moving the Cloudera Manager Server to a New Host NameNode Health Tests NameNode Metrics Navigator Audit Server Health Tests Navigator Audit Server Metrics Navigator Encrypt Navigator Encrypt Access Control List Navigator Encrypt Overview Navigator HSM KMS backed by SafeNet Luna HSM Metrics Navigator HSM KMS backed by Thales HSM Metrics Navigator Key HSM Navigator Key Trustee Server Navigator Luna KMS Metastore Health Tests Navigator Luna KMS Metastore Metrics Navigator Luna KMS Proxy Health Tests Navigator Luna KMS Proxy Metrics Navigator Metadata Server Health Tests Navigator Metadata Server Metrics Navigator Thales KMS Metastore Health Tests Navigator Thales KMS Metastore Metrics Navigator Thales KMS Proxy Health Tests Navigator Thales KMS Proxy Metrics Network Interface Metrics Network latency during replication Networking and Security Requirements Networking Considerations for Virtual Private Clusters NFS Gateway Health Tests NFS Gateway Metrics NiFi Registry TLS/SSL Properties NiFi TLS/SSL properties NodeManager Health Tests NodeManager Metrics Obtain and Deploy Keys and Certificates for TLS/SSL Obtaining Time-Series Data Using the API Omid Health Tests Omid Metrics Omid tso server Health Tests Omid tso server Metrics Oozie Oozie Health Tests Oozie Metrics Oozie Properties in Cloudera Runtime 7.1.7 Oozie Server Health Tests Oozie Server Metrics Operating System Requirements Optimizing Performance for HDFS Transparent Encryption Optimizing Performance in Cloudera Runtime Orphaned snapshots Other Tasks and Settings Overriding Configuration Properties Overriding custom keystore alias on a Ranger KMS Server Overview Overview Overview Overview Overview Overview Overview of Parcels Overview Tab Ozone Ozone DataNode Health Tests Ozone DataNode Metrics Ozone Manager Health Tests Ozone Manager Metrics Ozone Metrics Ozone Prometheus Health Tests Ozone Prometheus Metrics Ozone Properties in Cloudera Runtime 7.1.7 Ozone Recon Health Tests Ozone Recon Metrics Parcel Configuration Settings Parcel Life Cycle Parcel Locations Parcels Passive Database Health Tests Passive Database Metrics Passive Key Trustee Server Health Tests Passive Key Trustee Server Metrics Pausing a Cluster in AWS Performance and scalability limitations for HDFS replication policies Performance Considerations Performance Management Performance Trade Offs Performing Maintenance on a Cluster Host Periodic Stacks Collection Phoenix Phoenix Health Tests Phoenix Metrics Phoenix Properties in Cloudera Runtime 7.1.7 Port requirements for Replication Manager on CDP Private Cloud Base Ports Ports Ports Used by Cloudera Manager Ports Used by Cloudera Navigator Key Trustee Server Ports Used by Cloudera Runtime Components Ports Used by DistCp Ports Used by Third-Party Components Predicates Preparing a New Cluster Preparing for Encryption Using Cloudera Navigator Encrypt Prerequisites Prerequisites Prerequisites Prerequisites and Assumptions Prerequisites and exceptions for the example configuration Prerequisites for installing Atlas Prerequisites to configure TLS/SSL for HBase Presentation of Aggregate Data Principal name mapping Privileged commands for Cloudera Manager installation Process Management Processes Production Installation Profiler Admin Agent Health Tests Profiler Admin Agent Metrics Profiler Manager Metrics Profiler Metrics Agent Health Tests Profiler Metrics Agent Metrics Profiler Scheduler Agent Health Tests Profiler Scheduler Agent Metrics Profiler Scheduler Metrics Putting all Hosts in an Upgrade Domain group into Maintenance Mode Query Details Query Processor Health Tests Query Processor Metrics Query Server Health Tests Query Server Metrics Querying metric data Quick Start Deployment for a Streams Cluster Ranger Ranger Admin Health Tests Ranger Admin Metrics Ranger Health Tests Ranger KMS Health Tests Ranger KMS Metrics Ranger KMS Server Health Tests Ranger KMS Server Metrics Ranger KMS Server with KTS Health Tests Ranger KMS Server with KTS Metrics Ranger KMS with Key Trustee Server Health Tests Ranger KMS with Key Trustee Server Metrics Ranger Metrics Ranger Properties in Cloudera Runtime 7.1.7 Ranger Raz Health Tests Ranger Raz Metrics Ranger Raz Server Health Tests Ranger Raz Server Metrics Ranger RMS Health Tests Ranger RMS Metrics Ranger RMS Server Health Tests Ranger RMS Server Metrics Ranger Tagsync Health Tests Ranger Tagsync Metrics Ranger Usersync Health Tests Ranger Usersync Metrics Re-encrypting an EDEK Re-encrypting Encrypted Data Encryption Keys (EDEKs) Read the Events Recommissioning Hosts Recommissioning Role Instances Record User Data Paths Recovering a Key Trustee Server Redaction of Sensitive Information from Diagnostic Bundles Referencing Amazon S3 in URIs Referencing S3 Credentials for YARN, MapReduce, or Spark Clients RegionServer Health Tests RegionServer Metrics Registering Cloudera Navigator Encrypt with Key Trustee Server Release Notes Remove Cloudera Manager, User Data, and Databases Removing a Chart from a Custom Dashboard Removing a Filter Removing a Host From a Cluster Removing an Event Filter Renaming a Cluster Renaming a Service Renew and Redistribute Certificates Renewing a License Replacing Key Trustee Server Certificates Replicating data to Impala clusters Replicating directories with thousands of files and subdirectories Replicating from unsecure to secure clusters Replication Manager Replication Manager in CDP Private Cloud Base Replication Manager log retention Replication of encrypted data Replication of Impala and Hive User Defined Functions (UDFs) Replication of parameters Reports Reports Manager Reports Manager Health Tests Reports Manager Metrics Repository Configuration Files Required Databases Resetting Configuration Properties to the Default Value Resource Management Resource Management Resource Planning for Data at Rest Encryption ResourceManager Health Tests ResourceManager Metrics Resources Restarting a Cloudera Runtime Service Restarting Services and Instances after Configuration Changes Restarting the Cloudera Management Service Restore Key Trustee Server from ktbackup.sh backups Restore Key Trustee Server in package-based installations Restore Key Trustee Server in parcel-based installations Restoring Navigator Key Trustee Server Restoring Snapshots Restoring the Cloudera Manager configuration Results Tab Results Tab Retrieving metric data Review Changes Role Assignments Role Groups Role Instance Reference Role Instances Roll Over an Existing Key Rolling Encryption Keys Rolling Restart Run the Cloudera Manager Server Installer Run the Cloudera Manager Server Installer Running a MapReduce Job Running Diagnostic Commands for Roles Running the Host Inspector Running the Prune Command Using Cloudera Manager Admin Console Running the Prune Command Using the Cloudera Manager API Runtime Cluster Hosts and Role Assignments S3 Connector Properties in Cloudera Runtime 7.1.7 S3 Gateway Health Tests S3 Gateway Metrics S3Guard with Sqoop Sample Custom Alert Script Sample Python Code SAN Certificates Saving a Chart Saving Charts to a New Dashboard Saving Charts to an Existing Dashboard Saving Charts to Dashboards Schema Registry Health Tests Schema Registry Metrics Schema Registry Properties in Cloudera Runtime 7.1.7 Schema Registry Server Health Tests Schema Registry Server Metrics Search Searching for Properties Searching Within the File System SecondaryNameNode Health Tests SecondaryNameNode Metrics Secure Your Cluster Securing database connections with TLS/SSL Securing the Key Management System (KMS) Security considerations Security Management Security Overview Select Services Selecting a Point In Time or a Time Range Selecting Columns to Show in the Activities List Selecting Columns to Show in the Tasks List Sending Diagnostic Data to Cloudera for YARN Applications Sending Usage and Diagnostic Data to Cloudera Sentry Health Tests Sentry Metrics Sentry Server Health Tests Sentry Server Metrics Sentry to Ranger replication Server and Client Configuration Server Metrics Service Dependencies in Cloudera Manager Service Monitor Health Tests Service Monitor Metrics Service Monitor Requirements Service Summary Set Up a Cluster Using the Wizard Set Up a Gateway Host to Restrict Access to the Cluster Set Up a Streaming Cluster Set Up Access to Cloudera EDH (Microsoft Azure Marketplace) Set Up an Environment Set up CipherTrust HSM for Ranger KMS, KTS, and KeyHSM Set up GCP Cloud HSM for Ranger KMS, KTS, and KeyHSM Set up Luna 6 HSM for Ranger KMS, KTS, and KeyHSM Set up Luna 7 HSM for Ranger KMS w/database Set up Luna 7 HSM for Ranger KMS, KTS, and KeyHSM Setting an Advanced Configuration Snippet for a Cloudera Runtime Service Setting an Advanced Configuration Snippet for a Cluster Setting Quotas Setting SELinux Mode Setting the vm.swappiness Linux Kernel Parameter Setting Up a Web Server Setting Up a Web Server Setting Up Data at Rest Encryption for HDFS Setting Up Key Trustee Server High Availability Setup Database Shutting Down and Starting Up the Cluster Snapshots Snapshots history Software Distribution Management Solr Health Tests Solr Metrics Solr Properties in Cloudera Runtime 7.1.7 Solr Replica Metrics Solr Server Health Tests Solr Server Metrics Solr Shard Metrics Solutions to Common Problems Sorting the Activities List Sorting the Tasks List Source data during replication Spark Spark 3 Health Tests Spark 3 Metrics Spark 3 Properties in Cloudera Runtime 7.1.7 Spark Health Tests Spark Metrics Spark Properties in Cloudera Runtime 7.1.7 Specifying hosts to improve Hive replication policy performance Specifying Racks for Hosts Specifying the Diagnostic Data Directory Specifying TLS/SSL Minimum Allowed Version and Ciphers Sqoop 2 Health Tests Sqoop 2 Server Health Tests Sqoop Import into ADLS Sqoop Import into Amazon S3 SQOOP_CLIENT Properties in Cloudera Runtime 7.1.7 SRM Distributed Herder metrics Metrics SRM Driver Health Tests SRM Driver Metrics SRM Service Health Tests SRM Service Metrics Stale Configurations Starting a Cloudera Runtime Service on All Hosts Starting All the Roles on a Host Starting and Stopping Cloudera Management Service Roles Starting the Cloudera Management Service Starting the Embedded PostgreSQL Database Starting, Stopping, and Restarting Cloudera Manager Agents Starting, Stopping, and Restarting Role Instances Starting, Stopping, and Restarting the Cloudera Manager Server Starting, Stopping, Refreshing, and Restarting a Cluster State Management Static Service Pools Status Status Summary Status Summary Step 11: Inspect Cluster Step 1: Configure a Repository for Cloudera Manager Step 1: Identify Roles that Use the Embedded Database Server Step 1: Install Cloudera Manager and CDP Step 1: Welcome (Add Cluster - Installation) Step 1: Welcome (Add Cluster - Installation) Step 2: Cluster Basics Step 2: Cluster Basics Step 2: Install Java Development Kit Step 2: Install JCE policy files for AES-256 encryption Step 2: Migrate Databases from the Embedded Database Server to the External PostgreSQL Database Server Step 3: Create the Kerberos Principal for Cloudera Manager Server Step 3: Install Cloudera Manager Server Step 3: Setup Auto-TLS Step 3: Setup Auto-TLS Step 4. Install and Configure Databases Step 4: Enable Kerberos using the wizard Step 4: Specify Hosts Step 4: Specify Hosts Step 5: Create the HDFS superuser Step 5: Select Repository Step 5: Select Repository Step 5: Set up and configure the Cloudera Manager database Step 6: Get or create a Kerberos principal for each user account Step 6: Install Parcels Step 6: Install Runtime and Other Software Step 6: Select JDK Step 7: Enter Login Credentials Step 7: Prepare the cluster for each user Step 7: Set Up a Cluster Using the Wizard Step 8: Inspect Cluster Step 8: Install Agents Step 8: Verify that Kerberos security is working Step 9: (Optional) Enable authentication for HTTP web consoles for Hadoop roles Step 9: Install Parcels Stop all Services Stopping a Cloudera Runtime Service on All Hosts Stopping All the Roles on a Host Stopping the Cloudera Management Service Stopping the Embedded PostgreSQL Database Storage Container Manager Health Tests Storage Container Manager Metrics Storage Space Planning for Cloudera Manager Streams Messaging Manager Health Tests Streams Messaging Manager Metrics Streams Messaging Manager Properties in Cloudera Runtime 7.1.7 Streams Messaging Manager Rest Admin Server Health Tests Streams Messaging Manager Rest Admin Server Metrics Streams Messaging Manager UI Server Health Tests Streams Messaging Manager UI Server Metrics Streams Replication Manager Health Tests Streams Replication Manager Metrics Streams Replication Manager Properties in Cloudera Runtime 7.1.7 Summary Summary Support matrix for Replication Manager on CDP Private Cloud Base Suppressing a Configuration Validation in Cloudera Manager Suppressing a Health Test Suppressing Configuration and Parameter Validation Warnings Suppressing Configuration Validations Before They Trigger Warnings Suppressing Health Test Results Syntax for scm_prepare_database.sh SYSTEM Category System Requirements for POC Streams Cluster Tablet Server Health Tests Tablet Server Metrics Taking and deleting HDFS snapshots Task Attempts TaskController Error Codes (MRv1) TaskTracker Health Tests TaskTracker Hosts TaskTracker Metrics Telemetry Publisher Health Tests Telemetry Publisher Metrics Terminology Terminology Testing the Installation Testing with Hue Tez Metrics Tez Properties in Cloudera Runtime 7.1.7 The Actions Menu The File Browser The Processes Tab The Task Distribution Chart Third-party filesystems Time Line Time Series Attributes Time Series Entities and their Attributes Time Series Table Metrics Tips and Best Practices for Jobs TLS/SSL certificate requirements and recommendations TLS/SSL client authentication TLS/SSL Issues TLS/SSL settings for Streams Messaging Manager Tracer Health Tests Tracer Metrics Transparent Encryption Recommendations for HBase Transparent Encryption Recommendations for Hive Transparent Encryption Recommendations for Hue Transparent Encryption Recommendations for Impala Transparent Encryption Recommendations for MapReduce and YARN Transparent Encryption Recommendations for Search Transparent Encryption Recommendations for Spark Transparent Encryption Recommendations for Sqoop Trial Installation Triggers Troubleshooting Cluster Configuration and Operation Troubleshooting Installation Problems Troubleshooting Performance of Decommissioning Troubleshooting Security Issues Troubleshooting Security Issues tsquery Language tsquery Syntax Tuning and Troubleshooting Host Decommissioning Tuning HBase Prior to Decommissioning DataNodes Tuning HDFS Prior to Decommissioning DataNodes Tuning JVM Garbage Collection Tutorial: Using Impala, Hive and Hue with Virtual Private Clusters Understanding Keystores and Truststores Understanding Package Management Uninstall Cloudera Manager Agent and Managed Software Uninstall the Cloudera Manager Server Uninstalling a Runtime Component From a Single Host Uninstalling Cloudera Manager and Managed Software Unsuppressing Health Tests Upgrading from a CDP Private Cloud Base Trial to CDP Private Cloud Base Use case 1: Use Cloudera Manager to generate internal CA and corresponding certificates Use case 2: Enabling Auto-TLS with an intermediate CA signed by an existing Root CA Use case 3: Enabling Auto-TLS with Existing Certificates Use Self-Signed Certificates for TLS Use the Cluster Utilization Report to manage resources User Management User Metrics Using a Credential Provider to Secure S3 Credentials Using a custom Kerberos keytab retrieval script Using a load balancer Using a Local Parcel Repository Using an Internally Hosted Remote Parcel Repository Using auth-to-local rules to isolate cluster users Using Context-Sensitive Variables in Charts Using Fast Upload with Amazon S3 Using impala-shell and Hive Using metadata for cluster governance Using Ranger to Provide Authorization in CDP Using snapshots with replication Using Tags in Cloudera Manager Using the Cloudera Manager API Using the Cloudera Manager API for Cluster Automation Using the Cloudera Manager API to backup and restore clusters Using the Cloudera Manager API to Manage and Configure Clusters Using the Cloudera Manager API to Obtain Configuration Files Using the Cloudera Manager API to Set Advanced Configuration Snippets (Safety Valves) Using the Directory Usage Report Using the Ranger Key Management Service Validating Hadoop Key Operations Validating Key HSM Settings Validation of Configuration Properties Verifying Cloudera Navigator Key Trustee Server Operations Version and Download Information View HDFS directory structure of Compute clusters Viewing a Job's Task Attempts Viewing a List of All Suppressed Validations Viewing a List of Suppressed Health Tests Viewing Activity Details in a Report Format Viewing All Hosts Viewing and Debugging Spark Applications Using Logs Viewing and Downloading Stacks Logs Viewing and Editing Host Overrides Viewing and Editing Overridden Configuration Properties Viewing and Reverting Configuration Changes Viewing Audit Events Viewing Charts for Cluster, Service, Role, and Host Instances Viewing Cloudera Manager Agent Logs in the Logs Page Viewing Cloudera Manager Server Logs in the Logs Page Viewing Current Disk Usage by User, Group, or Directory Viewing Events Viewing Health Test Results Viewing Historical Disk Usage by User, Group, or Directory Viewing Host and Service Monitor Data Storage Viewing Host Details Viewing Host Role Assignments Viewing Host Status Viewing Individual Hosts Viewing Jobs Viewing Logs Viewing Parcel Usage Viewing Past Host Inspector Results Viewing Past Status Viewing Past Status Viewing Queries Viewing replication history Viewing replication policies Viewing Role Instance Status Viewing Running and Recent Commands Viewing Running and Recent Commands For a Cluster Viewing Running and Recent Commands for a Service or Role Viewing Service Instance Details Viewing Service Status Viewing the Cloudera Manager Agent Log Viewing the Cloudera Manager Agent Logs Viewing the Cloudera Manager Server Log Viewing the Cloudera Manager Server Log Viewing the Disks Overview Viewing the Distribution of Task Attempts Viewing the Health and Status of a Role Instance Viewing the Hosts in a Cluster Viewing the Jobs in a Pig, Oozie, or Hive Activity Viewing the Maintenance Mode Status of a Cluster Viewing the Maintenance Mode Status of a Cluster Viewing the Status of a Service Instance Viewing the URLs of the Client Configuration Files Virtual Private Clusters and Cloudera SDX Visualizing Spark Applications Using the Web Application UI WebHCat Server Health Tests WebHCat Server Metrics What's New in Cloudera Manager 7.6.5 Write a few Events into the Topic YARN YARN Health Tests YARN Metrics YARN Pool Metrics YARN Pool User Metrics YARN Properties in Cloudera Runtime 7.1.7 YARN Queue Manager Metrics YARN Queue Manager Properties in Cloudera Runtime 7.1.7 YARN Queue Manager Store Health Tests YARN Queue Manager Store Metrics YARN Queue Manager Webapp Health Tests YARN Queue Manager Webapp Metrics YARN Tab YARN, MRv1, and Linux OS Security Zeppelin Health Tests Zeppelin Metrics Zeppelin Properties in Cloudera Runtime 7.1.7 Zeppelin Server Health Tests Zeppelin Server Metrics ZooKeeper ZooKeeper Health Tests ZooKeeper Metrics ZooKeeper Properties in Cloudera Runtime 7.1.7 ZooKeeper Server Health Tests
ADLS Connector Properties in Cloudera Runtime 7.1.7
Service-Wide🔗
Advanced🔗
ADLS Connector Service Environment Advanced Configuration Snippet (Safety Valve)🔗
Description
For advanced use only, key-value pairs (one on each line) to be inserted into a role's environment. Applies to configurations of all roles in this service except client configuration.
Related Name
Default Value
API Name
ADLS_CONNECTOR_service_env_safety_valve
Required
false
Monitoring🔗
Enable Configuration Change Alerts🔗
Description
When set, Cloudera Manager will send alerts when this entity's configuration changes.
Related Name
Default Value
false
API Name
enable_config_alerts
Required
false
Other🔗
Cloud Account Name🔗
Description
Name of an Azure account. The associated keys are emitted to Hue, Impala and the Hive Metastore Server.
Related Name
Default Value
API Name
cloud_account
Required
true
Hue Browser Data Lake Store🔗
Description
This is required only for clusters using Hue with ADLS Gen1. Determines the Data Lake Store for the Hue browser. This is usually of the form: yourstorename .azuredatalakestore.net.
Related Name
Default Value
API Name
hue_browser_dls
Required
false
Credentials Protection Policy🔗
Description
Determines a security policy for the distribution of Azure account credentials to cluster services. 'More Secure': Encrypted at all times and directly available to a limited set of services. 'Less Secure': Credentials may be in plain text in some configuration files for specific services in the cluster.
Related Name
Default Value
SECURE
API Name
key_distribution_policy
Required
true
Suppressions🔗
Suppress Parameter Validation: ADLS Connector Service Environment Advanced Configuration Snippet (Safety Valve)🔗
Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the ADLS Connector Service Environment Advanced Configuration Snippet (Safety Valve) parameter.
Related Name
Default Value
false
API Name
service_config_suppression_adls_connector_service_env_safety_valve
Required
true
Suppress Parameter Validation: Hue Browser Data Lake Store🔗
Description
Whether to suppress configuration warnings produced by the built-in parameter validation for the Hue Browser Data Lake Store parameter.
Related Name
Default Value
false
API Name
service_config_suppression_hue_browser_dls
Required
true
Suppress Configuration Validator: ADLS Hue Browser DLS required validator🔗
Description
Whether to suppress configuration warnings produced by the ADLS Hue Browser DLS required validator configuration validator.
Related Name
Default Value
false
API Name
service_config_suppression_hue_browser_dls_required_validator
Required
true