Installation
Cloudera Private Cloud Base Installation Guide
Version and Download Information
Cloudera Manager Version Information
Cloudera Manager Download Information
Cloudera Runtime Version Information
Cloudera Runtime Download Information
Cloudera Manager support for CDH, Cloudera Runtime and CDP Private Cloud Data Services
Cloudera Private Cloud Base Trial Download Information
Cloudera Private Cloud Base Requirements and Supported Versions
Hardware Requirements
Cloudera Manager
Cloudera Manager Server
Service Monitor Requirements
Host Monitor
Reports Manager
Agent Hosts
Event Server
Alert Publisher
Cloudera Runtime
Atlas
HDFS
HBase
Hive
Hue
Impala
Kafka
Key Trustee Server
Ranger KMS
Kudu
Oozie
Ozone
Phoenix
Ranger
Solr
Spark
Livy
Zeppelin
YARN
ZooKeeper
Operating System Requirements
Database Requirements
Java Requirements
Networking and Security Requirements
Data at Rest Encryption Requirements
Third-party filesystems
Trial Installation
Installing a Trial Cluster
Before You Begin a Trial Installation
Download the Trial version of Cloudera Private Cloud Base
Run the Cloudera Manager Server Installer
Install Cloudera Runtime
Set Up a Cluster Using the Wizard
Stopping the Embedded PostgreSQL Database
Starting the Embedded PostgreSQL Database
Changing Embedded PostgreSQL Database Passwords
Migrating from the Cloudera Manager Embedded PostgreSQL Database Server to an External PostgreSQL Database
Prerequisites
Identify Roles that Use the Embedded Database Server
Migrate Databases from the Embedded Database Server to the External PostgreSQL Database Server
Installing and Configuring CDP with FIPS
Overview
Prerequisites for using FIPS
Configure Cloudera Manager for FIPS
Install and configure additional required components
Production Installation
Before You Install
Installing Python 3
Installing standard Python 3.8 binary on CentOS 7, CentOS 8 at a standard or custom location
Installing Python 3.8 standard package on RHEL 8
Installing Python 3.8 standard package on RHEL 7
Installing standard Python 3.8 binary on RHEL 7, RHEL 8 at a standard or custom location
Installing Python 3.9 standard package on RHEL 9
Installing standard Python 3.9 binary on RHEL 9 at a standard or custom location
Installing Python 3.10 standard package on SLES 15 SP4
Installing standard Python 3.10 binary on SLES 15 SP5 at a standard or custom location
Installing Python 3.8 standard package on SLES 12 SP5, SLES 15 SP4
Installing standard Python 3.8 binary on SLES 12 SP5 or SLES 15 SP4 at a standard or custom location
Installing Python 3.8 on Oracle UEK 8.8
Storage Space Planning for Cloudera Manager
Cluster Lifecycle Management with Cloudera Manager
Configure Network Names
Setting SELinux Mode
Disabling the Firewall
Enable an NTP Service
Impala Requirements
Runtime Cluster Hosts and Role Assignments
Allocating Hosts for Key Trustee Server and Key Trustee KMS
Configuring Local Package and Parcel Repositories
Understanding Package Management
Repository Configuration Files
Listing Repositories
Configuring a Local Package Repository
Creating a Permanent Internal Repository
Setting Up a Web Server
Downloading and Publishing the Package Repository
Creating a Temporary Internal Repository
Configuring Hosts to Use the Internal Repository
Configuring a Local Parcel Repository
Using an Internally Hosted Remote Parcel Repository
Setting Up a Web Server
Downloading and Publishing the Parcel Repository
Configuring Cloudera Manager to Use an Internal Remote Parcel Repository
Using a Local Parcel Repository
Configuring /tmp directory for cluster hosts
Installing Cloudera Manager, Cloudera Runtime, and Managed Services
Step 1: Configure a Repository for Cloudera Manager
Step 2: Install Java Development Kit
Installing OpenJDK on Cloudera Manager
Installing OpenJDK for CDP Runtime
Installing Oracle JDK for CDP Runtime
Tuning JVM Garbage Collection
Configuring a Custom Java Home Location
Step 3. Install and Configure Databases
Required Databases
Install and Configure PostgreSQL for CDP
Installing Postgres JDBC Driver
Installing PostgreSQL Server
Installing the psycopg2 Python package for PostgreSQL database
Installing the psycopg2 Python package for PostgreSQL database on a FIPS cluster (RHEL 8)
Configuring and Starting the PostgreSQL Server
Install and Configure MySQL for Cloudera Software
Install and Configure MariaDB for Cloudera Software
Install and Configure Oracle Database
Configuring the Hue Server to Store Data in the Oracle database
Enabling TLS 1.2 on Database Server
Enabling TLS 1.2 for MySQL
Enabling TCPS for Oracle
Enabling TLS 1.2 for MariaDB
Enabling TLS 1.2 for PostgreSQL
Enable Kerberos for MariaDB
Setting up the database for Reports Manager
Adding the Reports Manager role
Configuring a database for Ranger or Ranger KMS
Configuring a Ranger or Ranger KMS Database: MySQL/MariaDB
Configuring a Ranger or Ranger KMS Database: Oracle
Configuring a Ranger or Ranger KMS Database: Oracle using /ServiceName format
Configuring a PostgreSQL Database for Ranger or Ranger KMS
Configure Ranger with SSL/TLS enabled PostgreSQL Database
Enable HA for a Ranger Postgres database
Configuring the Database for Streaming Components
Configure PostgreSQL for Streaming Components
Configuring MySQL for Streaming Components
Configuring Oracle for Streaming Components
Step 4: Deploy Cloudera Manager Server and Cloudera Manager Agents
Step 5: Set up and configure the Cloudera Manager database
Configuring TLS 1.2 for Cloudera Manager
Enabling TLS 1.2 on Cloudera Manager Server
Setting up a certificate in Cloudera Manager
Creating Cloudera Manager Server database configuration file
JDBC URL format
Enabling TLS 1.2 for Cloudera Manager High Availability
Configuring TLS 1.2 for Reports Manager
Syntax for scm_prepare_database.sh
Configuring Oracle RAC for the Cloudera Manager database
PostgresSQL High Availability (HA)
Enabling Postgres HA
Configuring PostGres HA for the Cloudera Manager database
Step 6: Start the Cloudera Manager Server and Agents
Step 7: Using the installation wizard
Step 8: Set Up a Cluster Using the Wizard
Select Services
Assign Roles
Setup Database
Database setup details for cluster services for TLS 1.2/TCPS-enabled databases
Database setup details for Hue for TLS 1.2/TCPS-enabled databases
Database setup details for Ranger KMS for TLS 1.2/TCPS-enabled databases
Database setup details for Ranger for TLS 1.2/TCPS-enabled databases
Database setup details for Oozie for TLS 1.2/TCPS-enabled databases
Database setup details for Streams Messaging Manager for TLS 1.2/TCPS-enabled databases
Database setup details for Schema Registry for TLS 1.2/TCPS-enabled databases
Database setup details for Hive Metastore for TLS 1.2/TCPS-enabled databases
Enter Required Parameters
Review Changes
Configure Kerberos
Command Details
Summary
Step 9: (optional) Enable high availability for Cloudera Manager
(Recommended) Enable Auto-TLS
(Recommended) Enable Kerberos
Additional Steps for Apache Ranger
Installing Apache Knox
Apache Knox Install Role Parameters
Setting Up Data at Rest Encryption for HDFS
Installing Ranger KMS backed by a Database and HA
Installing the Ranger KMS Service
Restarting the Stale Services and Redeploying the Client Configuration
Validating Data Encryption to-and-from HDFS
Post-Tasks for the Data-at-Rest HDFS Ranger KMS Service
Installing Ranger KMS backed with a Key Trustee Server and HA
Adding an External Dedicated Cluster for the Key Trustee Server Service
Installing the Key Trustee Server to the Dedicated Cluster
Installing the Ranger KMS with Key Trustee Server Service
Restarting the Stale Services and Redeploying the Client Configuration
Validating Data Encryption to-and-from HDFS
Post-Tasks for the Data-at-Rest HDFS Ranger KMS Service
Updating the Ranger KMS with KTS Service Configuration Properties
Installing a Java Keystore KMS
Adding the Java KeyStore KMS Service
Restarting the Stale Services and Redeploying the Client Configuration
Validating Data Encryption to-and-from HDFS
Installing Cloudera Navigator Key Trustee Server
Installing Key Trustee Server using Cloudera Manager
Securing Key Trustee Server Host
Leveraging Built-in Processor Instruction Sets
Initializing Key Trustee Server
Installing Cloudera Navigator Encrypt
Installing Cloudera Navigator Key HSM
Installing Ranger RMS
Custom Installation Solutions
Privileged commands for Cloudera Manager installation
Prerequisites and exceptions for the example configuration
Example configuration to add to the sudoers file
Creating Virtual Images of Cluster Hosts
Creating a Pre-Deployed Cloudera Manager Host
Instantiating a Cloudera Manager Image
Creating a Pre-Deployed Worker Host
Instantiating a worker host
Manually Install Cloudera Software Packages
Install Cloudera Manager Packages
Manually Install Cloudera Manager Agent Packages
Installation Reference
Ports
Ports Used by Cloudera Manager
Ports Used by Cloudera Navigator Key Trustee Server
Ports Used by Cloudera Runtime Components
Ports Used by DistCp
Ports Used by Third-Party Components
Service Dependencies in Cloudera Manager
Cloudera Manager sudo command options
Introduction to Parcels
After You Install
Deploying Clients
Initializing Solr and creating HDFS home directory
Testing the Installation
Checking Host Heartbeats
Running a MapReduce Job
Testing with Hue
Deploying Atlas service
Secure Your Cluster
Installing the GPL Extras Parcel
Configuring HDFS properties to optimize log collection
Migrating a YARN Queue Manager database to an external database
Troubleshooting Installation Problems
Uninstalling Cloudera Manager and Managed Software
Record User Data Paths
Stop all Services
Deactivate and Remove Parcels
Delete the Cluster
Uninstall the Cloudera Manager Server
Uninstall Cloudera Manager Agent and Managed Software
Remove Cloudera Manager, User Data, and Databases
Uninstalling a Runtime Component From a Single Host