Homepage/Cloudera Base on premises upgrade

Search Documentation

▶︎Cloudera
1. Reference Architectures
▶︎Cloudera Public Cloud
▼Cloudera Private Cloud
▶︎Cloudera Manager
1. Cloudera Manager
▶︎Applications
▶︎Legacy
▶︎

Data Services
Getting Started
Cloudera Manager
Management Console
Replication Manager
Data Catalog
Data Engineering
Data Warehouse
Data Warehouse Runtime
Cloudera AI
Base
Getting Started
Runtime
Upgrade
Storage
Flow Management
Streaming Analytics
Flow Management Operator
Streaming Analytics Operator
Streams Messaging Operator

«

Filter topics

Cloudera Base on premises Upgrade
▶︎Release Guide
▶︎Getting Started with Cloudera Upgrade and Migration
▶︎In-Place Upgrades
▼Migrating Workloads

(Optional) Configure other services to work with Ozone
(Optional) Start Cloudera Manager Server & Cloudera Management Service
(Optional) Start Cloudera Manager Server & Cloudera Management Service
(Optional) Start Cloudera Manager Server & Cloudera Management Service
(Optional) Start Cloudera Manager Server & Cloudera Management Service
(Optional) Start Cloudera Manager Server & Cloudera Management Service
(Optional) Start Cloudera Manager Server & Cloudera Management Service
About migrating from Cloudera Navigator to Atlas using Cloudera Manager 6
About migrating from Cloudera Navigator to Atlas using Cloudera Manager 7
About Solr configuration transformation script
About using this online Upgrade Guide
About using this online Upgrade Guide
About using this online Upgrade Guide
Access Oozie load balancer URL
Access Oozie load balancer URL
Access required to Read/Write on Hadoop_SQL tables using SQL
Accommodate HMS changes for Hive replication policies
Accumulo
Accumulo
ACID ingest patterns
ACLs supported by Ranger KMS and Ranger KMS Mapping
ACLs supported by Ranger KMS and Ranger KMS Mapping
ACOS(2) and ASIN(2) return NULL
Add Backticks to Table References
Add Backticks to Table References
Add Backticks to Table References
Add Backticks to Table References
Add Backticks to Table References
Add Balancer Role to HDFS
Add Balancer Role to HDFS
Add Ranger policies for components on the CDP Cluster
Add Ranger policies for components on the CDP Cluster
Add source cluster as peer to use in replication policies
Add the DAS service
Add the DAS service
Add the Hue service using Cloudera Manager
Add the Hue service using Cloudera Manager
Adding a peer to use in replication policy
Adding Core Configuration service for Ozone
Adding Hue service with Cloudera Manager
Adding Hue service with Cloudera Manager
Adding Oozie service dependencies
Adding Query Processor service to a cluster
Adding Query Processor service to a cluster
Adding Query Processor service to a cluster
Adding Query Processor service to a cluster
Adding Security Browser to the blocked list of applications
Adding Security Browser to the blocked list of applications
Additional configuration tasks
Additional configuration tasks
Additional Services
Additional Services
ADD_MONTHS date validation
ADD_MONTHS function fix
Advanced configuration snippet (Safety valve)
Advanced Hive configuration parameters for Hive ACID table replication policies
Agent Hosts
Alert Publisher
Aliasing tables
AM2CM legacy tools download
AM2CM legacy tools download
Ambari and HDP Upgrade Checklist
Ambari and HDP Upgrade Checklist
Ambari Behavioral changes
Ambari Infra Solr
Ambari Infra Solr
Ambari Infra Solr
Ambari infra-migrate and restore
Ambari infra-migrate and restore
Ambari Metrics and LogSearch
Ambari Metrics and LogSearch
Ambari Metrics System (AMS) does not start
Ambari Properties backup
Ambari upgrade checklist
Ambari upgrade checklist
Ambari-Metrics
Ambari-Metrics
ANALYZE TABLE ... COMPUTE STATISTICS PARTIALSCAN removed
Apache Hadoop YARN default value changes
Apache Hadoop YARN default value changes
Apache HBase post-upgrade tasks
Apache HBase post-upgrade tasks
Apache Hive 3 architectural overview Apache Hive 3 in Cloudera Data Hub architectural overview Apache Hive 3 in Cloudera Data Warehouse architectural overview
Apache Hive Changes in CDP
Apache Hive Changes in CDP
Apache Hive Changes in CDP
Apache Hive Changes in CDP
Apache Hive Expedited Migration Tasks
Apache Hive Expedited Migration Tasks
Apache Hive Expedited Migration Tasks
Apache Hive features Apache Hive features in Cloudera Data Hub Apache Hive features in Cloudera Data Warehouse
Apache Hive Post-Upgrade Tasks
Apache Hive Post-Upgrade Tasks
Apache Hive Post-Upgrade Tasks
Apache Impala changes in CDP
Apache Impala changes in CDP
Apache Knox - create plugin audit directory
Apache Knox - create plugin audit directory
Apache Ranger TLS Post-Upgrade Tasks
Apache Ranger TLS Post-Upgrade Tasks
Apache Sqoop Changes
Apache Sqoop Changes
Apache Tez processing of Hive jobs
Apache Tez processing of Hive jobs
Apache ZooKeeper ACLs: YARN
Applications Upgrade
Applications Upgrade
Applications Upgrade
Applications Upgrade
Applications Upgrade
Applying a Service Pack
Applying custom Kudu configuration
Assessing the Impact of an Upgrade
Assessing the Impact of an Upgrade
Assessing the Impact of Apache Hive
Assumptions and prerequisites
Assumptions and prerequisites
Atlas
Atlas
Atlas
Atlas
Atlas
Atlas advanced configuration snippet (Safety valve)
Atlas advanced configuration snippet (Safety valve)
Atlas migration
Atlas Migration and HBase Hook settings
Atlas replication policies (technical preview)
Authorization Provider for Impala
Authorization Provider for Impala
Authorization Provider for Impala
Authzmigrator tool
Auto-converted Fair Scheduler properties
Auto-converted Fair Scheduler properties
Auto-converted Fair Scheduler properties
Automated rollback
Automatic Invalidation/Refresh of Metadata
Automatic Refresh of Tables on Impala Clusters
Automatic Row Count Estimation
Back up Ambari Infra Solr data
Back up Ambari Infra Solr data
Back up and upgrade Ambari infra and Ambari Log Search
Back up and upgrade Ambari infra Solr and Ambari Log Search
Back Up Cloudera Manager Agent
Back Up Cloudera Manager Agent
Back Up Cloudera Manager Agent
Back Up Cloudera Manager Agent
Back Up Cloudera Manager Agent
Back Up Cloudera Manager Agent
Back Up Cloudera Manager Server
Back Up Cloudera Manager Server
Back Up Cloudera Manager Server
Back Up Cloudera Manager Server
Back Up Cloudera Manager Server
Back Up Cloudera Manager Server
Back Up Cloudera Navigator Data
Back Up Cloudera Navigator Data
Back Up Cloudera Navigator Data
Back Up Cloudera Navigator Data
Back up Solr configuration and data
Back Up the Cloudera Management Service
Back Up the Cloudera Management Service
Back Up the Cloudera Management Service
Back Up the Cloudera Management Service
Back Up the Cloudera Management Service
Back Up the Cloudera Management Service
Back Up the Databases
Back Up the Databases
Back Up the Databases
Back Up the Databases
Back Up the Databases
Back Up the Databases
Back up the Ranger configuration
Backing up Ambari infra data
Backing up Ambari infra Solr data
Backing up Cloudera Manager databases
Backing up Cloudera Manager databases
Backing up Cloudera Manager databases
Backing up Cloudera Manager databases
Backing up data in Kudu
Backup Ambari
Backup Ambari
Backup Ambari
Backup Ambari Infra Solr
Backup Ambari Infra Solr
Backup Ambari-Metrics
Backup Ambari-Metrics
Backup and Restore Databases
Backup and Restore Databases
Backup Atlas
Backup Atlas
Backup databases
Backup databases
Backup HBase
Backup HBase
Backup HBase tables
Backup HBase tables
Backup HDFS
Backup HDFS
Backup HDP Cluster
Backup HDP Cluster
Backup HDP services from CDP 7.1.x
Backup Hive
Backup Hive
Backup Infra Solr collections
Backup Infra Solr collections
Backup Kafka
Backup Kafka
Backup Knox
Backup Knox
Backup Logsearch
Backup Logsearch
Backup Oozie
Backup Oozie
Backup Ranger
Backup Ranger
Backup Ranger Admin Database
Backup Ranger Admin Database
Backup Ranger KMS Database
Backup Ranger KMS Database
Backup the non-default Rack Awareness Topology script
Backup the non-default Rack Awareness Topology script
Backup Zeppelin
Backup Zeppelin
Backup ZooKeeper
Backup ZooKeeper
Before upgrading any cluster
Before upgrading any cluster
Before upgrading any cluster
Before upgrading any cluster
Before you begin
Before you begin
Before you begin
Before you upgrade
Before you upgrade
Before you upgrade Ambari
Before you upgrade Ambari
Bootstrapping Solr collections
Browsing HDFS directories
Capture Information about Multiple HiveServers
Case study for setting up an HDP-GPL local repository
Case study for setting up an HDP-GPL local repository
Case study for setting up local repository
Case study for setting up local repository
CAST function results
Casting invalid dates
Casting invalid dates
Casting invalid dates
Casting invalid dates
Casting invalid dates
Casting Timestamp to numeric and vice-versa
Casting timestamps
Casting timestamps
Casting timestamps
Casting timestamps
Casting timestamps
Casting types with leading or trailing spaces
CDH 5 to CDP Private Cloud Base
CDH 5 to Cloudera Base on premises post-upgrade transition steps
CDH 6 to CDP Private Cloud Base
CDH 6 to Cloudera Base on premises post-upgrade transition steps
CDH cluster upgrade requirements for Replication Manager
CDH cluster upgrade requirements for Replication Manager
CDH/HDP to Cloudera Base on premises
CDP Upgrade Readiness
CDP Upgrade Readiness
Change Kafka port value
Change Kafka port value
Change location of Datafiles
Changes to Ambari and HDP services
Changes to Ambari and HDP services
Changes to Ambari services and views
Changes to CDH and HDP Components in Cloudera Base on premises
Changes to CDH Hive Tables
Changes to CDH Hive Tables
Changes to CDH Hive Tables
Changes to CDH Hive Tables
Changes to CDH Hive Tables
Changes to HDP Hive tables
Changes to HDP Hive tables
Changes to HDP Hive tables
Changes to HDP Hive tables
Changes to HDP Hive tables
Changing incompatible column types
Changing incompatible column types
Changing incompatible column types
Changing incompatible column types
Changing incompatible column types
Changing incompatible column types
Changing the Hive warehouse location
Changing the Hive warehouse location
Check cluster configuration for Hive and Tez
Check cluster configuration for Hive and Tez
Check co-processor classes
Check co-processor classes
Check MySQL isolation configuration
Check Oracle Database Initialization
Check Oracle Database Initialization
Check SERDE Definitions and Availability
Check SERDE Definitions and Availability
Check SERDE Definitions and Availability
Check SERDE Definitions and Availability
Check SERDE Definitions and Availability
Check SERDE Definitions and Availability
Check SERDE Definitions and Availability
Check SERDE Definitions and Availability
Check SERDE Definitions and Availability
Checking and correcting Hive table locations
Checking and correcting Hive table locations
Checking Apache HBase
Checking Apache HBase
Checking co-processor classes
Checklist for large clusters
Checklist for large clusters
Checkpoint HDFS
Checkpoint HDFS
Classic ingest patterns
Clean the HBase Master procedure store
Cleaning up data on the HDFS source
CLI options of the fs2cs conversion tool
CLI options of the fs2cs conversion tool
CLI options of the fs2cs conversion tool
Client Configurations
Client Configurations
Cloudera AI Project Migration
Cloudera Base on premises Pre-upgrade transition steps
Cloudera Base on premises Pre-upgrade transition steps
Cloudera Base on premises Release Guide
Cloudera Base on premises requirements and supported versions
Cloudera Base on premises Trial Download Information
Cloudera Base on premises Upgrade
Cloudera Data Engineering Concepts
Cloudera license requirements for Replication Manager
Cloudera Manager
Cloudera Manager
Cloudera Manager Download Information
Cloudera Manager Installation and Setup
Cloudera Manager Installation and Setup
Cloudera Manager Installation and Setup
Cloudera Manager Server
Cloudera Manager Support Matrix
Cloudera Manager Version Information
Cloudera Manager versions 7.1.1 to 7.2.4
Cloudera Manager versions 7.1.1 to 7.2.4
Cloudera Manager versions 7.1.1 to 7.2.4
Cloudera Manager versions 7.3.1 or higher
Cloudera Manager versions 7.3.1 or higher
Cloudera Manager versions 7.3.1 or higher
Cloudera Release Notes
Cloudera Runtime
Cloudera Runtime Download Information
Cloudera Runtime Version Information
Cloudera Search changes
Cloudera Search post-upgrade tasks
Cloudera Upgrade and Migrations Paths
Cluster environment readiness
Cluster environment readiness
Cluster environment readiness
Collect Information
Collect Information
Collect Information
Collect Information
Collect Information
Collect Information
Compatible storage formats
Compiling and running a Java-based job
Compiling and running a Java-based job
Compiling and running a Java-based job
Compiling and running a Java-based job
Compiling and running a Scala-based job
Compiling and running a Scala-based job
Compiling and running a Scala-based job
Compiling and running a Scala-based job
Compiling and running Spark workloads
Compiling and running Spark workloads
Compiling and running Spark workloads
Compiling and running Spark workloads
Compiling and running Spark workloads
Compiling and running Spark workloads
Compiling and running Spark workloads
Compiling and running Spark workloads
Compiling and running Spark workloads
Configuration changes
Configuration changes
Configuration changes between MRv1 and MRv2
Configuration options available in Cloudera Data Warehouse by default
Configure Apache Knox authentication for AD/LDAP
Configure Apache Knox authentication for AD/LDAP
Configure edge nodes as gateways
Configure edge nodes as gateways
Configure edge nodes as gateways
Configure edge nodes as gateways
Configure edge nodes as gateways
Configure edge nodes as gateways
Configure encryption zone security
Configure encryption zone security
Configure encryption zone security
Configure encryption zone security
Configure encryption zone security
Configure encryption zone security
Configure file access control lists for Impala user
Configure HiveServer HTTP mode
Configure HiveServer HTTP mode
Configure HiveServer HTTP mode
Configure HiveServer HTTP mode
Configure HiveServer HTTP mode
Configure HiveServer HTTP mode
Configure parameters for Hive ACID table replication policies
Configure SMM to monitor SRM replications
Configure SMM to monitor SRM replications
Configure SMM's service dependency on Schema Registry
Configure SMM's service dependency on Schema Registry
Configure SSL/TLS in Ambari
Configure SSL/TLS in Ambari
Configure TLS/SSL for Ranger in a manually configured TLS/SSL environment
Configure TLS/SSL for Ranger in a manually configured TLS/SSL environment
Configure two-way trust between clusters
Configuring a Custom Java Home Location
Configuring a Custom Java Home Location
Configuring a Custom Java Home Location
Configuring a Local Package Repository
Configuring a Local Package Repository
Configuring a Local Package Repository
Configuring a Local Package Repository
Configuring a Local Parcel Repository
Configuring a Local Parcel Repository
Configuring a Local Parcel Repository
Configuring a Local Parcel Repository
Configuring a Ranger Database: PostgreSQL
Configuring a Ranger Database: PostgreSQL
Configuring a Ranger or Ranger KMS Database: MySQL/MariaDB
Configuring a Ranger or Ranger KMS Database: MySQL/MariaDB
Configuring a Ranger or Ranger KMS Database: Oracle
Configuring a Ranger or Ranger KMS Database: Oracle
Configuring authorization to tables
Configuring authorization to tables
Configuring authorization to tables
Configuring authorization to tables
Configuring authorization to tables
Configuring authorization to tables
Configuring DAS for SSL/TLS
Configuring DAS for SSL/TLS
Configuring External Authentication for Cloudera Manager
Configuring External Authentication for Cloudera Manager
Configuring HDFS properties to optimize log collection
Configuring HDFS properties to optimize log collection
Configuring heap size to replicate large directories using replication policies
Configuring HiveServer for ETL using YARN queues
Configuring HiveServer for ETL using YARN queues
Configuring HiveServer for ETL using YARN queues
Configuring HiveServer for ETL using YARN queues
Configuring HMS for high availability
Configuring HMS for high availability
Configuring HMS for high availability
Configuring HMS for high availability
Configuring HMS for high availability
Configuring HMS for high availability
Configuring HSMM to prevent migration
Configuring HSMM to prevent migration
Configuring legacy CREATE TABLE behavior
Configuring legacy CREATE TABLE behavior
Configuring legacy CREATE TABLE behavior
Configuring legacy CREATE TABLE behavior
Configuring legacy CREATE TABLE behavior
Configuring legacy CREATE TABLE behavior
Configuring peers with SAML authentication
Configuring properties for OBS bucket replication using Ozone replication policies
Configuring Ranger ACL Sync
Configuring SSL/TLS certificate exchange between two Cloudera Manager instances
Configuring storage locations
Configuring storage locations
Configuring storage locations
Configuring storage locations
Configuring storage locations
Configuring storage locations
Configuring storage locations
Configuring storage locations
Configuring storage locations
Configuring the CDP cluster
Configuring the HDP cluster
Configuring user authentication in Ambari
Configuring user authentication in Ambari
Configuring user authentication using Knox proxy
Configuring user authentication using Knox proxy
Configuring user authentication using Knox SSO
Configuring user authentication using Knox SSO
Configuring user authentication using SPNEGO
Configuring user authentication using SPNEGO
Configuring wire-encrypted clusters
Considerations for realm names to use for replication
Considerations for transferring data from HDFS to Ozone
Consolidating policies created by Authzmigrator
Convert Spark Submit commands to CDE CLI Spark Submit commands
Convert Spark Submits to CDE API Requests
Converting Hive CLI scripts to Beeline
Converting Hive CLI scripts to Beeline
Converting old mapping rule format to JSON-based placement rule format
Converting old mapping rule format to JSON-based placement rule format
Copy Raw Data
Copy Raw Data
Copy the transitioned configuration to the upgrade metadata directory
Copying the backed up data to the Cloudera cluster
CORR and COVAR_SAMP compliant with SQL:2011
Correct Hive File Locations
Create composite keytab for Ranger HA
Create HDFS backup directory
Create HIVE sys database
CREATE OR REPLACE VIEW and ALTER VIEW not supported
CREATE OR REPLACE VIEW and ALTER VIEW not supported
Creating a Hive external table replication policy
Creating a list of tables to migrate
Creating a list of tables to migrate
Creating a list of tables to migrate
Creating additional Ranger policies for the keyadmin user
Creating Atlas replication policies
Creating HDFS replication policy to replicate HDFS data
Creating Hive ACID table replication policy
Creating Iceberg replication policy
Creating Ozone replication policies
Creating Ranger replication policies
Creating snapshot policies in Replication Manager
CSV bad record handling
CSV bad record handling
CSV bad record handling
CSV bad record handling
CSV bad record handling
CSV bad record handling
CSV bad record handling
CSV bad record handling
CSV bad record handling
CSV header and schema match
CSV header and schema match
CSV header and schema match
CSV header and schema match
CSV header and schema match
CSV header and schema match
CSV header and schema match
CSV header and schema match
CSV header and schema match
Custom Spark SQL Warehouse Directory
Custom Topology
Custom Topology
Customizing CDSW for migrating host mounts
Customizing critical Hive configurations
Customizing critical Hive configurations
Customizing critical Hive configurations
Customizing critical Hive configurations
Customizing critical Hive configurations
Customizing critical Hive configurations
Customizing the authorization-migration-site.xml file
DAS does not log me out as expected, or I stay logged in longer than the time specified in the Ambari configuration
DAS does not log me out as expected, or I stay logged in longer than the time specified in the Ambari configuration
DAS post-installation tasks
DAS post-installation tasks
DAS service installation fails with the "python files missing" message
DAS service installation fails with the "python files missing" message
Data at Rest Encryption Requirements
Data Governance Support by Atlas
Data Governance Support by Atlas
Data Governance Support by Atlas
Data Migration Tools and Methods for Cloudera Private Cloud
Data Migration Versus Upgrade
Database Requirements
Databases
Databases
Dataframe API registerTempTable deprecated
Dataframe API registerTempTable deprecated
Dataframe API registerTempTable deprecated
Dataframe API registerTempTable deprecated
Dataset and DataFrame API explode deprecated
Dataset and DataFrame API explode deprecated
Dataset and DataFrame API explode deprecated
Dataset and DataFrame API explode deprecated
Date and timestamp format changes
Date and timestamp parser changes from LENIENT to STRICT
Date strings are parsed using local timezone
Dates are parsed by ignoring trailing invalid characters
Decimal literals
Decimal to string change
Default File Formats
Default Managed Tables
Default NULL ordering change
Delete ZNodes
Delete ZNODES
Dell EMC PowerScale
Disabling Partition Type Checking
Disabling Partition Type Checking
Disabling Partition Type Checking
Disabling replication of parameters during Hive replication
Disallow enabling/enforcing NOT NULL
Disk space and mountpoint considerations
Disk space and mountpoint considerations
Disk space and mountpoint considerations
Download cluster blueprints
Download cluster blueprints
Download cluster blueprints without hosts
Download cluster blueprints without hosts
Download Solr configuration from HDP Search ZooKeeper
Download Solr configuration from HDP Search ZooKeeper
Download the configuration
Download the Pre-Upgrade Tool JAR for Compaction
Downloadable Cloudera upgrade checklists
Downloading and Publishing the Package Repository
Downloading and Publishing the Package Repository
Downloading and Publishing the Package Repository
Downloading and Publishing the Parcel Repository
Downloading and Publishing the Parcel Repository
Downloading and Publishing the Parcel Repository
Dropping partitions
Dropping partitions
Dropping partitions
Dropping partitions
Dropping partitions
Empty schema not supported
Empty schema not supported
Empty schema not supported
Empty schema not supported
Empty schema not supported
Empty schema not supported
Empty schema not supported
Empty schema not supported
Empty schema not supported
Enable Auto Start setting
Enable Auto Start setting
Enable Kerberos for authentication
Enable Kerberos for authentication
Enabling and disabling HDFS snapshots
Enabling background threads after migration
Enabling logout option for secure clusters
Enabling logout option for secure clusters
Enabling replication between clusters with Kerberos authentication
Enabling SAC manually on Spark
Enabling Spark on YARN for Atlas
Encrypting data in transit between clusters
Enforcement of NOT NULL constraint
Estimating migration time and resources required
Estimating the time and resources needed for transition
Event notification cleanup interval
Event Server
Example commands for replicating HDP 3 workloads
Exclusive write lock for MERGE INSERT
Execution steps
Expediting the Hive upgrade
Expediting the Hive upgrade
Expediting the Hive upgrade
Exporting Permissions from Sentry Server
Extract Kafka broker ID
Extract Kafka broker ID
Factors to Consider for Capacity Planning
Fair Scheduler features and conversion details
Fair Scheduler features and conversion details
Fair Scheduler features and conversion details
Fair Scheduler to Capacity Scheduler transition
Fair Scheduler to Capacity Scheduler transition
Fix precision and scale inference for aggregate rewriting in Calcite
Fixing statistics
Fixing statistics
Fixing the canary test after upgrading
Flow management
From Cloudera Base on premises
FROM_UNIXTIME and UNIX_TIMESTAMP time zone
Functions that changed
Generate migration configuration
Generate migration configuration
Generating keytabs in Cloudera Manager
Get a Kerberos Ticket
Getting a 401 - Unauthorized access error message while accessing DAS
Getting a 401 - Unauthorized access error message while accessing DAS
Getting Started with CDE Airflow
Getting Started with Cloudera Upgrade and Migration
Getting started with Zero Downtime Upgrade (ZDU)
Getting the JDBC driver
Getting the JDBC driver
Getting the JDBC driver
Getting the JDBC driver
Getting the ODBC driver
Getting the ODBC driver
Getting the ODBC driver
Getting the ODBC driver
Glossary of terminologies
GPU Scheduling
Grant Ranger permissions to new users or groups
Grant Ranger permissions to new users or groups
Guidelines for moving repeated BI workloads
Guidelines to use snapshot diff-based replication
Hadoop Users (user:group) and Kerberos Principals
Hadoop Users (user:group) and Kerberos Principals
Hadoop Users (user:group) and Kerberos Principals
Handing a failed verification
Handle Missing Table or Partition Locations
Handle Missing Table or Partition Locations
Handle Missing Table or Partition Locations
Handle Missing Table or Partition Locations
Handle Missing Table or Partition Locations
Handle Missing Table or Partition Locations
Handle Missing Table or Partition Locations
Handle Missing Table or Partition Locations
Handling Data Files
Handling Data Files
Handling government regulations in ACID tables
Handling of CURRENT_TIMESTAMP output format
Handling of Julian dates in UDFs
Handling output of greatest and least functions
Handling output of greatest and least functions
Handling output of greatest and least functions
Handling output of greatest and least functions
Handling output of greatest and least functions
Handling output of greatest and least functions
Handling prerequisites
Handling prerequisites
Handling prerequisites
Handling prerequisites
Handling prerequisites
Handling prerequisites
Handling prerequisites
Handling prerequisites
Handling prerequisites
Handling return type for old date functions
Handling syntax changes
Handling table column named default
Handling table reference syntax
Handling table reference syntax
Handling table reference syntax
Handling table reference syntax
Handling table reference syntax
Handling table reference syntax
Handling table reference syntax
Handling the Keyword APPLICATION
Handling the Keyword APPLICATION
Handling the Keyword APPLICATION
Handling the Keyword APPLICATION
Handling trailing zeros of decimal constants
Hardware Requirements
HAVING without GROUP BY
HAVING without GROUP BY
HAVING without GROUP BY
HAVING without GROUP BY
HAVING without GROUP BY
HAVING without GROUP BY
HAVING without GROUP BY
HAVING without GROUP BY
HAVING without GROUP BY
HBase
HBase
HBase
HBase
HBase
HBase
HBase
HBase
HBase RegionServer heap size
HBase unsupported features
HDF Streaming Workloads
HDFS
HDFS
HDFS
HDFS
HDFS
HDFS
HDFS
HDFS
HDFS
HDFS
HDFS dependency on running Ozone
HDFS HA
HDFS HA
HDFS namespace mapping to Ozone
HDFS replication in Sentry-enabled clusters
HDFS replication policies
HDFS replication policy considerations
HDP 3.1.5 to HDP 7.1.7 Intermediate bits Kafka upgrade
HDP Core component version changes
HDP Core component version changes
HDP Core component version changes
HDP Intermediate bits for 7.1.x.0 Repositories
HDP Intermediate bits for 7.1.x.0 Repositories
HDP Prerequisites
HDP Prerequisites
HDP to CDP Private Cloud Base One Stage upgrade
HDP to CDP Private Cloud Base Upgade
HDP to CDP Upgrade Overview
HDP to CDP Upgrade Overview
HDP upgrade checklist
HDP upgrade checklist
HDP2 to CDP Private Cloud Base Two Stage upgrade
HDP3 to CDP Private Cloud Base Two Stage upgrade
Hive
Hive
Hive
Hive
Hive
Hive
Hive
Hive ACID table replication policies
Hive Configuration Changes Requiring Consent
Hive Configuration Changes Requiring Consent
Hive Configuration Property Changes
Hive Configuration Property Changes
Hive Configuration Property Changes
Hive Configuration Property Changes
Hive Configuration Property Changes
Hive Configuration Property Changes
Hive Configuration Requirements and Recommendations
Hive Configuration Requirements and Recommendations
Hive Configuration Requirements and Recommendations
Hive Configuration Requirements and Recommendations
Hive Configuration Requirements and Recommendations
Hive Configuration Requirements and Recommendations
Hive external table replication policies
Hive ingest patterns introduction
Hive Metastore corrupt
Hive Policy Additions
Hive post-HDP-upgrade tasks
Hive Pre-Upgrade Tool Command Help
Hive replication policy considerations
Hive tables and DDL commands
Hive unsupported interfaces and features
Hive unsupported interfaces and features
Hive unsupported interfaces and features
Hive unsupported interfaces and features
Hive unsupported interfaces and features
Hive unsupported interfaces and features
hive.stats.collect.rawdatasize removal
HIVE_SUPPORT_SQL11_RESERVED_KEYWORDS
HMS health check
Host Monitor
How HDFS replication policy works
How Iceberg replication policy works
How much time should I plan for to complete my upgrade?
How much time should I plan for to complete my upgrade?
How much time should I plan for to complete my upgrade?
How much time should I plan for to complete my upgrade?
How much time should I plan for to complete my upgrade?
How Ranger replication policy works
How Replication Manager uses snapshots
How the migration process works
How to Install Cumulative Hotfix (CHF)
How to use the post copy reconciliation script for HDFS replication policies
HSM Support
Hue
Hue
Hue
Hue post-upgrade tasks
Hue post-upgrade tasks
HWC changes from HDP to CDP
IBM Spectrum Scale
Iceberg replication policies
Identifying and fixing invalid Hive schema versions
Identifying and fixing invalid Hive schema versions
Identifying and fixing invalid Hive schema versions
Impala
Impala
Impala
Impala Changes between CDH and CDP
Impala Configuration Changes
Impala Configuration Changes
Impala configuration differences in CDH and CDP
Import Key Trustee KMS ACLs to Ranger KMS policies
Importing Sentry privileges into Ranger policies
Importing Sentry privileges into Ranger policies
Importing Sentry privileges into Ranger policies
Improve network latency during replication job run
Improved Handling of External Table Inserts in HDFS
In-Place and Restore
In-Place and Restore
In-Place and Restore
In-place data upgrade from Accumulo 1.7.0 in HDP 2 to Accumulo 1.10
In-place data upgrade from Accumulo 1.7.0 in HDP 3 to Accumulo 1.10
In-place data upgrade from Accumulo 1.7.2 in CDH 5 to Accumulo 1.10
In-place data upgrade from Accumulo 1.9.2 in CDH 6 to Accumulo 1.10
In-place data upgrade from CDH 6 to Operational Database
In-Place Upgrade Overview
In-Place Upgrade Overview
In-Place Upgrade Overview
In-place upgrade with new nodes for Cloudera Data Warehouse Data Service
Install and configure MySQL database
Install and configure MySQL database
Install software on the hosts
Install software on the hosts
Installing Atlas in the Cloudera Manager upgrade wizard
Installing Atlas in the Cloudera Manager upgrade wizard
Installing Atlas using the Cloudera Manager upgrade wizard
Installing Cloudera Management Service
Installing DAS using Ambari
Installing DAS using Ambari
Installing DAS using Cloudera Manager
Installing DAS using Cloudera Manager
Installing dependencies for Hue
Installing dependencies for Hue
Installing dependencies for Hue
Installing Hive on Tez and adding a HiveServer role
Installing Hive on Tez and adding a HiveServer role
Installing Hive on Tez and adding a HiveServer role
Installing Hive on Tez and adding a HiveServer role
Installing JDBC Driver
Installing JDBC Driver
Installing MySQL client for MariaDB databases
Installing MySQL client for MariaDB databases
Installing MySQL client for MariaDB databases
Installing MySQL client for MariaDB databases
Installing MySQL client for MariaDB databases
Installing MySQL client for MySQL databases
Installing MySQL client for MySQL databases
Installing MySQL client for MySQL databases
Installing MySQL client for MySQL databases
Installing MySQL client for MySQL databases
Installing Python 3.8
Installing Python 3.8
Installing Python 3.8 on CentOS 7 for Hue
Installing Python 3.8 on CentOS 7 for Hue
Installing Python 3.8 on RHEL 8 for Hue
Installing Python 3.8 on RHEL 8 for Hue
Installing Python 3.8 on SLES 12 for Hue
Installing Python 3.8 on SLES 12 for Hue
Installing Python 3.8 on Ubuntu 18 for Hue
Installing Python 3.8 on Ubuntu 18 for Hue
Installing the cnav.sh and dependencies
Installing the new Shared Libraries
Installing the new Shared Libraries
Installing the psycopg2 Python package for PostgreSQL database
Installing the psycopg2 Python package for PostgreSQL database
Installing the psycopg2 Python package for PostgreSQL database
Installing the psycopg2 Python package for PostgreSQL database
Installing the psycopg2 Python package for PostgreSQL database
Integrate Hue with Knox
Integrate Hue with Knox
Interoperability between Hive and Impala
Interoperability between Hive and Impala
Interoperability between Hive and Impala
Java Requirements
Kafka
Kafka
Kafka
Kafka
Kafka
Kafka
Kafka cluster Kerberos
Kerberos
Kerberos
Kerberos
Kerberos - Optional task
Kerberos cluster
Kerberos cluster
Kerberos connectivity test
Kerberos principal
Kerberos principal
Kerberos Principal for Cloudera Manager Server
Key concepts about ACID ingest patterns
Key migration
Key migration in UCL
Key semantic changes and workarounds
Key semantic changes and workarounds
Key semantic changes and workarounds
Key semantic changes and workarounds
Key semantic changes and workarounds
Key semantic changes and workarounds
Key syntax changes
Key syntax changes
Key Trustee KMS operations not supported by Ranger KMS
Key Trustee KMS operations not supported by Ranger KMS
Key Trustee Server
KMS and Encryption Products
Knox
Knox
Knox
Knox
Knox
KTS and Key HSM
Kudu
Kudu
Kudu migration overview
LENGTH function supported data types
Limit scanned partitions
Limitations of migrating CDSW to Cloudera AI
Livy
Livy2
Livy2
LOCATION and MANAGEDLOCATION clauses
LOCATION and MANAGEDLOCATION clauses
LOCATION and MANAGEDLOCATION clauses
LOCATION and MANAGEDLOCATION clauses
LOCATION and MANAGEDLOCATION clauses
Lock implementations to allow zero-wait readers
Log Search
Log Search
Major changes when migrating to MapReduce 2
Make Tables SparkSQL Compatible
Make Tables SparkSQL Compatible
Make Tables SparkSQL Compatible
Make Tables SparkSQL Compatible
Make Tables SparkSQL Compatible
Make Tables SparkSQL Compatible
Make Tables SparkSQL Compatible
Making the Hive plugin for Ranger visible
Making the Hive plugin for Ranger visible
Making the Hive plugin for Ranger visible
Making the Hive plugin for Ranger visible
Manage and monitor Iceberg replication policies
Manage and monitor snapshot policies
Manage, monitor, and troubleshoot Atlas replication policies
Managed table location
Managed table location
Managed table location
Managed table location
Managed table location
Managed table location
Managed table location
Managed table location
Managed table location
Managed Table Location Mapping
Managed Table Location Mapping
Managed Table Location Mapping
Managed Table Location Mapping
Managed Table Location Mapping
Managed Table Location Mapping
Managed Table Location Mapping
Managing HDFS snapshots in Cloudera Manager
Managing Hive ACID table replication policies
Managing MPacks
Managing MPacks
Managing Ozone replication policies
Managing Ranger replication policies
Managing replication policies
Mandatory CDP policy-level properties
Mandatory HDP cluster configuration properties
Mandatory HDP policy-level properties
Manual configuration of scheduler properties
Manual configuration of scheduler properties
Manual configuration of scheduler properties
Manual rollback
Manual upgrade to Cloudera Base on premises
Manual upgrade to Cloudera Base on premises
Manual upgrade to Cloudera Base on premises
Manually add the configurations of yarn-site.xml
Manually add the configurations of yarn-site.xml
Map Phoenix schemas to HBase namespaces
Map Phoenix schemas to HBase namespaces
Mapping Navigator metadata to Atlas
Mapping Navigator metadata to Atlas
Mapping Navigator metadata to Atlas
Mapping Sentry permissions for Solr to Ranger policies
Merge Independent Hive and Spark Catalogs
Merge Independent Hive and Spark Catalogs
Metadata Improvements
Migrate audit reports and processes to Ranger
Migrate Credential Aliases
Migrate Credential Aliases
Migrate from Cloudera Base on premises (Hive on Tez) to Cloudera Data Warehouse (LLAP)
Migrate Hive workloads from HDP (LLAP) to Cloudera Data Warehouse (LLAP)
Migrate Kafka Using Streams Replication Manager
Migrate Kafka Using the DefaultReplicationPolicy
Migrate Kafka Using the IdentityReplicationPolicy
Migrate Kafka Using the MigratingReplicationPolicy
Migrate Ranger Policies
Migrate Schema Registry
Migrate signing key
Migrate signing key
Migrate Streams Messaging Manager
Migrated features and limitations
Migrating Accumulo to Cloudera
Migrating ACLs from Key Trustee KMS to Ranger KMS
Migrating ACLs from Key Trustee KMS to Ranger KMS
Migrating Atlas data
Migrating Atlas data
Migrating Data Science Workbench (CDSW) to Cloudera AI
Migrating Data Science Workbench to Cloudera AI
Migrating data to Cloudera Base on premises from CDH using Replication Manager
Migrating Fair Scheduler to Capacity Scheduler for Cloudera Private Cloud
Migrating from Sentry to Ranger
Migrating HBase
Migrating HBase from CDH or HDP
Migrating HDFS data to Ozone for Cloudera Private Cloud
Migrating Hive 1-2 to Hive 3
Migrating Hive 1-2 to Hive 3
Migrating Hive workloads from CDH
Migrating Hive workloads from Cloudera Base on premises to Cloudera Data Warehouse on premises
Migrating Hive workloads from HDP 2.6.5
Migrating Hive workloads to ACID
Migrating Hive Workloads to Cloudera Private Cloud
Migrating Impala Data Overview
Migrating Impala Data to Cloudera Private Cloud
Migrating Impala Workloads to Cloudera Private Cloud
Migrating keys from Key Trustee Server to Ranger KMS
Migrating keys from Key Trustee Server to Ranger KMS
Migrating Kudu Data to Cloudera Private Cloud
Migrating Navigator audit information into Atlas
Migrating Navigator content to Atlas
Migrating Navigator content to Atlas
Migrating Navigator data using customized scripts
Migrating Navigator to Atlas for Cloudera Private Cloud with Cloudera Manager 6
Migrating Navigator to Atlas for Cloudera Private Cloud with Cloudera Manager 7
Migrating Navigator when upgrading Cloudera Manager 6 with CDH 6 clusters
Migrating Navigator when upgrading Cloudera Manager 7 with CDH 6 to Cloudera Runtime 7.1.9
Migrating Oozie configurations to Cloudera
Migrating Oozie Configurations to Cloudera Private Cloud
Migrating Oozie Shared Libraries
Migrating Operational Database to Cloudera Private Cloud
Migrating Projects
Migrating scheduler using the fs2cs conversion utility
Migrating Sentry to Ranger for Cloudera Private Cloud
Migrating Services
Migrating Services
Migrating Spark Apps
Migrating Spark Apps
Migrating Spark CDP to Cloudera Data Engineering
Migrating Spark Data to Cloudera Private Cloud
Migrating Spark workloads to
Migrating Spark workloads to
Migrating Spark workloads to Cloudera
Migrating Spark workloads to Cloudera
Migrating Spark workloads to Cloudera
Migrating Streaming workloads from HDF to Cloudera Private Cloud Base
Migrating Streaming Workloads to Cloudera Private Cloud
Migrating tables to CDP
Migrating tables to CDP
Migrating tables to CDP
Migrating to Accumulo 1.10.0
Migrating to Operational Database
Migrating Workloads
Migrating your data from HDFS to Ozone
Migration assumptions and prerequisites
Migration options
Migration paths for Hive users
Migration paths for Spark users
Migration paths from HDP 3 to CDP for LLAP users
Migration to Cloudera Data Warehouse
Migration to Cloudera Private Cloud Base
Migration to Cloudera Private Cloud Base or CDP Public Cloud
Missing Hive tables
Modifying peers to use in replication policy
Modifying the HSMM to prevent migration
Monitoring the performance of HDFS replication policies
Monitoring the performance of Hive/Impala replication policies
Move and Decommission
Move and Decommission
Move and Decommission
Move Atlas out of migration mode
Moving Atlas out of migration mode
Moving Atlas out of migration mode
Moving data from HDFS to Ozone using the distcp command
Moving Impala compute workloads from Cloudera Base on premises to Cloudera Data Warehouse Data Service on premises
Navigator Encrypt
Navigator Encrypt key migration with HSM
Navigator to Atlas
Networking and Security Requirements
New property to control datetime formatter
New Spark entry point SparkSession
New Spark entry point SparkSession
New Spark entry point SparkSession
New Spark entry point SparkSession
NULL related behaviors
NVL UDF implementation changes
Oozie
Oozie
Oozie
Oozie
Oozie
Oozie
Oozie
Oozie
Oozie database prerequisites
Oozie Load Balancer configuration
Oozie Load Balancer configuration
Operating System Requirements
Optional CDP policy-level properties
Optional HDP policy-level properties
ORC Support Disabled for Full-Transactional Tables
ORDER BY clause treatment of NULLs
Other Miscellaneous Changes in Impala
Other review configurations for HDFS
Other review configurations for HDFS
Other syntax and semantic changes
Overflow handling of decimals
Overview
Overview
Overview
Overview
Overview of the expedited Hive upgrade
Overview of the expedited Hive upgrade
Overview of the expedited Hive upgrade
Overview of the Migration of the Atlas and Infra Solr Data
Ozone
Ozone
Ozone configurations
Ozone namespace concepts
Ozone replication policies
Parameters to optimize Hive ACID table replication performance
Patches required on CDP
Patches Required on HDP
Perform express upgrade
Perform express upgrade
Perform the HDP upgrade
Perform the HDP upgrade
Performance and scalability limitations to consider for replication policies
Performance Differences between CDH and CDP
Permission models on Ozone
Phoenix
Phoenix
Phoenix
Place Atlas in migration mode
Placement rules evaluation engine
Placement rules evaluation engine
Placement rules migration
Placement Rules transition
Placement Rules transition
Plan your scheduler transition
Plan your scheduler transition
Planning a Cloudera Data Warehouse Virtual Warehouse instance
Planning Capacity Using WXM
Planning your scheduler migration
Port and network requirements for Replication Manager on Cloudera Base on premises
Ports
Ports
Post transition steps
Post transition steps
Post upgrade operations for your CDH 6 clusters
Post upgrade operations for your CDH 6 clusters
Post-HDP-upgrade tasks
Post-HDP-upgrade tasks
Post-migration steps
Post-migration steps
Post-migration tasks
Post-migration tasks
Post-migration tasks
Post-migration tasks
Post-migration tasks
Post-migration tasks
Post-migration tasks
Post-migration tasks
Post-migration tasks
Post-migration tasks
Pre-migration steps
Pre-migration steps
Pre-transition steps
Pre-transition steps
Pre-upgrade steps
Precedence of set operations
Precedence of set operations
Precedence of set operations
Precedence of set operations
Precedence of set operations
Precedence of set operations
Precedence of set operations
Precedence of set operations
Precedence of set operations
Precision and scale changes
Prepare to create Hive ACID table replication policies
Prepare to replicate using replication policies
Preparing Ambari Repository Configuration File to use Local Repository
Preparing Ambari Repository Configuration File to use Local Repository
Preparing Atlas for upgrade
Preparing clusters for Ranger replication policy creation
Preparing clusters to replicate Ozone data
Preparing configurations
Preparing for data migration
Preparing for your upgrade
Preparing for your upgrade
Preparing HBase for upgrade
Preparing HBase for upgrade
Preparing HDFS
Preparing HDFS
Preparing HDP Search for upgrade
Preparing HDP Search for upgrade
Preparing Hive for upgrade
Preparing Kafka for upgrade
Preparing Kafka for upgrade
Preparing Kerberos authentication-enabled clusters for replication
Preparing Ozone for data ingestion
Preparing Spark for upgrade
Preparing tables for migration
Preparing tables for migration
Preparing tables for migration
Preparing tables for migration
Preparing tables for migration
Preparing tables for migration
Preparing the backend HMS database for upgrade
Preparing the backend HMS database for upgrade
Preparing the backend HMS database for upgrade
Preparing the backend HMS database for upgrade
Preparing the services for upgrade
Preparing to create Atlas replication policies
Preparing to create Iceberg replication policies
Preparing Zeppelin for upgrade
Preparing ZooKeeper for upgrade
Prerequisites for CDSW to Cloudera AI migration
Prerequisites for external database
Preventing SparkSQL incompatibility
Preventing SparkSQL incompatibility
Problem area: Compose page
Problem area: Compose page
Problem area: Queries page
Problem area: Queries page
Problem area: Reports page
Problem area: Reports page
Procedure to Downgrade from CDP Private Cloud Base 7.1.9
Procedure to Downgrade from Cloudera Base on premises 7.3.1
Procedure to Downgrade or Rollback from CDP Private Cloud Base 7.1.9
Procedure to Downgrade or Rollback from Cloudera Base on premises 7.3.1
Procedure to Rollback from CDP Private Cloud Base 7.1.7 SP1 to CDP Private Cloud Base 7.1.7
Procedure to Rollback from CDP Private Cloud Base 7.1.7 SP1 to CDP Private Cloud Base 7.1.7
Procedure to Rollback from CDP Private Cloud Base 7.1.7 SP1 to CDP Private Cloud Base 7.1.7
Procedure to Rollback from CDP Private Cloud Base 7.1.7 SP2 to CDP Private Cloud Base 7.1.7 SP1
Procedure to Rollback from CDP Private Cloud Base 7.1.7 SP3 to CDP Private Cloud Base 7.1.6
Procedure to Rollback from CDP Private Cloud Base 7.1.7 SP3 to CDP Private Cloud Base 7.1.7
Procedure to Rollback from CDP Private Cloud Base 7.1.7 SP3 to CDP Private Cloud Base 7.1.7 SP1
Procedure to Rollback from CDP Private Cloud Base 7.1.7 SP3 to CDP Private Cloud Base 7.1.7 SP2
Procedure to Rollback from CDP Private Cloud Base 7.1.8 to CDP Private Cloud Base 7.1.7 SP1
Procedure to Rollback from CDP Private Cloud Base 7.1.9
Procedure to Rollback from CDP Private Cloud Base 7.1.9 SP1 to CDP Private Cloud Base 7.1.7 SP3
Procedure to Rollback from CDP Private Cloud Base 7.1.9 SP1 to CDP Private Cloud Base 7.1.8 latest cumulative hotfix
Procedure to Rollback from CDP Private Cloud Base 7.1.9 SP1 to CDP Private Cloud Base 7.1.9
Procedure to Rollback from Cloudera Base on premises 7.3.1
Process of migrating the HDFS data to Ozone
Product Compatibility Matrices
Project Migration FAQs
Proxy Cloudera Manager through Apache Knox
Proxy Cloudera Manager through Apache Knox
Query column is empty, yet you can see the DAG ID and Application ID
Query column is empty, yet you can see the DAG ID and Application ID
Query column is not empty, but you cannot see the DAG ID and Application ID
Query column is not empty, but you cannot see the DAG ID and Application ID
Querying Hive managed tables from Spark
Querying Hive managed tables from Spark
Querying Hive managed tables from Spark
Querying Hive managed tables from Spark
Querying Hive managed tables from Spark
Querying Hive managed tables from Spark
Querying Hive managed tables from Spark
Querying Hive managed tables from Spark
Querying Hive managed tables from Spark
Ranger
Ranger
Ranger
Ranger
Ranger
Ranger
Ranger
Ranger
Ranger
Ranger admin password
Ranger admin password
Ranger database prerequisites
Ranger Installation in High Availability with Load Balancer
Ranger KMS
Ranger KMS
Ranger KMS
Ranger KMS
Ranger MySQL collation
Ranger policies allowing create privilege for Hadoop_SQL databases
Ranger policies allowing create privilege for Hadoop_SQL tables
Ranger replication policies
Ranger Service connection with Oracle database
Ranger Service connection with Oracle database
Recommended Hive configuration parameters for Hive ACID table replication policies
Reconnect to HS2 Session
Recreating aliases
Reference information
Referencing a corrupt JSON/CSV record
Referencing a corrupt JSON/CSV record
Referencing a corrupt JSON/CSV record
Referencing a corrupt JSON/CSV record
Register software repositories
Register software repositories
Registering Ambari Cloudera Manager pair for source cluster
Registering Ambari Cloudera Manager pair for target cluster
Reindexing Solr collections
Release Guide
Remove Existing Collections and Upgrade Binaries
Remove Existing Collections and Upgrade Binaries
Remove Hive Ranger property
Remove PREFIX_TREE Data Block Encoding
Remove PREFIX_TREE data block encoding
Remove transactional=false from Table Properties
Remove transactional=false from Table Properties
Removing cluster hosts and Kubernetes nodes
Removing Hive on Spark Configurations
Removing Hive on Spark Configurations
Removing Hive on Spark Configurations
Removing Hive on Spark Configurations
Removing Navigator role instances
Removing Navigator role instances
Removing PREFIX_TREE Data Block Encoding
Removing the LLAP Queue
Removing the LLAP Queue
Removing the LLAP Queue
Renaming tables
Renaming tables
Renaming tables
Renaming tables
Renaming tables
Renaming tables
Repl Command Known Issues
Replicate Impala and Hive User Defined Functions (UDFs)
Replicating data to Impala clusters
Replicating from unsecure to secure clusters
Replicating Hive data
Replicating Hive data from HDP 3 to CDP
Replication failure in the DAS Event Processor
Replication failure in the DAS Event Processor
Replication Manager
Replication Manager
Replication Manager in Cloudera Base on premises
Replication of encrypted data
Reports Manager
Repurposing CDSW nodes for Cloudera AI
Required ports in Kerberos authentication-enabled clusters for replication
Reset ZNode ACLs
Reset ZNode ACLs
Restore ATLAS_ENTITY_AUDIT_EVENTS table
Restore ATLAS_ENTITY_AUDIT_EVENTS table
Restore HBase Tables
Restore HBase Tables
Restore old configuration symlinks
Restore Ranger Admin Database
Restore Ranger Admin Database
Restore Ranger Admin Database
Restore Ranger KMS Database
Restore Ranger KMS Database
Restore Ranger KMS Database
Restore Solr collections on CDP cluster
Restore Solr collections on CDP cluster
Restore Solr snapshots
Restoring HDFS snapshots in Cloudera Manager
Restoring HDFS snapshots in Cloudera Manager
Restoring Kudu data into the target Cloudera cluster
Restoring Ozone snapshots in Cloudera Manager
Retaining logs for Replication Manager
Reuse Existing Database
Reuse Existing Storage
Revert to CDH-like Tables
Revert to CDH-like Tables
Reverting a Failed Upgrade
Reverting a Failed Upgrade
Reverting a Failed Upgrade
Review Ambari UI and the Quick Links
Roles and sizing considerations for Ozone
Rollback Ambari 7.1.x to Ambari 2.7.5
Rollback Ambari to 2.6.5
Rollback and Downgrade Cloudera Base on premises
Rollback HDP Services
Rollback HDP Services 3.1.5 from CDP 7.1.x
Rollback HDP services from CDP 7.1.x
Rollback of Ranger KMS DB to KTS
Rolling back a Cloudera Base on premises 7 upgrade to CDH 5
Rolling Back a Cloudera Private Cloud Base Upgrade from version 7.1.8 to CDH 6
Rolling Back a Cloudera Private Cloud Base Upgrade from version 7.1.9 to CDH 6
Rolling Back a Cloudera Private Cloud Base Upgrade from versions 7.1.1 - 7.1.7 to CDH 6
Rounding in arithmetic operations
Rounding in arithmetic operations
Rounding in arithmetic operations
Rounding in arithmetic operations
Run Compaction on Hive Tables
Run Hue Document Cleanup
Run Hue Document Cleanup
Run the extraction
Run the extraction for CDH 6 with Cloudera Manager 6
Run the extraction for CDH 6 with Cloudera Manager 7
Run the import
Run the import for CDH 6 with Cloudera Manager 6
Run the import for CDH 6 with Cloudera Manager 7
Run the transformation
Run the transformation for CDH 6 with Cloudera Manager 6
Run the transformation for CDH 6 with Cloudera Manager 7
Running a job interactively
Running a job interactively
Running a job interactively
Running a job interactively
Running a Python-based job
Running a Python-based job
Running a Python-based job
Running a Python-based job
Sample data ingestion
Sample data ingestion
Sample data ingestion
Save Hive Metastore by Dumping
Scheduler migration limitations
Scheduler migration overview
Scheduler transition limitations
Scheduler transition limitations
Search post-HDP-upgrade tasks
Search post-HDP-upgrade tasks
Securing ZooKeeper
Securing ZooKeeper
Security considerations for encrypted data during replication
Security tasks
Security tasks
Semantic changes and workarounds CDP 7.1.1
Semantic changes and workarounds CDP 7.1.4
Semantic changes and workarounds CDP 7.1.5
Semantic changes and workarounds CDP 7.1.6
Semantic changes and workarounds CDP 7.1.7
Semantic changes and workarounds CDP 7.1.7 SP1
Semantic changes and workarounds CDP 7.1.7 SP2
Semantic changes and workarounds CDP 7.1.7 SP2 CHFx
Semantic changes and workarounds CDP 7.1.8 CHFx
Sentry to Ranger
Sentry to Ranger replication for Hive external tables
Service components limitations
Service Monitor Requirements
Set ACLs for Impala
Set ACLs for Impala
Set log level for KeyTrustee KMS to INFO
Set log level for KeyTrustee KMS to INFO
Set maximum retention days for Ranger audits
Set maximum retention days for Ranger audits
Set Solr configuration properties
Set Storage Engine ACLs
Set Up a New Streaming Cluster in Cloudera Private Cloud Base
Set up self-signed certificates
Set up self-signed certificates
Set up trusted CA certificate
Set up trusted CA certificate
Setting Hive Configuration Overrides
Setting Hive Configuration Overrides
Setting Hive Configuration Overrides
Setting Hive Configuration Overrides
Setting Hive Configuration Overrides
Setting Hive Configuration Overrides
Setting the owner and permissions of /user/yarn
Setting up a local repository
Setting up a local repository
Setting up access control lists
Setting up access control lists
Setting up access control lists
Setting up access control lists
Setting up access control lists
Setting up access control lists
Setting up CMA server
Setting up Hive metastore for Atlas
Setting up Hive metastore for Atlas
Setting up Hive metastore for Atlas
Setting up Hive metastore for Atlas
Setting up local repository with temporary internet access
Setting up local repository with temporary internet access
Setting up ODBC connection from a BI tool
Setting up quick links for the DAS UI
Setting up quick links for the DAS UI
Setting up the HDP cluster
Setting up the tmp directory
Setting up the tmp directory
Side-car migration
Sidecar migration from CDH to CDP
Sidecar migration from CDH to Cloudera
Sidecar migration from HDP to CDP
Sidecar migration from HDP to Cloudera
Snapshots and snapshot policies
Software download matrix for 3.1.5 to CDP 7.1.x
Software download matrix for HDP 2.6.5 to CDP 7.1.x
Software download matrix for HDP 3.1.5 and 2.6.5 to CDP 7.1.x
Software Requirements
Solr
Solr
Solr
Solr
Solr
Solr
Solr
Sort behavior in SHOW COLUMNS
Spark
Spark
Spark
Spark
Spark
Spark
Spark
Spark
Spark 1.6 to Spark 2.4 changes
Spark 1.6 to Spark 2.4 changes
Spark 1.6 to Spark 2.4 changes
Spark 1.6 to Spark 2.4 changes
Spark 1.6 to Spark 2.4 Refactoring
Spark 1.6 to Spark 2.4 Refactoring
Spark 1.6 to Spark 2.4 Refactoring
Spark 1.6 to Spark 2.4 Refactoring
Spark 2.3 to Spark 2.4 changes
Spark 2.3 to Spark 2.4 changes
Spark 2.3 to Spark 2.4 changes
Spark 2.3 to Spark 2.4 changes
Spark 2.3 to Spark 2.4 changes
Spark 2.3 to Spark 2.4 Refactoring
Spark 2.3 to Spark 2.4 Refactoring
Spark 2.3 to Spark 2.4 Refactoring
Spark 2.3 to Spark 2.4 Refactoring
Spark 2.3 to Spark 2.4 Refactoring
Spark 2.4 CSV example
Spark 2.4 CSV example
Spark 2.4 CSV example
Spark 2.4 CSV example
Spark 2.4 CSV example
Spark 2.4 CSV example
Spark 2.4 CSV example
Spark 2.4 CSV example
Spark 2.4 CSV example
Spark 2.4 to Spark 3.2 Refactoring
Spark integration with Hive
Spark integration with Hive
Spark integration with Hive
Spark integration with Hive
Spark integration with Hive
Spark2/Livy
Spark2/Livy
Specifying hosts to improve HDFS replication policy performance
Specifying hosts to improve Hive replication policy performance
Start job history
Start job history
Starting all services
Starting all services
STDDEV_SAMP and VAR_SAMP
Step 10: Exit Maintenance Mode
Step 10: Run the Upgrade Cluster Wizard
Step 10: Run the Upgrade Cluster Wizard
Step 11: Finalize the HDFS or Ozone Upgrade
Step 11: Finalize the HDFS or Ozone Upgrade
Step 12: Complete Post-Upgrade steps for upgrades to Cloudera Base on premises
Step 12: Complete Post-Upgrade steps for upgrades to Cloudera Base on premises
Step 13: Exit Maintenance Mode
Step 13: Exit Maintenance Mode
Step 1: Getting Started
Step 1: Getting Started
Step 1: Getting Started
Step 1: Getting Started
Step 1: Getting Started
Step 1: Getting Started
Step 1: Getting Started
Step 1: Getting Started Upgrading Cloudera Manager 5
Step 1: Getting Started Upgrading Cloudera Manager 6
Step 1: Getting Started Upgrading Cloudera Manager 7
Step 2: Backing Up
Step 2: Backing Up
Step 2: Backing Up
Step 2: Backing Up
Step 2: Backing Up
Step 2: Backing Up
Step 2: Backing Up
Step 2: Ingesting permissions into Ranger
Step 2: Review Notes and Warnings
Step 2: Review Notes and Warnings
Step 2: Review Notes and Warnings
Step 3: Backing Up the Cluster
Step 3: Backing Up the Cluster
Step 3: Backing Up the Cluster
Step 3: Before You Upgrade
Step 3: Before You Upgrade
Step 3: Before You Upgrade
Step 3: Before You Upgrade
Step 3: Upgrading the Server
Step 3: Upgrading the Server
Step 3: Upgrading the Server
Step 4: After You Upgrade
Step 4: After You Upgrade
Step 4: After You Upgrade
Step 4: After You Upgrade
Step 4: Back Up
Step 4: Back Up Cloudera Manager
Step 4: Back Up Cloudera Manager
Step 4: Upgrading the Agents
Step 4: Upgrading the Agents
Step 4: Upgrading the Agents
Step 5: Access Parcels
Step 5: After You Upgrade
Step 5: After You Upgrade
Step 5: After You Upgrade
Step 5: Complete Pre-Upgrade steps for upgrades to Cloudera Base on premises
Step 5: Complete Pre-Upgrade steps for upgrades to Cloudera Base on premises
Step 6: Access Parcels
Step 6: Access Parcels
Step 6: Enter Maintenance Mode
Step 7: Configure Streams Messaging Manager
Step 7: Configure Streams Messaging Manager
Step 7: Run the Upgrade Cluster Wizard
Step 8: Configure Schema Registry
Step 8: Configure Schema Registry
Step 8: Finalize the HDFS or Ozone Upgrade
Step 9: Complete Post-Upgrade steps for upgrades to Cloudera Base on premises
Step 9: Enter Maintenance Mode
Step 9: Enter Maintenance Mode
Steps for migrating Impala workloads to Cloudera Data Warehouse Data Service on premises
Stop Cloudera Manager Server & Cloudera Management Service
Stop Cloudera Manager Server & Cloudera Management Service
Stop Cloudera Manager Server & Cloudera Management Service
Stop Cloudera Manager Server & Cloudera Management Service
Stop Cloudera Manager Server & Cloudera Management Service
Stop Cloudera Manager Server & Cloudera Management Service
Supplemental Upgrade Topics
Support for 0 ROWS PRECEDING or FOLLOWING
Support for SQL:2016 datetime formats (limited formats)
Support for SQL:2016 datetime formats (text, FM, FX)
Supported authentication
Supported in-place upgrade paths
Supported scheduled query operations
Syntax and semantic changes CDH 6.2.1 to CDP 7.0.3.2
Table design considerations
Table properties support
Table properties support
Table properties support
Table properties support
Table properties support
Table properties support
Table properties support
Table properties support
Table properties support
Tables in Hive 1 and 2 vs. Hive 3
Take a Mandatory Snapshot of Hive Tables
Taking and deleting HDFS snapshots
Test the configuration
Test the configuration
Test the configuration
Test the replicated data
Testing applications
Tez
Tez
Third-party filesystems
TIMESTAMP based on UTC
Timestamp or date related behaviors
TLS/SSL
TLS/SSL
Topology migration
Topology migration
Transition process
Transition process
Transition Solr configuration
Transition Solr configuration
Transition Solr configuration
Transitioning Cloudera Search configuration
Transitioning Embedded PostgreSQL Database to External PostgreSQL Database
Transitioning from MapReduce 1 to MapReduce 2
Transitioning from Sentry Policy Files to the Sentry Service
Transitioning from Sentry Policy Files to the Sentry Service
Transitioning HDP 2.6.5 cluster to CDP Private Cloud Base 7.1.x cluster using the AM2CM tool
Transitioning HDP 3.1.5 cluster to CDP Private Cloud Base 7.1.x cluster using the AM2CM tool
Transitioning HDP to Cloudera Private Cloud Base
Transitioning HDP to Cloudera Private Cloud Base
Transitioning Navigator audits
Transitioning Navigator audits
Transitioning Navigator content to Atlas
Transitioning Navigator content to Atlas
Transitioning Navigator data using customized scripts
Transitioning Navigator data using customized scripts
Transitioning the Sentry service to Apache Ranger
Transitioning the Sentry service to Apache Ranger
Transitioning to Cloudera Manager
Transitioning to Cloudera Manager
Troubleshooting
Troubleshooting
Troubleshooting
Troubleshooting
Troubleshooting
Troubleshooting
Troubleshooting
Troubleshooting CDSW migration to Cloudera AI
Troubleshooting DAS installation
Troubleshooting DAS installation
Troubleshooting Hive ACID table replication policies
Troubleshooting Hive replication using REPL
Troubleshooting preflight migration check issues
Troubleshooting replication policies between on-premises clusters
Troubleshooting snapshot policies in Replication Manager
Troubleshooting the HDP upgrade
Troubleshooting the HDP upgrade
Troubleshooting: Retrying a successful or failed migration
Troubleshooting: Running the tool as a background process
Troubleshooting: Using custom SSL certificates to connect to Cloudera AI Workbenches
TRUNCATE TABLE on an external table
TRUNCATE TABLE on an external table
TRUNCATE TABLE on an external table
TRUNCATE TABLE on an external table
TRUNCATE TABLE on an external table
TRUNCATE TABLE on an external table
Tuning JVM Garbage Collection
Tuning JVM Garbage Collection
Tuning JVM Garbage Collection
Turn off YARN GPU
UNBOUNDED representation in Window functions
Understanding CREATE TABLE behavior
Understanding CREATE TABLE behavior
Understanding CREATE TABLE behavior
Understanding CREATE TABLE behavior
Understanding CREATE TABLE behavior
Understanding CREATE TABLE behavior
Understanding migrated Navigator entites
Understanding the Hive upgrade
Understanding the Hive upgrade
Understanding the Hive upgrade
union replaces unionAll
union replaces unionAll
union replaces unionAll
union replaces unionAll
UNIX_TIMESTAMP behavior
UNIX_TIMESTAMP conversion of TIMESTAMPLOCALTZ
Unsetting Kafka Protocol version
Unsetting Kafka Protocol version
Unsupported Interfaces and Features
Update Oozie properties
Update Oozie properties
Update permissions for Replication Manager service
Update permissions for Replication Manager service
Update Ranger passwords
Update version repository base urls
Update version repository base urls
Updated CDH Components
Updated HDP Components
Updating Ambari repo files
Updating Ambari repo files
Updating group permissions for Hive query editor
Updating group permissions for Hive query editor
Updating HDP repo files
Updating HDP repo files
Updating Hive and Impala JDBC/ODBC drivers
Updating Hive and Impala JDBC/ODBC drivers
Updating Hive and Impala JDBC/ODBC drivers
Updating Hive and Impala JDBC/ODBC drivers
Updating Navigator Encrypt
Upgrade Key Trustee Server to 7.1.x
Upgrade Key Trustee Server to 7.1.x
Upgrade Navigator Encrypt to 7.1.x
Upgrade Navigator Encrypt to 7.1.x
Upgrade Notes for Apache Kudu 1.12 / CDP 7.1
Upgrade Notes for Apache Kudu 1.15 / CDP 7.1
Upgrade process
Upgrade process
Upgrade to Ambari 7.1.x.0
Upgrade to Ambari 7.1.x.0
Upgrading a CDH 5 Cluster
Upgrading a CDH 6 Cluster
Upgrading a Cluster
Upgrading Ambari
Upgrading Ambari
Upgrading Ambari Infra
Upgrading Ambari Infra
Upgrading Ambari Log Search
Upgrading Ambari Metrics
Upgrading Ambari Metrics
Upgrading Ambari Metrics System and SmartSense
Upgrading an MRv1 installation using Cloudera Manager
Upgrading Cloudera Manager 5
Upgrading Cloudera Manager 6
Upgrading Cloudera Manager 7
Upgrading Cloudera Navigator Encrypt
Upgrading Cloudera Navigator Key HSM
Upgrading Cloudera Navigator Key HSM
Upgrading Cloudera Navigator Key HSM
Upgrading Cloudera Navigator Key Trustee Server 7.1.x
Upgrading HDP to Cloudera Runtime 7.1.x
Upgrading HDP to Cloudera Runtime 7.1.x
Upgrading Key Trustee KMS
Upgrading SmartSense
Upgrading the cluster's underlying OS
Upgrading the cluster's underlying OS
Upgrading the cluster's underlying OS
Upgrading the JDK
Upgrading the JDK
Upgrading the JDK
Upgrading the Operating System
Upgrading the Operating System
Upgrading the Operating System to a new Major Version
Upgrading the Operating System to a new Minor Version
Upload aliases.json to the upgraded cluster
Upload HDFS entity information
Upload HDFS entity information
Use authzmigrator tool to migrate Hive and Kafka permissions to Ranger
Use Cloudera Manager Safety Valves to configure scheduler properties
Use Cloudera Manager Safety Valves to configure scheduler properties
Use Replication Manager to migrate to Cloudera Base on premises
Use the fs2cs conversion utility
Use the fs2cs conversion utility
Use YARN Queue Manager UI to configure scheduler properties
Use YARN Queue Manager UI to configure scheduler properties
Using AES-256 Encryption
Using AES-256 Encryption
Using AES-256 Encryption
Using Airflow
Using Cloudera Manager Safety Valves to configure scheduler properties
Using Reserved Words in SQL Queries
Using spark-submit drop-in migration tool for migrating Spark workloads to CDE
Using Swagger Page
Using the CDSW to Cloudera AI Migration tool
Using the Cloudera Data Engineering CLI
Using YARN Queue Manager UI to configure scheduler properties
Validate Database URL
Validate Database URL
Validate HFile
Validate HFiles
Validate the configuration
Validate the configuration
Validate the configuration
Validate the migration
Validate TLS configurations
Validate TLS configurations
Validating external table replication
Validating the migrated data
Verify Zeppelin settings in Ambari
Verifying and validating if your data is migrated
Verifying replication
Verifying the Hive data replication
Verifying the migration prerequisites
Version and Download Information
Versions and supported services for migration
View HDFS replication policy details
View historical details for an HDFS replication policy
What is new in Atlas for Navigator Users
What's new in Atlas for Navigator Users?
What's new in Atlas for Navigator Users?
Workload selection
Write to Hive bucketed tables
Write to Hive bucketed tables
Write to Hive bucketed tables
Write to Hive bucketed tables
YARN
YARN
YARN
YARN
YARN
YARN
YARN Capacity Scheduler
YARN CGroups
YARN Fair Scheduler to Capacity Scheduler
Yarn Mapreduce framework jars
Yarn Mapreduce framework jars
YARN mapreduce paramater
YARN NodeManager
YARN NodeManager CGroups
YARN owner permission
YARN Registry DNS instance fails to start
YARN Registry DNS instance fails to start
You cannot see your databases or the query editor is missing
You cannot see your databases or the query editor is missing
You cannot view new databases and tables, or cannot see changes to existing databases or tables
You cannot view new databases and tables, or cannot see changes to existing databases or tables
You cannot view queries from other users
You cannot view queries from other users
Your queries are not appearing on the Queries page
Your queries are not appearing on the Queries page
ZDU Component Support
ZDU known issues
Zeppelin
Zeppelin
Zeppelin
Zeppelin Shiro configurations
Zeppelin Shiro configurations
ZooKeeper
ZooKeeper
ZooKeeper
ZooKeeper
ZooKeeper
ZooKeeper
Mandatory Post-Upgrade Tasks
Mandatory Post-Upgrade Tasks
Preparing to Upgrade Ambari

«

Filter topics

Migrating Spark Apps

▼Migrating Hive workloads from CDH
▶︎Migrating Hive workloads from HDP 2.6.5
▶︎Replicating Hive data from HDP 3 to CDP
▶︎Migration paths from HDP 3 to CDP for LLAP users
1. ▶︎Migration paths for Hive users
2. ▶︎Migration paths for Spark users
  1. Migration to Cloudera Private Cloud Base
  2. HWC changes from HDP to CDP
▶︎Migrating Hive workloads from Cloudera Base on premises to Cloudera Data Warehouse on premises
▶︎Migrating Hive workloads to ACID

»

Migrating Hive Workloads to Cloudera Private Cloud

Migrating Spark Apps

Preventing SparkSQL incompatibility
You need to be aware of two SparkSQL incompatibilities and how to work around these problems. The upgrade process converted all CDH Hive tables to external tables, however, if you moved managed, non-ACID tables preventing conversion to external tables, these are not compatible with native SparkSQL. Also, you might encounter a problem reading Hive 2 external ORC tables from Spark.
Spark integration with Hive
You need to know a little about Hive Warehouse Connector (HWC) and how to find more information because to access Hive from Spark, you need to use HWC implicitly or explicitly.
Removing Hive on Spark Configurations
Your scripts, or queries, include the Hive on Spark configuration, which is no longer supported, and you must know how to recognize and remove these configurations.

Parent topic: Migrating Hive workloads from CDH

Parent topic: Migrating Hive Workloads from HDP 2.6.5 after an in-place upgrade

This site uses cookies and related technologies, as described in our privacy policy, for purposes that may include site operation, analytics, enhanced user experience, or advertising. You may choose to consent to our use of these technologies, or