Migrating Data to CDP
Overview
Migrating data from CDH to Cloudera
Migrating HDFS and Hive data from CDH to Cloudera
Migration prerequisites
Ports for Cloudera Replication Manager on Cloudera Public Cloud
Setting up an external account
Setting up SSL/TLS certificate exchange
Cloudera license requirements for
Introduction to Cloudera Replication Manager
Accessing the Cloudera Replication Manager service
How replication policies work
Replication policy considerations
Working with cloud credentials
Adding cloud credentials
Update cloud credentials
Delete cloud credentials
HDFS data migration from CDH to Cloudera
Creating a HDFS replication policy
Verifying HDFS data migration
Hive migration from CDH to Cloudera
Creating a Hive replication policy
Verifying Hive data migration
Migrating Oozie workflows from CDH to Cloudera
About Migrating Oozie workloads
Migration prerequisites
Setting up an external account
Migrating Hue databases from CDH to Cloudera
Performing post-migration tasks
Migrating HDFS and Hive data from CDH to Cloudera
Migrating HDFS native permissions to Cloudera
Extracting HDFS native permissions
Converting HDFS native permissions into Ranger HDFS policies
Transforming Ranger HDFS policies into Ranger S3 policies
Importing Ranger AWS S3 policies
Migrating workflows directly created in Oozie to Cloudera
Migrating Sentry policies from CDH to Cloudera
About Migrating Sentry policies
Migration prerequisites
Setting up an external account
Exporting Sentry permissions
Importing Sentry permissions into Ranger
Migrating data from HDP to Cloudera
Migrating HDFS data from HDP to Cloudera
Migration prerequisites
About DistCp tool
Using the DistCp tool
Unbanning hdfs user in HDP cluster
Before migrating
HDFS data migration from HDP to Cloudera
Migrating HDFS native permissions to Cloudera
Extracting HDFS native permissions
Converting HDFS native permissions into Ranger HDFS policies
Transforming Ranger HDFS policies into Ranger S3 policies
Importing Ranger AWS S3 policies
Migrating Ranger policies from HDP to Cloudera
About Migrating Ranger policies
Migration prerequisites
Copying Policy Migration utility to the source cluster
Performing Export and Transform operations
About the export operation
Running the export operation
About the transform operation
Running the transform operation
Performing Import operation
Supported Input parameters for Export operation
Supported Input parameters for Transform operation
Migrating Hive data from HDP 2.x or HDP 3.x to Cloudera
Migration prerequisites
Setting up Hive JDBC standalone JARS
Save Hive Metastore by Dumping
Take a Mandatory Snapshot of Hive Tables
Setting up security
Installing and configuring HMS Mirror
Sample YAML configuration file
Testing the YAML and the cluster connection
HMS Mirror command summary
Migrating Hive metadata
HMS Mirror generated files
Verifying metadata migration
Migrating actual Hive data
Adjust AVRO table schema URLs
Verifying actual Hive data migration
Table locations
Fixing statistics
Changes to HDP Hive tables