Cloudera Migration Assistant Overview

Cloudera Migration Assistant is a user interface based extensible tool to assist Hadoop (CDH) users to easily migrate data, metadata and certain workloads to the various form factors of Cloudera.

Supported Cloudera Public Cloud migration paths

Cloudera Migration Assistant (previously AM2CM) can be used to migrate from the legacy CDH and Cloudera Private Cloud Base platforms to Cloudera Public Cloud. The supported migration paths vary based on the Cloudera Migration Assistant version.


Cloudera Migration Assistant version	Migration paths	Cloud provider	Workloads	Data
Cloudera Migration Assistant 3.4	Cloudera Private Cloud Base 7.1.7, 7.1.8, 7.1.\|9 → Cloudera Public Cloud 7.2.18 migration	AWS, Azure	SQL Oozie Spark	HDFS files HMS tables HBase tables
Cloudera Migration Assistant 3.3	CDH 5.1.x → Cloudera Public Cloud 7.2.x CDH 6.3.x → Cloudera Public Cloud 7.2.x Cloudera Private Cloud Base 7.1.7→ Cloudera Public Cloud 7.2.x	AWS, Azure	SQL Oozie	HDFS files HMS tables HBase tables
Cloudera Migration Assistant 3.2	CDH 5.1.x → Cloudera Public Cloud 7.2.x CDH 6.3.x → Cloudera Public Cloud 7.2.x	AWS	SQL Oozie (Hive action)	HDFS files HMS tables HBase tables
Cloudera Migration Assistant 3.0	CDH 5.1.x → Cloudera Public Cloud 7.2.x CDH 6.3.x → Cloudera Public Cloud 7.2.x	AWS	SQL	HDFS files HMS tables
Cloudera Migration Assistant 2.8	CDH 6.3.x → Cloudera Public Cloud 7.2.17 (Technical Preview)	AWS	SQL	HDFS files HMS tables

Release Notes

Learn about the known issues, and fixed issues and behavioral changes in Cloudera Migration Assistant.

3.4.1

What's new

AMCM-2489 configurable JVM heap size for CDH discovery tool

Fixed issues

AMCM-2692 Stop All Services In The Cluster - fails with non-default password
AMCM-2637 Spark application parameters with single - won't work
AMCM-2570 Remove Label assignment removes HDFS locations
AMCM-2650 SQL Workload Migration doesn't replicate its SQL file from HDFS
AMCM-2625 Multiple HiveSQL migration ignores the HiveSQL files
AMCM-2626 NPE when trying to get source server clusters after db upgrade
AMCM-2624 /root/.cdp/credentials Missing for hive migration
AMCM-2636 Use master node in execution Instruction

Known issues

AMCM-2457 Python 3.12.x dependency collision on Cloudera Migration Assistant server node

3.4.0

What's new

AMCM-1168 Spark Application Migration
- Exploring Past Spark Workloads via Spark History Server
- Spark Workload's dependency discovery based on spark-submit and application parameters
- Limitations
  - CDH6 and Cloudera Private Cloud Base as Source with Spark 2
  - No spark code change available
  - No automated jar and Python package dependency discovery
AMCM-2426 Store SSH Settings as Credentials
AMCM-2300 Upgradability - Tech Preview
Several UX improvements and fixes

Known issues

AMCM-2457 Python 3.12.x dependency collision on Cloudera Migration Assistant server node

3.3.1

What's new

Parcel deployment - available as Technical Preview
The parcel deployment enables you to install Cloudera Migration Assistant as a service in Cloudera Manager.

Fixed issues

AMCM-2273 Cloudera Migration Assistant doesn't handle long clusternames
AMCM-2233 Create a field to manage the number of Ansible forks
AMCM-2232 Fix user settings validation on target registration when changing clusters
AMCM-2218 Replace Browser icon (Favico) to Cloudera Migration Assistant icon small version
AMCM-2067 Obtain Hive HMS DB Password from User Directly
Pre-checks on Cloudera Migration Assistant Server Start:
- AMCM-2188 Checking if Java11 and JAVA_HOME exists
- AMCM-2188 Checking Java before starting the server
- AMCM-2186 Checking Python version

3.3.0

What's new

AMCM-1764 Azure Support
AMCM-1418 Cloudera Private Cloud Base to Public Cloud Migration (without security metadata migration)
AMCM-1361 Oozie Migration with Map-Reduce action and genric support for all other action types
AMCM-1765 Cloudera Migration Assistant Landing Page
AMCM-1878 Side-bar Redesign
AMCM-2135 One-time HBase Migration without Cloudera Replication Manager

Limitations

You need to manually migrate Ranger policies from Cloudera Private Cloud Base to Cloudera Public Cloud as described in Migrating from source cluster to destination cluster.

3.2.1

Fixed Issues

AMCM-1879 Missing airgapped for localhost (#1696)
AMCM-1908 Hive SQL Export button does not work (#1693)
AMCM-1906 Fix Broken background color (#1691)
AMCM-1888 Show Refresh option of scanned data tables as in UI design - rebase fix (#1686)
AMCM-1880 ps is missing from the rhel8 docker image (#1659) (#1685)
AMCM-1902 Make navigation panel not scrollable (#1679) (#1684)
AMCM-1872 Filtered scan results are reset after switch to another page (#1655) (#1678)
AMCM-1830 discovery_bundle_builder fails if no mysql-connector-java.jar is found (#1682)
AMCM-1892 L&S Data migration Cloudera Replication Manager policy should have default value for frequencyInSec (#1681) (#1683)
AMCM-1888 Show Refresh option of scanned data tables as in UI design (#1666) (#1670)
AMCM-1887 Fix Mapping discrepancies (#1662) (#1671)
AMCM-1891 Change API info (#1668) (#1675)
AMCM-1867 Set step status before perform (#1667) (#1674)
AMCM-1820 Toast message appears unexpectedly (#1663) (#1669)
AMCM-1871 Fix wrong position of collection component (#1643) (#1672)

Known Issues

AMCM-1860 Airgapped download

The following files needs to be downloaded and copied manually before any --airgapped install.

<CMA_ROOT_DIR>
- atlas-migration-exporter-0.8.0.2.6.6.0-332.tar.gz
- jdbc-drivers/
  - mysql-connector-java-5.1.46.jar
  - ojdbc8.jar
  - postgresql-42.3.4.jar

Only add the JDBC driver your cluster uses.

Behavioral Changes

/info endpoint API response changed to correctly return the product name (AMCM-1891)

Fixed Common Vulnerabilities and Exposures

Learn more about the Common vulnerabilities and Exposures (CVEs) that were fixed in this release.

CVE-2024-1597: org.postgresql:postgresql vulnerable to SQL Injection via line comment generation - AMCM-1910

/info endpoint API response changed to correctly return the product name (AMCM-1891)

3.2.0

Known Issues

HBase migration from CDH needs extra parcels Installed

In order to use Cloudera Migration Assistant for you need obtain the following parcels from Cloudera Support :

CDH5 : CLOUDERA_OPDB_REPLICATION-1.0-1.CLOUDERA_OPDB_REPLICATION5.14.4.p0.31473501-el7.parcel
CDH6 : CLOUDERA_OPDB_REPLICATION-1.0-1.CLOUDERA_OPDB_REPLICATION6.3.3.p0.8959316-el7.parcel

These along with their hash files need to be copied to parcels directory in Cloudera Migration Assistant root directory