Transitioning the cluster
Transition the HDP cluster managed by Ambari to CDP Private Cloud Base cluster managed by Cloudera Manager using the AM2CM tool.
Take a copy of your blueprint before transitioning your
cluster. It helps you to understand the changes and differences between HDP 2.6.5 versus
HDP 7.1.x versus Cloudera Manager. Use this to take the blueprint:
http://<ambari_ip>:<port>/api/v1/clusters/<cluster-name>?format=blueprint
.
You cannot take the blueprint after transitioning the cluster.
- Login to Ambari server.
-
In the new tab, enter the URL:
http://<ambari_ip>:<port>/api/v1/clusters/<cluster-name>?format=blueprint_with_hosts
- Download the Ambari blueprint and save it in JSON format.
-
Download the AM2CM tool from:
https://archive.cloudera.com/am2cm/1.x/am2cm-1.1.0.0-103.tar.gz
To find all the download links in a centralised location, see Software download matrix
-
Extract the am2cm-1.0.0.0-xx.tar file to
am2cm-1.0.0.0-xx
folder. -
Set the
JAVA_HOME
variable. For example,$ export JAVA_HOME= [path to your installed JDK]
-
Navigate to the
am2cm-1.0.0.0-xx/conf/
user-settings.ini
file and update Parcels, Cluster name, passwords, and JDBC URL information.# Cluster details cluster.name=<Cluster-Name> cluster.displayname=<Cluster-Name> cluster.fullversion=7.1.1 # Hive JDBC settings SERVICE_HIVE_hive_metastore_database_password=<DB-Password> SERVICE_HIVE_hive_jdbc_url_override=<JDBC_URL> # Oozie JDBC settings SERVICE_OOZIE_oozie_database_password=<DB-Password> SERVICE_OOZIE_oozie_service_JPAService_jdbc_url=<JDBC_URL> # Ranger JDBC settings SERVICE_RANGER_ranger_database_password=<Ranger-DB-Password> SERVICE_RANGER_rangeradmin_user_password=<Rangeradmin-user-Password> SERVICE_RANGER_rangerusersync_user_password=<Rangerusersync-user-Password> SERVICE_RANGER_rangertagsync_user_password=<Rangertagsync-user-Password> SERVICE_RANGER_rangerkeyadmin_user_password=<Rangerkeyadmin-user-Password> SERVICE_RANGER_KMS_ranger_kms_master_key_password=<Rangerksmmaster-key-Password> SERVICE_RANGER_KMS_ranger_kms_database_password=<Rangerkms-database-Password> #Knox Settings SERVICE_KNOX_gateway_master_secret=admin
-
Generate the Cloudera Manager Deployment template.
# cd am2cm-1.0.0.0-xx #chmod +x ./am2cm.sh # ./am2cm.sh -bp PATH/TO/Amb_blueprint.json -dt /PATH/TO/cm_deployment_template.json
-
Check for errors in the console or in the
am2cm-1.0.0.0-xx/cm_migration.log logs. For example,
sh am2cm.sh
. -
LZO package configuration: If HDP is configured with LZO packages then follow
below steps.
- Go to the Parcels/Parcel Repository & Network Settings page on Cloudera Manager user interface and add Remote Parcel Repository URLs.URL
- In Parcels screen - Download, Distribute and Activate “GPLEXTRAS” If the HDP intermediate bits or Ambari 7.1.x.x has LZO packages used, then enable or add the packages to Cloudera Manager. For more information, see Configuring Data Compression documentation.
- Stop HDP services from Ambari.
-
Import the template using the API through browser or CLI.
- Using browser:
- Copy the URL in the browser and enter.
http://<CM_HOST>:7180/static/apidocs/ui/index.html#!/ClouderaManagerResource/updateDeployment2
- Navigate to Cloudera ManagerResource
- Copy the template in body.
- Click Tryit out!
- Copy the URL in the browser and enter.
- Using
CLI:
curl --user admin:admin -k -X PUT -H "Content-Type: application/json" -d @cm_deployment_template.json 'http://<CM_HOST>:7180/api/v41/cm/deployment?deleteCurrentDeployment=false'
- Using browser:
-
In Cloudera Manager Parcel screen, download Cloudera
Runtime and distribute the parcel. Cloudera Manager deploys the parcel to the
cluster hosts. The default is 10 concurrent hosts. You can adjust this to a
maximum of 50, but must be configured before the template is applied.
- After the parcels are deployed on Cloudera Manager, activate the Cloudera Runtime 7.1.x parcels.