Running DistCp job on the Cloudera Private Cloud Base cluster

After you make the required configuration changes in the HDP cluster and Cloudera Private Cloud Base cluster and configure a user to run the YARN jobs on both the clusters, you can run the Hadoop DistCp job.

  1. Restart the cluster services on both the clusters.
  2. Run the following Hadoop DistCp command:
    sudo -u [***SUPERUSER OR HDFS***] hadoop distcp [***SOURCE CLUSTER***] [***DESTINATION CLUSTER***]

    For example, sudo -u [***SUPERUSER***] hadoop distcp hdfs://nn1:8020/source hdfs://nn2:8020/destination