Cloudera Docs

Running DistCp job on the Cloudera Base on premises cluster

After you make the required configuration changes in the HDP cluster and Cloudera Base on premises cluster and configure a user to run the YARN jobs on both the clusters, you can run the Hadoop DistCp job.

  1. Restart the cluster services on both the clusters.
  2. Run the following Hadoop DistCp command:
    sudo -u [***SUPERUSER OR HDFS***] hadoop distcp [***SOURCE CLUSTER***] [***DESTINATION CLUSTER***]

    For example, sudo -u [***SUPERUSER***] hadoop distcp hdfs://nn1:8020/source hdfs://nn2:8020/destination