Using DistCp to copy files

Hadoop DistCp (distributed copy) can be used to copy data between CDP clusters (and also within a CDP cluster).

DistCp uses MapReduce to implement its distribution, error handling, and reporting. It expands a list of files and directories into map tasks, each of which copies a partition of the files specified in the source list.