The following table provides a summary of configuration, settings, and results when using DistCp to copy data from HDP1 and HDP2 clusters to HDP2 clusters.
From | To | Source Configuration | Destination Configuration | DistCp Should be Run on… | Result |
HDP 1.3 | HDP 2.x | insecure + hdfs | insecure + webhdfs | HDP 1.3 (source) | success |
HDP 1.3 | HDP 2.x | secure + hdfs | secure + webhdfs | HDP 1.3 (source) | success |
HDP 1.3 | HDP 2.x | secure + hftp | secure + hdfs | HDP 2.x (destination) | success |
HDP 2.0 | HDP 2.x | secure + hdfs | insecure + hdfs | secure HDP 2.0 (source) | success |
HDP 2.0 | HDP 2.x | secure + hdfs | secure + hdfs | either HDP 2.0 or HDP 2.x (source or destination) | success |
HDP 2.0 | HDP 2.x | secure + hdfs | secure + webhdfs | HDP 2.0 (source) | success |
HDP 2.0 | HDP 2.x | secure + hftp | secure + hdfs | HDP 2.x (destination) | success |
HDP 1.3 | HDP 2.1 | secure + hftp | secure + swebhdfs | HDP 2.1 (destination) | success |
Note | |
---|---|
For the above table:
|