Configuring a user to run YARN jobs on both the clusters
To run Hadoop DistCp jobs to migrate the data from HDP to CDP Private Cloud Base cluster, you must use HDFS superuser or hdfs user.
Ensure that you have one of the following user accounts before you run Hadoop DistCp
jobs:
- HDFS superuser - For information about creating a HDFS superuser, see Create the HDFS superuser.
- User named hdfs - By default, the hdfs user is not allowed to run YARN jobs. You must enable the hdfs user to run YARN jobs on both the clusters.
-
Perform the following steps on the HDP cluster:
-
On the CDP Private Cloud Base cluster, perform the following steps:
- Select the YARN service.
- Click the Configuration tab.
- Make sure that hdfs user is not listed in the banned.users list.
- Make sure that the min.user.id property is set to 0.
- Restart the YARN service.