Replicating from unsecure to secure clusters
You can use Replication Manager to replicate data from an unsecure cluster, one that does not use Kerberos authentication, to a secure cluster, a cluster that uses Kerberos. Note that the reverse is not true.
To enable replication from an unsecure cluster to a secure cluster, you need a user that exists on all the hosts on both the source cluster and destination cluster. Specify this user in the Run As Username field when you create a replication schedule.
On a host in the source or destination cluster, add a user with the following
sudo -u hdfs hdfs dfs -mkdir -p /user/<username>For example, the following command creates a user named milton:
sudo -u hdfs hdfs dfs -mkdir -p /user/milton
Set the permissions for the user directory with the following command:
sudo -u hdfs hdfs dfs -chown <username> /user/usernameFor example, the following command makes milton the owner of the milton directory:
sudo -u hdfs hdfs dfs -chown milton /user/milton
Create the supergroup group for the user you created in step 1 with the following
Add the user you created in step 1 to the group you created:
usermod -G supergroup <username>For example, add milton to the group named supergroup:
usermod -G supergroup milton
- Repeat this process for all hosts in the source and destination clusters so that the user and group exists on all of them.