Cloudera Docs

Adding a Worker Host Using Cloudera Manager

Worker hosts are not required for a fully-functional Cloudera Data Science Workbench deployment. For proof-of-concept deployments, you can deploy a 1-host cluster with just a Master host. The Master host can run user workloads just as a worker host can.

To add a worker host using Cloudera Manager, complete the following steps:
  1. Log in to the Cloudera Manager Admin Console.
  2. Add a new host to your cluster.
    Make sure this is a gateway host and you are not running any services on this host.
  3. Assign the HDFS, YARN, and Spark 2 gateway roles to the new host. For instructions, refer the Cloudera Manager documentation at Adding a Role Instance.
  4. Go to the Cloudera Data Science Workbench service.
  5. Click the Instances tab.
  6. Click Add Role Instances.
  7. Assign the Worker and Docker Daemon roles to the new host. Click Continue.
  8. Review your changes and click Continue. The wizard finishes by performing any actions necessary to add the new role instances.
    Do not start the new roles at this point. You must run the Prepare Node command as described in the next steps before the roles are started.
  9. The new host must have the following packages installed on it. 
    nfs-utils
libseccomp
lvm2
bridge-utils
libtool-ltdl
iptables   
rsync 
policycoreutils-python 
selinux-policy-base 
selinux-policy-targeted 
ntp 
ebtables 
bind-utils 
nmap-ncat  
openssl 
e2fsprogs 
redhat-lsb-core 
conntrack-tools
socat
    You must either manually install these packages now, or, allow Cloudera Manager to install them in the next step.
    If you choose the latter, make sure that Cloudera Manager has the permission needed to install the required packages. To do so, go to the Cloudera Data Science Workbench service and click Configuration. Search for the Install Required Packages property and make sure it is enabled.
  10. Click Instances and select the new host. From the list of available actions, select the Prepare Node command to install the required packages on the new node.
  11. On the Instances page, select the new role instances and click Actions for Selected > Start.