Adding a Worker Host Using Cloudera Manager
Worker hosts are not required for a fully-functional Cloudera Data Science Workbench deployment. For proof-of-concept deployments, you can deploy a 1-host cluster with just a Master host. The Master host can run user workloads just as a worker host can.
- Log in to the Cloudera Manager Admin Console.
Add a new host to your cluster.
Make sure this is a gateway host and you are not running any services on this host.
Assign the HDFS, YARN, and Spark 2 gateway roles to the new host. For instructions,
refer the Cloudera Manager documentation at Adding a Role Instance.
- Go to the Cloudera Data Science Workbench service.
- Click the Instances tab.
- Click Add Role Instances.
- Assign the Worker and Docker Daemon roles to the new host. Click Continue.
Review your changes and click Continue. The wizard finishes
by performing any actions necessary to add the new role instances.
Do not start the new roles at this point. You must run the Prepare Node command as described in the next steps before the roles are started.
The new host must have the following packages installed on it.
nfs-utils libseccomp lvm2 bridge-utils libtool-ltdl iptables rsync policycoreutils-python selinux-policy-base selinux-policy-targeted ntp ebtables bind-utils openssl e2fsprogs redhat-lsb-core conntrack-tools bash curlYou must either manually install these packages now, or, allow Cloudera Manager to install them in the next step.If you choose the latter, make sure that Cloudera Manager has the permission needed to install the required packages. To do so, go to the Cloudera Data Science Workbench service and click Configuration. Search for the Install Required Packages property and make sure it is enabled.
- Click Instances and select the new host. From the list of available actions, select the Prepare Node command to install the required packages on the new node.
On the Instances page, select the new role instances and