Cloudera Docs

Dedicating Cloudera Embedded Container Service nodes for specific workloads

Use Cloudera Manager to bind Cloudera Embedded Container Service cluster nodes for specific workloads.

Dedicating Cloudera Embedded Container Service nodes when creating a new cluster

  1. Verify the ECS installation requirements.
  2. Add the new hosts to Cloudera Manager.
  3. In Cloudera Manager UI, select Hosts > Hosts Configuration.
  4. Use the search box to locate the node_taint configuration property and select Add Host Overrides.
  5. Apply the node_taint at the host override level, and not globally.
  6. Under the node_taint property on the Cloudera Embedded Container Service Host Configuration page:
    • Select Dedicated GPU Node to allocate the node for Cloudera AI when the host has NVIDIA GPU. Once selected, this host will be reserved for worloads that require GPU resources.
    • Select Dedicated NVMe Node to allocate the node for Cloudera Data Warehouse service when the host has NVMe for caching. Once selected, this host will be reserved only for the workloads that need NVMe resources.
    • Select Dedicated CDE Node for Cloudera Data Engineering services (available only if Cloudera Embedded Container Service version is 1.5.5 SP2 or higher). Once selected, the host is applicable only for the Cloudera Data Engineering services and workloads.
    • Select Dedicated CAI Infra for Cloudera AI infrastructure services (available only if Cloudera Embedded Container Service version is 1.5.5 SP2 or higher). Once selected, the host is applicable only for the Cloudera Embedded Container Service infrastructure services.
    • Select None if you do not want to make any selection. This is the default value.

    When either of these options are selected, no other workload pods will be allowed to run on the dedicated node.

  7. Click Save Changes.
  8. Run the following commands to map the respective profiles:
    1. To label the Dedicated NVMe Node for Cloudera Data Warehouse workloads:
      kubectl label node <node name> cdw.cloudera.com/dedicated-executor-host=<any value>
    2. To label the Dedicated CDE Node:
      kubectl label node <node name> cloudera.com/node-role=cde
    3. To label the Dedicated CAI Infra:
      kubectl label node <node name> cloudera.com/node-role=cai-infra
  9. Repeat the previous steps to add the other Cloudera Embedded Container Service hosts to Cloudera Manager and assign workload types.
  10. Follow the ECS installation procedure. The Specify Hosts page in the installation wizard displays the hosts you added to Cloudera Manager.
  11. Select the hosts, click Continue, and proceed through the rest of the installation wizard.
  12. After the installation is complete, the applicable workloads run on the specified dedicated nodes.

Dedicating Cloudera Embedded Container Service nodes in an existing cluster

  1. Open the Cloudera Manager Admin Console.
  2. On the Home page, click the ECS Cluster.
  3. Click Hosts, go to the ECS host to be tainted, then go to the Configuration tab.
  4. Click the Configuration tab, then use the Search box to locate the node_taint configuration property.

  5. Under the node_taint property on the Cloudera Embedded Container Service Host Configuration page, use the same information under step 6 as listed in the previous section.

  6. Click Save Changes.
  7. Run the following commands to map the respective profiles:
    1. To label the Dedicated NVMe Node for Cloudera Data Warehouse workloads:
      kubectl label node <node name> cdw.cloudera.com/dedicated-executor-host=<any value>
    2. To label the Dedicated CDE Node:
      kubectl label node <node name> cloudera.com/node-role=cde
    3. To label the Dedicated CAI Infra:
      kubectl label node <node name> cloudera.com/node-role=cai-infra
  8. Repeat the previous steps to assign workload types to the other ECS hosts.
  9. On the ECS Cluster landing page, click Actions > Refresh Cluster.
  10. After the Refresh is complete, click Actions > Rolling Restart.