Dedicating Cloudera Embedded Container Service nodes for Cloudera Data Engineering

Learn about how to dedicate Cloudera Embedded Container Service cluster nodes for Cloudera Data Engineering.

  1. Configure Cloudera Data Engineering infrastructure services and user workloads with appropriate tolerations and labels to allow scheduling only on nodes tainted for Cloudera Data Engineering. This leverages the platform's automatic tainting of nodes designated with the Dedicated CDE Node profile in the Cloudera Manager. For more information, see Dedicating Cloudera Embedded Container Service nodes for specific workloads.
  2. Open the terminal on your device and export the kubeconfig file by using the following command:
    export KUBECONFIG=[***path_of_the_Kubeconfig_file***]
  3. Cloudera Data Engineering introduces a configuration setting, stored in the cdp-release-dex-cp-server-cm ConfigMap within the <CDP-NAMESPACE>, to control the enforcement of node affinity. Set the nodeSelector.enabled parameter to true to trigger the Cloudera Data Engineering installer to update the future deployment specifications to include the required nodeSelector or nodeAffinity rules for the Cloudera Data Engineering label.
  4. Restart the dex-cp pod for the enforcement to take effect and ensure that all newly created or updated Cloudera Data Engineering installations automatically apply the affinity rules to support strict scheduling isolation.
    kubectl rollout restart deployment/cdp-release-dex-cp -n [***CDP-NAMESPACE***]