Upgrading an Azure Kubernetes Service cluster for CDW

Azure Kubernetes Service (AKS) cluster requires regular updates to the Kubernetes versions. Using the latest AKS version supported by Cloudera avoids compatibility issues between Cloudera Data Warehouse (CDW) and Azure resources.

This release 1.4.3-b225 (released September 15, 2022) supports the Azure CLI to upgrade the AKS cluster to/from the following AKS versions only:

  • Upgrade to AKS 1.24
  • Upgrade from AKS 1.22 (running on 1.4.2 released August 1, 2022)

Upgrading from environments earlier than AKS 1.22 is not supported. Cloudera does not plan to support upgrading from environments earlier than 1.4.2.

Alternatively, in this release and the previous release 1.4.2-b116 (released August 1, 2022), through the environment activation from CDW process, you can automatically get and use AKS 1.24 in your CDP cluster.

The CDW application uses Kubernetes (K8S) clusters to deploy and manage Hive and Impala in the cloud. Kubernetes versions are updated every 3 months on average. When the version is updated, minor versions are deprecated.

  • Suspend the CDW Virtual Warehouses.
  • If there are more than three Database Catalogs (including custom and default Database Catalog) in an environment, suspend them before proceeding with the upgrade.

The reason behind suspending Virtual Warehouses and Database Catalogs is to reduce the upgrade time.

  1. Use the Azure CLI to upgrade the AKS cluster to 1.24 as described in the Azure Kubernetes Service documentation.
    Upgrading environments earlier than 1.4.2 is not supported.
  2. Restart the Virtual Warehouses and Database Catalogs after you have upgraded the cluster.