Upgrading an Azure Kubernetes Service cluster for CDW

Azure Kubernetes Service (AKS) cluster requires regular updates to the Kubernetes versions. It is important that you upgrade to the latest AKS version to avoid compatibility issues between Cloudera Data Warehouse (CDW) and Azure resources. You can use the Azure CLI to upgrade the AKS cluster.

The CDW application uses Kubernetes (K8S) clusters to deploy and manage Hive and Impala in the cloud. Kubernetes versions are updated every 3 months on average. When the version is updated, minor versions are deprecated.While upgrading the Kubernetes version for your AKS cluster, you cannot perform a skip-level upgrade. You must upgrade sequentially to every minor version that is available for the AKS cluster. For example, to upgrade from 1.18 to 1.20, you must first upgrade from 1.18 to 1.19 and then to 1.20.
  • Suspend the CDW Virtual Warehouses.
  • If there are more than three Database Catalogs (including custom and default Database Catalog) in an environment, suspend them before proceeding with the upgrade.

The reason behind suspending Virtual Warehouses and Database Catalogs is to reduce the upgrade time.

  1. Use the Azure CLI and upgrade the AKS cluster as described in the Azure Kubernetes Service documentation.
  2. Restart the Virtual Warehouses and Database Catalogs after you have upgraded the cluster.