Migrating Azure Load Balancers and Public IP

Microsoft is planning to transition from Basic SKU to Standard SKU for Basic Load Balancers and Public IPs. Cloudera recommends to migrate to Standard SKUs as soon as possible.

As of today, the default SKU for "Microsoft.Network/publicIPAddresses" and “Microsoft.Network/loadBalancers” is Basic SKU, which takes effect when the SKU is not specified explicitly in the ARM template.

the following customer resources are currently created with Basic Public IP:

Non-multi-AZ FreeIPA instances with Public IP
Non-multi-AZ Data Lake and Cloudera Data Hub instances with Public IP, where Load Balancing is not explicitly defined as Standard SKU
Non-multi-AZ Basic SKU Load Balancers

Microsoft is planning to phase out the Basic SKU for both resources, according to the following timeline:

March 31, 2025 - Last day to create new Basic Load Balancer and Public IP.
- After this date, you will not be able to create new Basic Load Balancers and Public IPs. Those created before this date will continue to work.
- The default SKU is transitioned to Standard SKU for any new Cloudera environments on Azure.
  The Standard SKU supports enhanced functionalities such as availability zones and a better security model.
- Cloudera Data Hub and Data Lake creation requests explicitly specifying Basic SKU Load Balancer will be rejected.
September 30, 2025 - Retirement Day of Basic Load Balancer and Public IP.
- After this date, you will not be able to use Basic Load Balancers and Public IPs.
- Clusters that have Basic SKU Public IP can become unreachable.
- Knox and Oozie on clusters that have basic SKU Load Balancer can become unreachable.

Cloudera recommends to upgrade to Standard SKUs as soon as possible.

In the affected clusters, you will see a notification in Cloudera Management Console asking you to perform a migration to Standard SKU. To migrate from Basic SKU to Standard, you have the following options:

Automatic migration flow: You can complete the migration by performing an upgrade, repair, or upscale operation on your clusters with Basic SKU Load Balancers and Public IPs. During the upgrade, repair, or upscale operation, the Basic SKU Load Balancers and Public IPs will be migrated automatically to Standard SKU.
note
While the operations are in progress, the cluster can be unreachable for a couple of minutes and client connections might need to be re-initiated.
On-demand one-click migration flow: You can complete the migration by navigating either to the Environments, Data Lakes or Data Hubs page in Cloudera Management Console, and select where you see the warning message for the migration. Select Migrate to Standard SKU, and confirm the operation to start the migration.