Resources created under the hood

Creating a Cloudera environment on Azure with a private Flexible Server setup created by Cloudera involves creating several Azure resources, all of which are necessary to have a private setup that works out-of-the-box.

This private setup ensures that communication between Cloudera and the Azure Postgres server happens via a private IP address. However, cluster services do need to contact the Postgres server via FQDN, so the address needs to be resolvable from the VNet.

Resources created when using a Cloudera-managed Private DNS Zone

In the scenario where Cloudera creates the private DNS, several resources are created:

  • A Private DNS Zone: It is a DNS zone, part of an Azure-hosted DNS server. It has a fixed name, privatelink.postgres.database.azure.com for Flexible Server with Private Link and flexible.postgres.database.azure.com for Flexible Server with delegated subnet. However, any DNS Zone name ending with postgres.database.azure.com is usable for Flexible Server with delegated subnet in the “Bring your own private DNS” setup.
  • A virtual network link between the zone and a VNet where the domain resolution should happen.
  • An A record within the zone: FQDN to IP address resolution. There is no reverse lookup.

When you delete the environment, the DNS zone and the network link that you provided will not be deleted.

Resources created when using your own private DNS zone

In this case the Private DNS Zone and the network link are provided by you and Cloudera creates the following:

  • Cloudera creates an A record within the zone: FQDN to IP address resolution. There is no reverse lookup.

When you delete the environment, the DNS zone and the network link that you provided will not be deleted.