Cloudera Docs

Upgrading Cloudera AI Registry

Cloudera AI Registry can be upgraded in place using Helm Upgrade on the existing release within the same namespace. This preserves all Kubernetes resources, including ClusterResourcePlacement (CRP), the namespace, Persistent Volume Claims (PVCs), StatefulSets, and Secrets, , consequently upgrading Cloudera AI Registry might take 40 to 60 minutes.

When you perform an upgrade, the existing instance is updated to a newer version rather than creating a new instance. If the upgrade is unsuccessful, you must retry the upgrade process.

The Cloudera AI Registry upgrade process involves provisioning a new cluster, so the process can take approximately 40 to 60 minutes. The upgrade operation should be performed during a maintenance window, when new models are not being added or updated in Cloudera AI. The maintenance window should be at least 3 hours long.

Prerequisites

The Cloudera AI Registry must be in Ready or Failed state to enable upgrade. When the Cloudera AI Registry upgrade is already in progress, it is not possible to start a new upgrade.

  1. In the Cloudera console, click the Cloudera AI tile.

    The Cloudera AI Home page is displayed.

  2. Click AI Registries under ADMINISTRATION on the left navigation menu.

    The AI Registries page is displayed.

  3. Choose the Cloudera AI Registry you want to upgrade.
  4. From the Actions menu, choose Upgrade.
  5. Click OK.

Result:

When the upgrade completes, the Cloudera AI Registry shows either Ready or Failed status.

  • If the upgrade succeeds, the Cloudera AI Registry appears in Ready status. It has the same name and namespace, but a higher version of the Cloudera AI Registry.
  • If the upgrade was not successful, the Cloudera AI Registry is in Failed status, and the version has not been upgraded. In this case, the Cloudera AI Registry is again available for upgrade.

To determine why the upgrade failed, review the event logs on the Event Logs tab of the Details page of the Cloudera AI Registry.

Verification:

  1. Open a workbench and confirm that all of the models are available.
  2. Check the event logs to see if any errors occurred during the upgrade. The event logs can also be used in real time to confirm that the process is running.
  1. In the Cloudera console, click the Cloudera AI tile.

    The Cloudera AI Home page is displayed.

  2. Click AI Registries under ADMINISTRATION on the left navigation menu.

    The AI Registries page is displayed.

  3. Choose the Cloudera AI Registry you want to upgrade.
  4. Copy the CRN from the AI Registry details.
  5. In the CDP CLI, enter the following command: 
    cdp ml upgrade-model-registry --crn <crn>
    In the AI Registries UI, the Status of the AI Registry changes to Backup Initiated. The process starts provisioning a new registry (Status: Creating) and then performs a backup operation to restore the state.
  6. When the new registry shows Ready, in Actions, click Synchronize.
  7. Check the contents of the new registry to verify that all of the models have transferred.
  8. After verifying the contents of the new registry, you can delete the old registry (check the Created at timestamp) in the Actions menu.

Verification:

  1. Open a workbench and confirm that all of the models are available.
  2. Check the event logs to see if any errors occurred during the upgrade. The event logs can also be used in real time to confirm that the process is running. If you need to create an escalation ticket, make sure to include the logs.