Cloudera Docs

Upgrading Cloudera AI Inference service using the CLI

Upgrade the Cloudera AI Inference service using the CLI. Upgrading the Cloudera AI Inference service is available in Cloudera AI on premises 1.5.5 SP2 and higher releases.

You can upgrade an existing Cloudera AI Inference service instance when a higher supported version becomes available. Upgrading allows you to take advantage of new features, performance improvements, security updates, and supported component versions.

Upgrade your Cloudera AI Inference service in the following cases:
  • A higher version of Cloudera AI Inference service is released.
  • Security patches or critical bug fixes are available.
  • New features or enhancements are required.
  • Alignment with the latest supported Kubernetes, Istio, or serving components is needed.
Use the following command to upgrade the Cloudera AI Inference service:
cdp --no-verify-tls ml upgrade-ml-serving-app --cli-input-json '{
  "appCrn": "crn:cdp:ml:us-west-1:9e230228-5d32-4adf-936c-a713614d41ea:mlserving:5eaac17c-df0a-4aa8-bfd5-c07d6fdafc74"
}'

When the upgrade has started the Inference service status changes to upgrade:started.

Monitor the progress of the upgrade by performing the fllowing actions:
  • Viewing the status on the service listing page.
  • Reviewing Event Logs for detailed progress.
  • Checking the service details page.

Upgrade results

Successful upgrade
In case of successful upgrade the Inference service status changes to upgrade:finished and the service returns to the Ready state.
Failed upgrade
In case of a failed upgrade, the Inference service status changes to upgrade:failed.

Proceed with performing the following actions:

  • Review the Event Logs for failure details.
  • Resolve any reported issues.
  • Retry the upgrade if applicable.

Post-upgrade verification

After a successful upgrade, verify the following details:

Verify service health by performing the following actions:
  • Checking if the Inference service status is Ready with upgrade:finished.
  • Checking that all Cloudera AI Inference service pods are running and healthy.
Verify the version of the Cloudera AI Inference service by:
  • Confirming that the Cloudera AI Inference service version reflects the target version.
  • Reviewing version details on the service details page.