Prerequisites for setting up Cloudera AI Inference service

Consider the following prerequisites before setting up Cloudera AI Inference service.

CDP CLI

You must dowload CDP CLI and install it on your machine to create a Cloudera AI Inference service instance. For information on how to download CDP CLI, in the CDP console, click on the left navigation Help > Download CLI. You must use CDP CLI version 0.9.123 or higher with Cloudera AI Inference service.

Compute cluster-enabled CDP environment

Cloudera AI Inference service requires a compute cluster-enabled CDP environment. You must either create the compute cluster-enabled environment, or convert your existing environment.

Data Lake and Cloudera Manager supported versions

JSON Web Token based authentication from Cloudera Machine Learning workspaces to Cloudera AI Inference requires Data Lake version 7.2.18 or above, and Cloudera Manager version 7.12 or above.

Cloudera Model Registry

A Cloudera Model Registry must first be deployed in the same CDP environment in which you plan to deploy Cloudera AI Inference service. That is, Cloudera AI Inference service can only deploy models registered to a Cloudera Model Registry in the same CDP environment. For this release, Cloudera Model Registry version CML2024.09-1 or higher version must be created before provisioning the Cloudera AI Inference service. If you have an existing Cloudera Model Registry in the environment, you must first upgrade it to version CML2024.09-1 before provisioning Cloudera AI Inference service.