Supported Model Artifact Formats

Lists Cloudera AI Inference service supported models:

  • Text-generating and embedding Large Language Models (LLMs) packaged as NVIDIA NIM.
  • Predictive models in the ONNX representation, registered to Cloudera Model Registry from a Cloudera Machine Learning Workspace. See Register an ONNX model to Model Registry as an example showing how to convert a sklearn model to ONNX and then register it to the Cloudera Model Registry. Refer to Export a PyTorch model to ONNX or Getting Started Converting TensorFlow to ONNX documentation regarding how models using these frameworks can be converted to the ONNX representation.