Metadata for custom ML Runtimes

This topic addresses the metadata for custom ML Runtimes.

All new custom ML Runtimes must override the Edition metadata of existing ML Runtimes. The rest of the metadata can be overridden to communicate the expectations for the users of the image. Both the Docker label and the environment variable match in a custom ML Runtimes image. In order to add or register a custom ML Runtimes to a deployment, the user facing metadata combination must be unique in that deployment. For example, among Editor, Edition, Kernel, Version, and Maintenance Version, at least the Maintenance Version must be incremented when publising a new iteration of the same image.

See the following reference table for more details on ML Runtime metadata.

Environment variable Docker Label Description Override in custom non-PBJ ML Runtimes Value in PBJ ML Runtimes
ML_RUNTIME_METADATA_VERSION com.cloudera.ml.runtime.runtime-metadata-version Metadata version Not allowed

Must be set to:

2 for Ubuntu-based ML Runtimes

3 for Chainguard-based ML Runtimes.

ML_RUNTIME_EDITOR com.cloudera.ml.runtime.editor Cloudera AI Editor installed in the image. Allowed Required
ML_RUNTIME_EDITION com.cloudera.ml.runtime.edition Edition of the image, a notion of the ML Runtimes capabilities. Required Required
ML_RUNTIME_DESCRIPTION com.cloudera.ml.runtime.description Longer description of the ML Runtimes image capabilities. Recommended Required
ML_RUNTIME_KERNEL com.cloudera.ml.runtime.kernel Main kernel included in the image, for example, Python 3.8. Not allowed Required
ML_RUNTIME_SHORT_VERSION com.cloudera.ml.runtime.short-version Main version of the image, for example, 1.0. This shows up as Version in the selection screen. Recommended Required
ML_RUNTIME_FULL_VERSION com.cloudera.ml.runtime.full-version The complete version consists of the short version and the maintenance version, for example, 1.0.1 Optional Optional
ML_RUNTIME_MAINTENANCE_VERSION com.cloudera.ml.runtime.maintenance-version The maintenance version must be an integer, for example, 1. Only the largest maintenance version of the set of the same short version images are visible for users to select. Increment this number if you create a drop in replacement of an existing ML Runtimes. Start with 1 with a new version or edition. Recommended Required
ML_RUNTIME_CUDA_VERSION com.cloudera.ml.runtime.cuda-version CUDA version installed in the image. Not allowed Do not set
ML_RUNTIME_GIT_HASH com.cloudera.ml.runtime.git-hash Git hash of ML Runtimes source Not allowed Do not set
ML_RUNTIME_GBN com.cloudera.ml.runtime.gbn Cloudera internal build number Not allowed Do not set