Homepage
/
Cloudera AI
1.5.1
(Private Cloud)
Search Documentation
▶︎
Cloudera
Reference Architectures
▶︎
Cloudera Public Cloud
Getting Started
Patterns
Preview Features
Data Catalog
Data Engineering
DataFlow
Data Hub
Data Warehouse
Data Warehouse Runtime
Cloudera AI
Management Console
Operational Database
Replication Manager
DataFlow for Data Hub
Runtime
▼
Cloudera Private Cloud
Data Services
Getting Started
Cloudera Manager
Management Console
Replication Manager
Data Engineering
Data Warehouse
CDW Runtime
Machine Learning
Base
Getting Started
Runtime & Cloudera Manager
Upgrade
Storage
Flow Management
Streaming Analytics
▶︎
Cloudera Manager
Cloudera Manager
▶︎
Applications
Cloudera Streaming Community Edition
Data Science Workbench
Data Visualization
Edge Management
Observability SaaS
Observability on premises
Workload XM On-Prem
▶︎
Legacy
Cloudera Enterprise
Flow Management
Stream Processing
HDP
HDF
Streams Messaging Manager
Streams Replication Manager
▶︎
Data Services
Getting Started
Cloudera Manager
Management Console
Replication Manager
Data Engineering
Data Warehouse
CDW Runtime
Machine Learning
Base
Getting Started
Runtime & Cloudera Manager
Upgrade
Storage
Flow Management
Streaming Analytics
«
Filter topics
▶︎
All roles
▶︎
Top Tasks
Creating a Project with Legacy Engine Variants
Analytical Applications
Creating and Deploying a Model
▶︎
Release Notes
What's New
Known Issues
▶︎
ML Runtimes Release Notes
▶︎
ML Runtimes What's New
ML Runtimes Version 2022.11.2
ML Runtimes Version 2022.11
ML Runtimes Version 2022.04
ML Runtimes Version 2021.12
ML Runtimes Version 2021.09.02
ML Runtimes Version 2021.09
ML Runtimes Version 2021.06
ML Runtimes Version 2021.04
ML Runtimes Version 2021.02
ML Runtimes Version 2020.11
ML Runtimes Known Issues and Limitations
▶︎
ML Runtimes Pre-installed Packages
▶︎
Pre-Installed Packages in ML Runtimes
▶︎
ML Runtimes 2022.11
Python 3.9 Libraries for Workbench
Python 3.8 Libraries for Workbench
Python 3.7 Libraries for Workbench
Scala 2.11 Libraries for Workbench
Python 3.9.6 Libraries for JupyterLab
Python 3.8 Libraries for JupyterLab
Python 3.7 Libraries for JupyterLab
R 4.1 Libraries
R 4.0 Libraries
R 3.6 Libraries
Python 3.9 Libraries for PBJ Workbench
Python 3.8 Libraries for PBJ Workbench
Python 3.7 Libraries for PBJ Workbench
PBJ R 4.1 Libraries
PBJ R 4.0 Libraries
PBJ R 3.6 Libraries
▶︎
ML Runtimes 2022.04
Python 3.9 Libraries for Workbench
Python 3.8 Libraries for Workbench
Python 3.7 Libraries for Workbench
Scala 2.11 Libraries for Workbench
Python 3.9.6 Libraries for JupyterLab
Python 3.8 Libraries for JupyterLab
Python 3.7 Libraries for JupyterLab
R 4.0 Libraries
R 4.1 Libraries
R 3.6 Libraries
▶︎
ML Runtimes 2021.12
Python 3.9 Libraries for Workbench
Python 3.8 Libraries for Workbench
Python 3.7 Libraries for Workbench
Scala 2.11 Libraries for Workbench
Python 3.9.6 Libraries for JupyterLab
Python 3.8 Libraries for JupyterLab
Python 3.7 Libraries for JupyterLab
R 4.0 Libraries
R 4.1 Libraries
R 3.6 Libraries
ML Runtimes 2020.11
▶︎
About CML
Cloudera Machine Learning Overview
▶︎
Requirements
Introduction to Private Cloud
Cloudera Machine Learning requirements (OCP)
Cloudera Machine Learning requirements (ECS)
Get started with CML on Private Cloud
Test your connectivity to the CDP-DC cluster
Differences Between Public and Private Cloud
Limitations on Private Cloud
▶︎
Network File System (NFS)
NFS Options for Private Cloud
Internal Network File System on OCP
Internal Network File System on ECS
Using an External NFS Server
Deploy an ML Workspace with Support for TLS
Replace a Certificate
Deploy an ML Workspace with Support for TLS on ECS
GPU node setup
▼
Data Scientist
▶︎
Starting a Project
▶︎
Collaboration models
Collaboration Models
Sharing Job and Session Console Outputs
▶︎
User Roles and Team Accounts
User Roles
Business Users and CML
Managing your Personal Account
Creating a Team
Managing a Team Account
▶︎
Managing Projects
▶︎
Managing Projects
Creating a Project with Legacy Engine Variants
Creating a project from a password-protected Git repo
Configuring Project-level Runtimes
Adding Project Collaborators
Modifying Project Settings
Managing Project Files
Custom Template Projects
Deleting a Project
▶︎
Native Workbench Console and Editor
Launch a Session
Run Code
Access the Terminal
Stop a Session
Workbench editor file types
Environmental Variables
▶︎
Third-Party Editors
Modes of Configuration
▶︎
Configure a Browser IDE as an Editor
Testing a Browser IDE in a Session
Configure a Browser IDE at the Project Level
Legacy Engine Level Configuration
Configure a Local IDE using an SSH Gateway
▶︎
Configure PyCharm as a Local IDE
Add Cloudera Machine Learning as an Interpreter for PyCharm
Configure PyCharm to use Cloudera Machine Learning as the Remote Console
(Optional) Configure the Sync Between Cloudera Machine Learning and PyCharm
▶︎
Configure VS Code as a Local IDE
Download cdswctl and Add an SSH Key
Initialize an SSH Connection to Cloudera Machine Learning for VS Code
Setting up VS Code
(Optional) Using VS Code with Python
(Optional) Using VS Code with R
(Optional) Using VS Code with Jupyter
(Optional) Using VS Code with Git integration
Limiting files in Explorer view
▶︎
Git for Collaboration
Linking an Existing Project to a Git Remote
▶︎
Embedded Web Applications
Example: A Shiny Application
▶︎
Applied ML Prototypes (AMP)
Applied ML Prototypes (AMPs)
Creating New AMPs
Custom AMP Catalog
Add a catalog
Catalog File Specification
AMP Project Specification
Host names required by AMPs
▶︎
Discovering and Exploring Data
▶︎
Data Access
Data Access
Upload and work with local files
Create an Iceberg data connection
Create an Ozone data connection
▶︎
Connect to CDW
▶︎
Accessing data with Spark
Use JDBC Connection with PySpark
Connect to external Amazon S3 buckets
Connect to External SQL Databases
▶︎
Accessing Ozone
Accessing Ozone from Spark
Accessing local files in Ozone
▶︎
Visualizations
▶︎
Built-in CML Visualizations
Simple Plots
Saved Images
HTML Visualizations
IFrame Visualizations
Grid Displays
Documenting Your Analysis
Cloudera Data Visualization for ML
▶︎
Editors
▶︎
Built-in CML Visualizations
Simple Plots
Saved Images
HTML Visualizations
IFrame Visualizations
Grid Displays
Documenting Your Analysis
Cloudera Data Visualization for ML
▶︎
Developing for Data Science and ML
▶︎
Runtimes
▶︎
Managing ML Runtimes
ML Runtimes versus Legacy Engine
Using Runtime Catalog
Disabling Runtimes
▶︎
PBJ Workbench
Dockerfile compatible with PBJ Workbench
PBJ Runtimes and Models
Example models with PBJ Runtimes
▶︎
Using ML Runtimes Addons
Adding Hadoop CLI to ML Runtime Sessions
Adding Spark to ML Runtime Sessions
Turning off ML Runtimes Addons
▶︎
ML Runtimes NVIDIA GPU Edition
Testing ML Runtime GPU Setup
ML Runtimes NVIDIA RAPIDS Edition
▶︎
Using Editors for ML Runtimes
▶︎
Using JupyterLab with ML Runtimes
Installing a Jupyter extension
Installing a Jupyter kernel
Using Conda Runtime
Installing Additional ML Runtimes Packages
Restrictions for upgrading R and Python packages
Custom Runtime Addons with CML
▶︎
ML Runtimes Environment Variables
ML Runtimes Environment Variables List
Accessing Environmental Variables from Projects
▶︎
Customized Runtimes
▶︎
Creating Customized ML Runtimes
Create a Dockerfile for the Custom Runtime Image
Metadata for Custom ML Runtimes
Editor Customization
Build the New Docker Image
Distribute the Image
Add Docker registry credentials and certificates
Adding New ML Runtimes
Limitations
▶︎
Pre-Installed Packages in ML Runtimes
▶︎
ML Runtimes 2022.11
Python 3.9 Libraries for Workbench
Python 3.8 Libraries for Workbench
Python 3.7 Libraries for Workbench
Scala 2.11 Libraries for Workbench
Python 3.9.6 Libraries for JupyterLab
Python 3.8 Libraries for JupyterLab
Python 3.7 Libraries for JupyterLab
R 4.1 Libraries
R 4.0 Libraries
R 3.6 Libraries
▶︎
ML Runtimes 2022.04
Python 3.9 Libraries for Workbench
Python 3.8 Libraries for Workbench
Python 3.7 Libraries for Workbench
Scala 2.11 Libraries for Workbench
Python 3.9.6 Libraries for JupyterLab
Python 3.8 Libraries for JupyterLab
Python 3.7 Libraries for JupyterLab
R 4.0 Libraries
R 4.1 Libraries
R 3.6 Libraries
▶︎
ML Runtimes 2021.12
Python 3.9 Libraries for Workbench
Python 3.8 Libraries for Workbench
Python 3.7 Libraries for Workbench
Scala 2.11 Libraries for Workbench
Python 3.9.6 Libraries for JupyterLab
Python 3.8 Libraries for JupyterLab
Python 3.7 Libraries for JupyterLab
R 4.0 Libraries
R 4.1 Libraries
R 3.6 Libraries
▶︎
ML Runtimes 2021.09
Python 3.9 Libraries for Workbench
Python 3.8 Libraries for Workbench
Python 3.7 Libraries for Workbench
Python 3.6 Libraries for Workbench
Scala 2.11 Libraries for Workbench
Python 3.9.6 Libraries for JupyterLab
Python 3.8 Libraries for JupyterLab
Python 3.7 Libraries for JupyterLab
Python 3.6 Libraries for JupyterLab
R 4.0 Libraries
R 3.6 Libraries
▶︎
ML Runtimes 2021.06
Python 3.8.6 Libraries for Workbench
Python 3.7.9 Libraries for Workbench
Python 3.6.12 Libraries for Workbench
Python 3.8.6 Libraries for JupyterLab
Python 3.7.9 Libraries for JupyterLab
Python 3.6.12 Libraries for JupyterLab
R 4.0 Libraries
R 3.6 Libraries
▶︎
ML Runtimes 2021.04
RAPIDS Runtime PIP Python 3.7.8 Libraries for Workbench
RAPIDS Runtime PIP Python 3.8.6 Libraries for Workbench
RAPIDS Runtime PIP Python 3.7.8 Libraries for JupyterLab
RAPIDS Runtime PIP Python 3.8.6 Libraries for JupyterLab
▶︎
ML Runtimes 2021.02
Python 3.8 Libraries for Workbench
Python 3.7 Libraries for Workbench
Python 3.6 Libraries for Workbench
Python 3.8 Libraries for JupyterLab
Python 3.7 Libraries for JupyterLab
Python 3.6 Libraries for JupyterLab
R 4.0 Libraries
R 3.6 Libraries
ML Runtimes 2020.11
▶︎
Legacy Engines
Basic Concepts and Terminology
ML Runtimes versus Legacy Engine
Engine Dependencies
▶︎
Engines for Experiments & Models
Snapshot Code
Build Image
Run Experiment / Deploy Model
Environmental Variables
▶︎
Managing Engines
Creating Resource Profiles
Configuring the Engine Environment
Set up a custom repository location
▶︎
Installing Additional Packages
Using Conda to Manage Dependencies
▶︎
Engine Environment Variables
Engine Environment Variables
Accessing Environmental Variables from Projects
▶︎
Customized Engine Images
▶︎
Creating a Customized Engine Image
Create a Dockerfile for the Custom Image
Build the New Docker Image
Distribute the Image
Including Images in allowlist for Cloudera Machine Learning projects
Add Docker registry credentials
Limitations
End-to-End Example: MeCab
▶︎
Pre-Installed Packages in Engines
Base Engine 15-cml-2021.09-1
Base Engine 14-cml-2021.05-1
Base Engine 13-cml-2020.08-1
Base Engine 12-cml-2020.06-2
Base Engine 11-cml1.4
Base Engine 10-cml1.3
Base Engine 9-cml1.2
▶︎
GPUs
Using GPUs for Cloudera Machine Learning projects
Testing GPU Setup
▶︎
Distributed Computing
▶︎
Distributed Computing with Workers
Workers API
Worker Network Communication
▶︎
Spark
Spark on CML
Apache Spark supported versions
Spark Configuration Files
Managing Memory Available for Spark Drivers
Managing Dependencies for Spark 2 Jobs
Spark Log4j Configuration
Setting Up an HTTP Proxy for Spark 2
Spark Web UIs
▶︎
Using Spark 2 from Python
Example: Montecarlo Estimation
Example: Locating and Adding JARs to Spark 2 Configuration
Using Spark 2 from R
▶︎
Using Spark 2 from Scala
Managing Dependencies for Spark 2 and Scala
Running Spark with Yarn on the CDP base cluster
▶︎
Experiments
Experiments with MLflow
CML Experiment Tracking through MLflow API
Running an Experiment using MLflow
Visualizing Experiment Results
Using an MLflow Model Artifact in a Model REST API
Deploying an MLflow model as a CML Model REST API
Automatic Logging
Setting Permissions for an Experiment
Known issues and limitations
▶︎
Running an Experiment (Legacy)
Limitations
Tracking Metrics
Saving Files
Debugging Issues with Experiments
▼
Packaging and Deployment
▼
Models
Machine Learning Project Lifecycle
▶︎
Experiments
Experiments - Concepts and Terminology
▶︎
Models
Models - Concepts and Terminology
▶︎
Challenges with Machine Learning in production
Challenges with model deployment and serving
Challenges with model monitoring
▶︎
Challenges with model governance
Model visibility
Model explainability, interpretability, and reproducibility
Model governance using Apache Atlas
▶︎
Using Model Registry
▶︎
Setting up Model Registry
Creating a Model Registry
Viewing Details for Model Registry
Deleting Model Registry
▶︎
Registering and deploying a Model Registry
Creating a model using MLflow
Registering a model using the Model Registry user interface
Registering a model using MLflow SDK
Creating a new version of a Model Registry
Deploying a model from the Model Registry page
Deploying a model from the destination Project page
Viewing Details for Model Registry
Disabling Model Registry
Creating and Deploying a Model
Usage Guidelines
Known Issues and Limitations
Request/Response Formats (JSON)
Testing Calls to a Model
▼
Securing Models
Access Keys for Models
▶︎
API Key for Models
Enabling authentication
Generating an API key
Managing API Keys
Active Model Workflows
Technical Metrics for Models
Debugging Issues with Models
Deleting a Model
▶︎
Example - Model Training and Deployment (Iris)
Train the Model
Deploy the Model
▶︎
Serving ML Models
▶︎
Securing Models
▶︎
Securing Models
Access Keys for Models
▶︎
API Key for Models
Enabling authentication
Generating an API key
Managing API Keys
▶︎
Performing ML Operations
▶︎
Model Governance
Enabling model governance
ML Governance Requirements
Registering training data lineage using a linking file
Viewing lineage for a model deployment in Atlas
▶︎
Model Metrics
Enabling model metrics
Tracking model metrics without deploying a model
Tracking metrics for deployed models
▶︎
Deploying Applications
▶︎
Applications
Analytical Applications
Securing Applications
Limitations
Monitoring applications
▶︎
Jobs and Pipelines
Creating a Job
Creating a Pipeline
Viewing Job History
Jobs API
▶︎
Reference
▶︎
API
CML API v2
API v2 Usage
REST API v2 Reference
▶︎
CLI
Command Line Tools in CML
▶︎
cdswctl - CLI Client
Download and Configure cdswctl
Initialize an SSH Endpoint
Log into cdswctl
Prepare to manage models using the model CLI
Create a model using the CLI
Build and deployment commands for models
Deploy a new model with updated resources
View replica logs for a model
cdswctl command reference
▶︎
Jupyter Magics
▶︎
Jupyter Magic Commands
Python
Scala
▶︎
Troubleshooting
▶︎
Troubleshooting Issues with Workloads
Kerberos Errors
▶︎
Administrator
▶︎
Managing your CML Workspace service
▶︎
ML Workspaces
Provision an ML Workspace
Monitoring ML Workspaces
Removing ML Workspaces
▶︎
How to upgrade CML workspaces
Upgrading CML workspaces version 1.4.1 to 1.5.0 on ECS
Upgrading CML workspaces version 1.4.1 to 1.5.0 on OCP
▶︎
Backing up ML workspaces
Workspace Backup and Restore Prerequisites
Back up an ML workspace
Restore an ML workspace
▶︎
Site Administration
Managing Users
Configuring Quotas
Creating Resource Profiles
Disable or Deprecate Runtime Addons
Onboarding Business Users
Adding a Collaborator
▶︎
Monitoring User Activity
Tracked User Events
Monitoring User Events
Monitoring Active Models
Monitoring and Alerts
Application Polling Endpoint
Choosing Default Engine
Controlling User Access to Features
Configuring Email with SMTP
Web session timeouts
Project Garbage Collection
How to make base cluster configuration changes
Ephemeral storage
Installing a non-transparent proxy in a CML environment
Export Usage List
Disable Addons
▶︎
Security
▶︎
Configuring External Authentication with LDAP and SAML
▶︎
Configuring SAML Authentication
Configuration Options
▶︎
Configuring HTTP Headers for Cloudera Machine Learning
Enable HTTP Security Headers
Enable HTTP Strict Transport Security (HSTS)
Enable Cross-Origin Resource Sharing (CORS)
▶︎
SSH Keys
Personal Key
Team Key
Adding an SSH Key to GitHub
Creating an SSH Tunnel
Autoscaling Workloads with Kubernetes
Restricting User-Controlled Kubernetes Pods
Hadoop Authentication for ML Workspaces
CML and outbound network access
▶︎
Supporting your CML service
▶︎
Troubleshooting
Recommended Troubleshooting Workflow
Downloading diagnostic bundles for a workspace
(Optional) Configure the Sync Between Cloudera Machine Learning and PyCharm
(Optional) Using VS Code with Git integration
(Optional) Using VS Code with Jupyter
(Optional) Using VS Code with Python
(Optional) Using VS Code with R
About CML
Access Keys for Models
Access Keys for Models
Access the Terminal
Accessing data with Spark
Accessing Environmental Variables from Projects
Accessing Environmental Variables from Projects
Accessing local files in Ozone
Accessing Ozone
Accessing Ozone from Spark
Active Model Workflows
Add a catalog
Add Cloudera Machine Learning as an Interpreter for PyCharm
Add Docker registry credentials
Add Docker registry credentials and certificates
Adding a Collaborator
Adding an SSH Key to GitHub
Adding Hadoop CLI to ML Runtime Sessions
Adding New ML Runtimes
Adding Project Collaborators
Adding Spark to ML Runtime Sessions
Administrator
All roles
AMP Project Specification
Analytical Applications
Analytical Applications
Apache Spark supported versions
API
API Key for Models
API Key for Models
API v2 Usage
Application Polling Endpoint
Applications
Applied ML Prototypes (AMP)
Applied ML Prototypes (AMPs)
Automatic Logging
Autoscaling Workloads with Kubernetes
Back up an ML workspace
Backing up ML workspaces
Base Engine 10-cml1.3
Base Engine 11-cml1.4
Base Engine 12-cml-2020.06-2
Base Engine 13-cml-2020.08-1
Base Engine 14-cml-2021.05-1
Base Engine 15-cml-2021.09-1
Base Engine 9-cml1.2
Basic Concepts and Terminology
Build and deployment commands for models
Build Image
Build the New Docker Image
Build the New Docker Image
Built-in CML Visualizations
Built-in CML Visualizations
Business Users and CML
Catalog File Specification
cdswctl - CLI Client
cdswctl command reference
Challenges with Machine Learning in production
Challenges with model deployment and serving
Challenges with model governance
Challenges with model monitoring
Choosing Default Engine
CLI
Cloudera Data Visualization for ML
Cloudera Data Visualization for ML
Cloudera Machine Learning Overview
Cloudera Machine Learning requirements (ECS)
Cloudera Machine Learning requirements (OCP)
CML and outbound network access
CML API v2
CML Experiment Tracking through MLflow API
Collaboration models
Collaboration Models
Command Line Tools in CML
Configuration Options
Configure a Browser IDE as an Editor
Configure a Browser IDE at the Project Level
Configure a Local IDE using an SSH Gateway
Configure PyCharm as a Local IDE
Configure PyCharm to use Cloudera Machine Learning as the Remote Console
Configure VS Code as a Local IDE
Configuring Email with SMTP
Configuring External Authentication with LDAP and SAML
Configuring HTTP Headers for Cloudera Machine Learning
Configuring Project-level Runtimes
Configuring Quotas
Configuring SAML Authentication
Configuring the Engine Environment
Connect to CDW
Connect to external Amazon S3 buckets
Connect to External SQL Databases
Controlling User Access to Features
Create a Dockerfile for the Custom Image
Create a Dockerfile for the Custom Runtime Image
Create a model using the CLI
Create an Iceberg data connection
Create an Ozone data connection
Creating a Customized Engine Image
Creating a Job
Creating a Model Registry
Creating a model using MLflow
Creating a new version of a Model Registry
Creating a Pipeline
Creating a project from a password-protected Git repo
Creating a Project with Legacy Engine Variants
Creating a Project with Legacy Engine Variants
Creating a Team
Creating an SSH Tunnel
Creating and Deploying a Model
Creating and Deploying a Model
Creating Customized ML Runtimes
Creating New AMPs
Creating Resource Profiles
Creating Resource Profiles
Custom AMP Catalog
Custom Runtime Addons with CML
Custom Template Projects
Customized Engine Images
Customized Runtimes
Data Access
Data Access
Data Scientist
Debugging Issues with Experiments
Debugging Issues with Models
Deleting a Model
Deleting a Project
Deleting Model Registry
Deploy a new model with updated resources
Deploy an ML Workspace with Support for TLS
Deploy an ML Workspace with Support for TLS on ECS
Deploy the Model
Deploying a model from the destination Project page
Deploying a model from the Model Registry page
Deploying an MLflow model as a CML Model REST API
Differences Between Public and Private Cloud
Disable Addons
Disable or Deprecate Runtime Addons
Disabling Model Registry
Disabling Runtimes
Distribute the Image
Distribute the Image
Distributed Computing
Distributed Computing with Workers
Dockerfile compatible with PBJ Workbench
Documenting Your Analysis
Documenting Your Analysis
Download and Configure cdswctl
Download cdswctl and Add an SSH Key
Downloading diagnostic bundles for a workspace
Editor Customization
Editors
Embedded Web Applications
Enable Cross-Origin Resource Sharing (CORS)
Enable HTTP Security Headers
Enable HTTP Strict Transport Security (HSTS)
Enabling authentication
Enabling authentication
Enabling model governance
Enabling model metrics
End-to-End Example: MeCab
Engine Dependencies
Engine Environment Variables
Engine Environment Variables
Engines for Experiments & Models
Environmental Variables
Environmental Variables
Ephemeral storage
Example - Model Training and Deployment (Iris)
Example models with PBJ Runtimes
Example: A Shiny Application
Example: Locating and Adding JARs to Spark 2 Configuration
Example: Montecarlo Estimation
Experiments
Experiments
Experiments - Concepts and Terminology
Experiments with MLflow
Export Usage List
Generating an API key
Generating an API key
Get started with CML on Private Cloud
Git for Collaboration
GPU node setup
GPUs
Grid Displays
Grid Displays
Hadoop Authentication for ML Workspaces
Host names required by AMPs
How to make base cluster configuration changes
How to upgrade CML workspaces
HTML Visualizations
HTML Visualizations
IFrame Visualizations
IFrame Visualizations
Including Images in allowlist for Cloudera Machine Learning projects
Initialize an SSH Connection to Cloudera Machine Learning for VS Code
Initialize an SSH Endpoint
Installing a Jupyter extension
Installing a Jupyter kernel
Installing a non-transparent proxy in a CML environment
Installing Additional ML Runtimes Packages
Installing Additional Packages
Internal Network File System on ECS
Internal Network File System on OCP
Introduction to Private Cloud
Jobs and Pipelines
Jobs API
Jupyter Magic Commands
Jupyter Magics
Kerberos Errors
Known Issues
Known issues and limitations
Known Issues and Limitations
Launch a Session
Legacy Engine Level Configuration
Legacy Engines
Limitations
Limitations
Limitations
Limitations
Limitations on Private Cloud
Limiting files in Explorer view
Linking an Existing Project to a Git Remote
Log into cdswctl
Machine Learning Project Lifecycle
Managing a Team Account
Managing API Keys
Managing API Keys
Managing Dependencies for Spark 2 and Scala
Managing Dependencies for Spark 2 Jobs
Managing Engines
Managing Memory Available for Spark Drivers
Managing ML Runtimes
Managing Project Files
Managing Projects
Managing Projects
Managing Users
Managing your Personal Account
Metadata for Custom ML Runtimes
ML Governance Requirements
ML Runtimes 2020.11
ML Runtimes 2020.11
ML Runtimes 2021.02
ML Runtimes 2021.04
ML Runtimes 2021.06
ML Runtimes 2021.09
ML Runtimes 2021.12
ML Runtimes 2021.12
ML Runtimes 2022.04
ML Runtimes 2022.04
ML Runtimes 2022.11
ML Runtimes 2022.11
ML Runtimes Environment Variables
ML Runtimes Environment Variables List
ML Runtimes Known Issues and Limitations
ML Runtimes NVIDIA GPU Edition
ML Runtimes NVIDIA RAPIDS Edition
ML Runtimes Pre-installed Packages
ML Runtimes Release Notes
ML Runtimes Version 2020.11
ML Runtimes Version 2021.02
ML Runtimes Version 2021.04
ML Runtimes Version 2021.06
ML Runtimes Version 2021.09
ML Runtimes Version 2021.09.02
ML Runtimes Version 2021.12
ML Runtimes Version 2022.04
ML Runtimes Version 2022.11
ML Runtimes Version 2022.11.2
ML Runtimes versus Legacy Engine
ML Runtimes versus Legacy Engine
ML Runtimes What's New
ML Workspaces
Model explainability, interpretability, and reproducibility
Model Governance
Model governance using Apache Atlas
Model Metrics
Model visibility
Models
Models
Models - Concepts and Terminology
Modes of Configuration
Modifying Project Settings
Monitoring Active Models
Monitoring and Alerts
Monitoring applications
Monitoring ML Workspaces
Monitoring User Activity
Monitoring User Events
Native Workbench Console and Editor
Network File System (NFS)
NFS Options for Private Cloud
Onboarding Business Users
PBJ R 3.6 Libraries
PBJ R 4.0 Libraries
PBJ R 4.1 Libraries
PBJ Runtimes and Models
PBJ Workbench
Personal Key
Pre-Installed Packages in Engines
Pre-Installed Packages in ML Runtimes
Pre-Installed Packages in ML Runtimes
Prepare to manage models using the model CLI
Project Garbage Collection
Provision an ML Workspace
Python
Python 3.6 Libraries for JupyterLab
Python 3.6 Libraries for JupyterLab
Python 3.6 Libraries for Workbench
Python 3.6 Libraries for Workbench
Python 3.6.12 Libraries for JupyterLab
Python 3.6.12 Libraries for Workbench
Python 3.7 Libraries for JupyterLab
Python 3.7 Libraries for JupyterLab
Python 3.7 Libraries for JupyterLab
Python 3.7 Libraries for JupyterLab
Python 3.7 Libraries for JupyterLab
Python 3.7 Libraries for JupyterLab
Python 3.7 Libraries for JupyterLab
Python 3.7 Libraries for JupyterLab
Python 3.7 Libraries for PBJ Workbench
Python 3.7 Libraries for Workbench
Python 3.7 Libraries for Workbench
Python 3.7 Libraries for Workbench
Python 3.7 Libraries for Workbench
Python 3.7 Libraries for Workbench
Python 3.7 Libraries for Workbench
Python 3.7 Libraries for Workbench
Python 3.7 Libraries for Workbench
Python 3.7.9 Libraries for JupyterLab
Python 3.7.9 Libraries for Workbench
Python 3.8 Libraries for JupyterLab
Python 3.8 Libraries for JupyterLab
Python 3.8 Libraries for JupyterLab
Python 3.8 Libraries for JupyterLab
Python 3.8 Libraries for JupyterLab
Python 3.8 Libraries for JupyterLab
Python 3.8 Libraries for JupyterLab
Python 3.8 Libraries for JupyterLab
Python 3.8 Libraries for PBJ Workbench
Python 3.8 Libraries for Workbench
Python 3.8 Libraries for Workbench
Python 3.8 Libraries for Workbench
Python 3.8 Libraries for Workbench
Python 3.8 Libraries for Workbench
Python 3.8 Libraries for Workbench
Python 3.8 Libraries for Workbench
Python 3.8 Libraries for Workbench
Python 3.8.6 Libraries for JupyterLab
Python 3.8.6 Libraries for Workbench
Python 3.9 Libraries for PBJ Workbench
Python 3.9 Libraries for Workbench
Python 3.9 Libraries for Workbench
Python 3.9 Libraries for Workbench
Python 3.9 Libraries for Workbench
Python 3.9 Libraries for Workbench
Python 3.9 Libraries for Workbench
Python 3.9 Libraries for Workbench
Python 3.9.6 Libraries for JupyterLab
Python 3.9.6 Libraries for JupyterLab
Python 3.9.6 Libraries for JupyterLab
Python 3.9.6 Libraries for JupyterLab
Python 3.9.6 Libraries for JupyterLab
Python 3.9.6 Libraries for JupyterLab
Python 3.9.6 Libraries for JupyterLab
R 3.6 Libraries
R 3.6 Libraries
R 3.6 Libraries
R 3.6 Libraries
R 3.6 Libraries
R 3.6 Libraries
R 3.6 Libraries
R 3.6 Libraries
R 3.6 Libraries
R 4.0 Libraries
R 4.0 Libraries
R 4.0 Libraries
R 4.0 Libraries
R 4.0 Libraries
R 4.0 Libraries
R 4.0 Libraries
R 4.0 Libraries
R 4.0 Libraries
R 4.1 Libraries
R 4.1 Libraries
R 4.1 Libraries
R 4.1 Libraries
R 4.1 Libraries
R 4.1 Libraries
RAPIDS Runtime PIP Python 3.7.8 Libraries for JupyterLab
RAPIDS Runtime PIP Python 3.7.8 Libraries for Workbench
RAPIDS Runtime PIP Python 3.8.6 Libraries for JupyterLab
RAPIDS Runtime PIP Python 3.8.6 Libraries for Workbench
Recommended Troubleshooting Workflow
Registering a model using MLflow SDK
Registering a model using the Model Registry user interface
Registering and deploying a Model Registry
Registering training data lineage using a linking file
Release Notes
Removing ML Workspaces
Replace a Certificate
Request/Response Formats (JSON)
Requirements
Restore an ML workspace
Restricting User-Controlled Kubernetes Pods
Restrictions for upgrading R and Python packages
Run Code
Run Experiment / Deploy Model
Running an Experiment (Legacy)
Running an Experiment using MLflow
Running Spark with Yarn on the CDP base cluster
Runtimes
Saved Images
Saved Images
Saving Files
Scala
Scala 2.11 Libraries for Workbench
Scala 2.11 Libraries for Workbench
Scala 2.11 Libraries for Workbench
Scala 2.11 Libraries for Workbench
Scala 2.11 Libraries for Workbench
Scala 2.11 Libraries for Workbench
Scala 2.11 Libraries for Workbench
Securing Applications
Securing Models
Securing Models
Securing Models
Security
Set up a custom repository location
Setting Permissions for an Experiment
Setting Up an HTTP Proxy for Spark 2
Setting up Model Registry
Setting up VS Code
Sharing Job and Session Console Outputs
Simple Plots
Simple Plots
Site Administration
Snapshot Code
Spark
Spark Configuration Files
Spark Log4j Configuration
Spark on CML
Spark Web UIs
SSH Keys
Stop a Session
Team Key
Technical Metrics for Models
Test your connectivity to the CDP-DC cluster
Testing a Browser IDE in a Session
Testing Calls to a Model
Testing GPU Setup
Testing ML Runtime GPU Setup
Third-Party Editors
Top Tasks
Tracked User Events
Tracking Metrics
Tracking metrics for deployed models
Tracking model metrics without deploying a model
Train the Model
Troubleshooting
Troubleshooting
Troubleshooting Issues with Workloads
Turning off ML Runtimes Addons
Upgrading CML workspaces version 1.4.1 to 1.5.0 on ECS
Upgrading CML workspaces version 1.4.1 to 1.5.0 on OCP
Upload and work with local files
Usage Guidelines
Use JDBC Connection with PySpark
User Roles
User Roles and Team Accounts
Using an External NFS Server
Using an MLflow Model Artifact in a Model REST API
Using Conda Runtime
Using Conda to Manage Dependencies
Using Editors for ML Runtimes
Using GPUs for Cloudera Machine Learning projects
Using JupyterLab with ML Runtimes
Using ML Runtimes Addons
Using Model Registry
Using Runtime Catalog
Using Spark 2 from Python
Using Spark 2 from R
Using Spark 2 from Scala
View replica logs for a model
Viewing Details for Model Registry
Viewing Details for Model Registry
Viewing Job History
Viewing lineage for a model deployment in Atlas
Visualizations
Visualizing Experiment Results
Web session timeouts
What's New
Workbench editor file types
Worker Network Communication
Workers API
Workspace Backup and Restore Prerequisites
«
Filter topics
Securing Models
Machine Learning Project Lifecycle
▶︎
Experiments
Experiments - Concepts and Terminology
▶︎
Models
Models - Concepts and Terminology
▶︎
Challenges with Machine Learning in production
Challenges with model deployment and serving
Challenges with model monitoring
▶︎
Challenges with model governance
Model visibility
Model explainability, interpretability, and reproducibility
Model governance using Apache Atlas
▶︎
Using Model Registry
▶︎
Setting up Model Registry
Creating a Model Registry
Viewing Details for Model Registry
Deleting Model Registry
▶︎
Registering and deploying a Model Registry
Creating a model using MLflow
Registering a model using the Model Registry user interface
Registering a model using MLflow SDK
Creating a new version of a Model Registry
Deploying a model from the Model Registry page
Deploying a model from the destination Project page
Viewing Details for Model Registry
Disabling Model Registry
Creating and Deploying a Model
Usage Guidelines
Known Issues and Limitations
Request/Response Formats (JSON)
Testing Calls to a Model
▼
Securing Models
Access Keys for Models
▶︎
API Key for Models
Enabling authentication
Generating an API key
Managing API Keys
Active Model Workflows
Technical Metrics for Models
Debugging Issues with Models
Deleting a Model
▶︎
Example - Model Training and Deployment (Iris)
Train the Model
Deploy the Model
»
Models
Securing Models
Access Keys for Models
Each model in Cloudera Machine Learning has a unique access key associated with it. This access key is a unique identifier for the model.
API Key for Models
You can prevent unauthorized access to your models by specifying an API key in the “Authorization” header of your model HTTP request. This topic covers how to create, test, and use an API key in Cloudera Machine Learning.
This site uses cookies and related technologies, as described in our
privacy policy
, for purposes that may include site operation, analytics, enhanced user experience, or advertising. You may choose to consent to our use of these technologies, or
manage your own preferences.
Accept all
1.5
1.5.4
1.5.3
1.5.2
1.5.1
1.5.0
1.4
1.4.1
1.4.0