What's New
Cloudera Private Cloud 1.5.4 includes the following features for Cloudera Machine Learning.
New features
- Cloudera Machine Learning Service Accounts are available in Cloudera Machine Learning Private Cloud
-
In Cloudera Machine Learning (CML), the Kerberos principal for the Service Account may not be the same as your login information. Therefore, ensure you provide the Kerberos identity when you sign in to the Service Account. For more information, see Authenticating Hadoop for CML Service Accounts.
- Cloudera Model Registry is available in Cloudera Private Cloud
-
Cloudera Model Registry is now generally available (GA) in Private Cloud. Model Registry in Private Cloud uses Apache Ozone to store model artifacts. For creating a Cloudera Model Registry you need the Ozone S3 gateway endpoint, the Ozone access key, and the Ozone secret key.
If you deploy Model Registry in an environment that contains one or more CML workspaces, you must synchronize the Model Registry with the workspaces. For more information, see Prerequisites for creating Model Registry and Synchronizing the model registry with a workspace.
- Heterogeneous GPU usage
-
When using heterogeneous GPU clusters to run sessions and jobs, the available GPU accelerator labels need to be selected during workload creation. For more information, see Heterogeneous GPU clusters.
- Data connections without auto discovery
-
Cloudera Machine Learning is a flexible, open platform, supporting connections to many data sources. The provided code samples demonstrate how to access local data for CML workloads. For more information, see Connecting to CDW.
- Spark Log4j Configuration
-
Cloudera Machine Learning allows you to update Spark’s internal logging configuration on a per-project basis. Spark logging properties can be customized for every session, and job with a default file path found at the root of your project. You can also specify a custom location with a custom environment variable. For more information, see Spark Log4j Configuration.
- ML Metrics Collector service
-
The Metrics Collector service gathers data about how users and groups use resource quota, like how much CPU, Memory and GPU capacity (if any) is allocated, and what the users or groups utilize from that. The Metrics Collector service is running by default, but to collect data about resource quota metrics, you need to enable the Quota Management feature. For more information, see ML Metrics Collector Service overview.
- Quota Management for group level
-
Quota Management Technical Preview (TP) release enables you to control how resources are allocated within your CML workspace on user and on group level. Yunikorn Gang Scheduling is also available, which is the default scheduling mechanism in Cloudera Machine Learning. For more information, see Quota Management overview and Yunikorn Gang Scheduling.
- Restarting a failed AMP setup
-
You can now retry failed AMP deployment steps and continue the AMP setup to handle intermittent and configuration issues. For more information, see Restarting a failed AMP setup.
- New Hadoop CLI Runtime Addon versions are available
-
The HadoopCLI 7.1.8.3-601 Runtime Addon is released for the Cloudera Private Cloud.