ML Metrics Collector Service overview

The Metrics Collector service shows metrics data for Cloudera Machine Learning (CML).

It sends this data to a server called Prometheus, which is part of the Cloudera Data Platform (CDP) control plane. Grafana, the visualization tool, connects to Prometheus to visualize these metrics. With the CML Quota Management, you can see various metrics from different CML workspaces under the CDP control plane.

Currently, the Metrics Collector service gathers data about how users and groups use resource quota, like how much CPU, Memory and GPU capacity (if any) is allocated, and what the users or groups utilize from that. The Metrics Collector service is running by default, but to collect data about resource quota metrics, you need to enable the Quota Management feature.