Sources of Metrics Sent to Workload Manager



The above diagram shows the sources from which you can configure Telemetry Publisher to collect diagnostic metrics. These metrics are collected in the following ways:

  • Pull — Telemetry Publisher pulls diagnostic metrics from these services periodically (once per minute, by default). These sources are indicated with the outbound arrows leading from Telemetry Publisher in the above diagram. They are Oozie, YARN, and Spark.
  • Push — A Cloudera Manager Agent pushes diagnostic metrics from these services to Telemetry Publisher within 5 seconds after a job finishes. These sources are indicated with the inbound arrows to Telemetry Publisher. They are Hive and Impala.

After the diagnostic metrics reaches Telemetry Publisher, it is stored temporarily in its data directory and periodically (once per minute) exported to Workload Manager.