Cloudera Docs

Cloudera AI on premises Observability non-airgapped integration

Cloudera Observability integrates with Cloudera AI on Cloudera Data Services on premises to monitor non-airgapped environments. This integration enables you to optimize AI workbench performance and manage resource utilization effectively.

Deploying OpenTelemetry stack for Cloudera AI

After you upgrade to Cloudera Data Services on premises 1.5.5 SP2, the observability pipeline must be enabled on Cloudera AI. This integration allows Cloudera AI to provide enhanced visibility into model performance and system health, eliminating the need for manual configuration of complex monitoring pipelines. Integrating OpenTelemetry with Cloudera AI enables Cloudera Observability features for your Cloudera AIworkflows.

Prerequisite

  • You must be on Cloudera Data Services on premises 1.5.5 Service Pack 2 and higher.
  • Provisioning a Cloudera AI Workbench:
    • In Cloudera AI on premises, the Cloudera AI Workbench provides a workspace for data scientists. After your Administrator has created or given you access to an environment, you can set up a workbench. For more information, see the Provisioning a Cloudera AI Workbench documentation.
    • You can also use the existing Workbench from previous versions of Cloudera Data Services on premises on Cloudera Data Services on premises 1.5.5 SP2.
  • You must have administrator access to the cluster to run kubectl commands.