About the Cloudera Observability user interface hierarchy

Provides a brief introduction to the web interface, its hierarchical components, and the frequently used interface elements of Cloudera Observability. Cloudera recommends that you take a moment to familiarize yourself with the user interface, its components, and elements.

The Cloudera Observability web UI hierarchically displays the health, performance, and status of your environment, services, workload clusters, engines, and resources, including the costs associated with your data infrastructure, from the top-down. Its dashboard components include statistics, performance, health, and prescriptive guidance visually displayed in chart widgets or tabular views.

After selecting the Cloudera Observability tile from the CDP Public Cloud Enterprise Data web interface landing page, the Cloudera Observability landing page opens. This page is also called the Cloudera Observability HOME page.

About the main navigation panel

The Main navigation panel enables access to the following Cloudera Observability features:
  • Financial Governance, which opens the Chargeback page that displays the total costs and the hourly CPU and memory usage for all of your cost centers, including the unutilized resource usage costs from the Uncategorised section.
    From its Actions list you can:
    • Configure your cost centers criteria based on CPU and Memory costs and resource usage.
    • Create cost centers, which separate costs across user or pool usage and track their workload resource consumption costs.
  • Analytics, which depending on the tier level within the hierarchy displays:
    • The Environments page that lists your environments, including:
      • The environment's platform type.
      • The platform's version number.
      • The number and type of service hosted on the platform.
      • The date and time that telemetry data was last collected.

      To filter and display only those environment platforms or services of interest, either enter the environment's name in the Search field or from the Environments list, select the environment's Type.

      The Cloudera Observability Environment Types are:
      • Classic Cluster
      • Manually Uploaded
      • Private Cloud Base
      • Data Lake
      • Data Hub
      • Database Catalog
      • Virtual Warehouse
      • Data Engineering
      • Virtual Cluster

      Where, a Cloudera Observability Environment hierarchically represents the association of your Public or Private Cloud account and its data services, resources, clusters and their workloads (Jobs and Queries).

  • User login name, which enables you to access your Cloudera Management Console user profile and to log out. The profile page displays information about you including your cloud region and cloud resource name. You to can also create the Cloudera Observability Telemetry Publisher access key credentials from the Actions list.

About the environment navigation panel

The Environment navigation panel hierarchically displays the environment from its parent tier (environment name) to the lower tier levels (services, service components, clusters, engines, jobs, and queries).

The following table describes the environment categories, which are displayed in the Environment panel dependent on the selected Cloudera Observability environment type:
Table 1. Environment categories and summaries
Category Description
DATA HUB CLUSTERS This service when expanded in the Environment panel, hierarchically displays the environment's clusters and workload engines.
DATA WAREHOUSE This service when expanded in the Environment panel, hierarchically displays the data service's Database Catalogs, their Virtual Warehouses and workload Hive and Impala engines.
DATA ENGINEERING This service when expanded in the Environment panel, hierarchically displays the data service's Virtual Clusters and workload Spark engines.
ENGINES Lists the Hive, Impala, Spark, Oozie, and MapReduce workload engines for Classic Cluster, Private Cloud Base, and Data Hub environments.
HIVE METASTORE Lists the Hive and Impala engine metastores.

When a metastore is selected the List of Tables View displays details about each table available in your system that were processed in Hive and Impala engines, regardless of whether they have been queried or not.

Unclassified Jobs Displays the diagnostic data collected from Data Hub environments before April 30th 2023 or collected from CDE and CDW environments using versions older than CDE 1.19 and CDW 1.6.3.
The following table describes the Environment, Cluster, and Engine Summary pages:
Table 2. Environment summary pages
Environment Summary Displays the Data Lake Data Services page, which enables the exploration of each of your services and their components.
The table has the following columns:
  • Data Service, which lists the name of each service.
  • Type, which lists the Cloudera Observability environment type, such as Data Engineering Service, Database Catalog, or Data Hub Cluster.
  • Content, which displays the number of workspaces, virtual warehouses, or virtual clusters.
  • Version, which displays the version number of the service.
  • Last Data Collection, which displays the last time data was collected for the service.
Cluster Summary Displays the Summary page and the Cloudera Observability features available for the environment's cluster and subscription entitlement:
  • Summary tab, which displays performance trends and metrics about the processed jobs and queries as chart widgets and enables you to view historical trends for analysis when you select a predefined or custom time period from the Time-Range filter list.
  • Workloads tab, which enables the creation and management of your Workload views for the environment's cluster.
  • Validations tab, which displays all the open validation alerts for your environment's cluster.
  • Auto Actions tab, which enables the creation and management of your Auto Actions events for the environment's cluster.
Engine Summary Displays information about the workload jobs or queries run by the selected engine, such as which jobs or queries have failed or are slow, their processing time, missed SLAs (thresholds), user and pool metrics, and outlier issues.

About the Cloudera Observability chart widgets

The Cloudera Observability chart widgets enable you to quickly observe real-time and historical patterns, trends, and outliers of your workload data. They provide quick insights into the health and performance of your workloads, clusters, and resources. Where:
  • Hovering over an element with your mouse pointer, such as over a time-line or a data point, displays more information about the element underneath.
  • Clicking a link within a chart widget or a bar within bar chart widget, such as the Suboptimal bar chart widget, opens the engine's Jobs or Queries page that contains more information in a tabular view for you to investigate further.

About the Jobs and Queries pages

Depending on the engine chosen, the engine's Jobs or Queries page provides information about each of the jobs or queries that are serviced by the engine. You can filter further by selecting a filter option from one of the filter categories; Pool, User, Status, Health Check, or Duration.

For more information about a specific job's or query's health, execution details, baseline, and trends, open their respective page by clicking the link in the Job or Query column and selecting the tab of interest. To investigate further, these pages also provide prescriptive guidance and recommendations that enable you to address problems and optimize solutions.