Cloudera Docs

Credit consumption and usage insights

Cloudera includes a user interface that allows you to monitor your credit consumption and download your consumption records.

Cloudera Public Cloud displays consumption data in terms of credits. A credit is a unit of consumption in Cloudera Public Cloud.

There is a two-day time delta for the consumption data showing up in the Consumption page. You should not expect to see data for consumption, which occurred within the past two days.

Required roles: BillingAdmin

Steps

  1. Navigate to the Cloudera web interface and select Cloudera Management Console.
  2. Select Consumption from the navigation pane.
    On the Consumption page, you can view the Credit Summary, Credits Burndown and Usage Insights. By default, the consumption summaries are shown for all environments. You can further customize the visualization of consumption based on time, specific environments, and tags.
    Credit Summary
    Displays credit information based on your credit subscription.
    Credits and Usage Insights
    • The Credits Burndown chart shows the credit used over a period of time.
    • The Usage Insights bar chart shows the total consumption of the services over a period of time.
    • The Clusters table shows the number of the number of credits used by the clusters, number of hours the cluster was running, and how many clusters belong to the specific services.
  3. Select a date range to display the consumption for a time period. The selected time period can be one month, three months, six months and one year in a daily or monthly view.
  4. Select tags to further filter the clusters in the environments for Usage Insights. The filter uses the user-level tags of the clusters. When selecting multiple tags, the clusters are displayed using OR logic. For example, if you select department=engineering and department=finance, the clusters will be shown on the Usage Insights that have a department tag value of engineering or finance.
  5. Select all or specific environments.

    You can view the Usage Insights of the clusters for all existing environments or select a specific one.

    1. Hover over a bar to display consumption information by services.

      Select or hide services that are displayed on the Usage Insights chart.

      Displaying the consumption information of the specific services associated with the environments can be enabled and disabled.

    2. Click on a bar to display consumption information by clusters.

      You can view credit and usage information of clusters that belong to all services or a specific service.

      Clusters can also be searched by providing their name in the search field.

Download consumption summary from Cloudera web interface

Use the Download Usage Details option to download the consumption data:

Download consumption summary from CDP CLI

Use the cdp consumption list-compute-usage-records command to download the consumption data. For example:
cdp consumption list-compute-usage-records \
--from-timestamp '2023-02-05T00:00:00Z' \
--to-timestamp '2023-02-07T00:00:00Z'

You can optionally set page size and page token.

To set page size (the number of records you want on one page), add the --page-size <value> option to the above command..

To set page token (which signifies which page you would like in the response), add the --starting-token <value> option to the above command. You will get the starting token for the next page in the response of the previous page.