Financial Governance Budgeting feature

The Financial Governance Budgeting feature provides organizations with granular control over their spending by allowing them to allocate and manage budgets for expenses associated with workloads and infrastructure.

Budgeting works on the existing financial governance capability, which already tracks and records workload costs by attributing them to the corresponding users and allows the creation of cost centers based on criteria like individual users or resource pools. This feature helps you to enable budget creation, monitor financial control, track spending against the budget set, and implement an alerting system.

You can create budgets for specific cost centers or environments for a defined duration, incorporating a warning threshold. If the scope is Cost Centers, the amount spent is calculated based on jobs run within those cost centers, (for example, Spark, Hive, Impala, and AI jobs). If the scope is Environments, the spent amount is calculated using infrastructure cost data. You can monitor the spending, remaining budget days, and budget utilization percentages.

Alerting is a key function. A scheduled job validates budget thresholds, sending an alert notification to the configured email address if actual costs exceed the specified warning threshold.

Currently, Slack notifications are not available for on premises deployments.

Supported versions:
  • Cloudera Lakehouse Optimizer
  • Cloudera AI Workbench
  • Cloudera Data Hub (7.2.18.100 and higher)
  • Cloudera Private Cloud Base (7.3.1.200 and higher) clusters running Cloudera Manager 7.13.1.200 and higher.

Budget Scope definition

The flexibility to define the scope of the budget is based on two options: Cost Centers or Environments. This scoping determines how the consumption is tracked and calculated against the allocated budget amount. For both options, you can select the same cost centers or environments across multiple budgets, allowing for flexible management and reporting.

Cost Centers

  • If you select Cost Centers, you can choose one or more available cost centers.
  • For cost centers, the amount spent is calculated based on jobs that run within those cost centers.
  • You can select the same cost centers across multiple budgets.

Environments

  • If you select Environments, you can choose one or more available environments.
  • For environments, the amount spent is calculated based on the infrastructure cost data received from Pulse.
  • You can select the same environments across multiple budgets.

Budget report details

The budget report displays a list of all budgets with description:

Budget resport Description
Budget Name The identifier assigned during creation.
Type Categorized as either Environment or Cost Center.
Scope

List of supported and unsupported environments or cost centers.

Frequency The recurring interval. For example, Daily, Weekly, Monthly, or Quarterly.
Duration The active period for which the budget applies.
Duration Remaining The number of days remaining until the budget's duration concludes.
Allocated The predefined spending limit for a specific interval.
Spent The actual amount spent within that interval.
Spent Percentage Line chart visually representing utilization as a percentage. Blue indicates utilization below the warning threshold, Orange is above the warning threshold, and Red denotes an overshoot.
Actions Edit, Clone, and Delete are the available actions.
Search You can search using textual fields using the budget name and scope.

Role-Based Access Control (RBAC) and administration

The ObservabilityAccountAdmin role is required to create, edit, or view budgets, consistent with other financial governance features. The Cloudera Observability support administrator has read-only access to the budget feature, preventing them from performing actions like creating, cloning, deleting, or editing budgets.

Budget dependencies and constraints

  • If a cost center is currently in use within a budget, attempting to delete that cost center will trigger a validation error to prevent its deletion.
  • For Quarterly budgets, you can only select the current and next quarters.
  • The default Warning Threshold is set at 80%.
  • The system skips validation if a budget's duration has concluded or it's no longer active.
  • Alerts are not generated if the premium entitlement is no longer active.