Workload consumption metrics limitations
This section describes data availability, system limitations for workload consumption metrics. Use these guidelines to understand data availability for different types of workloads, and data continuity during service interruptions.
Visibility of short-lived workloads
The system samples workload metrics at one-minute intervals.
Transient workloads: If a workload starts and finishes in less than one minute, the collection system might not detect it. Therefore, these workloads might not appear in consumption reports.
Data continuity during maintenance
You might notice brief, temporary gaps in consumption data collection during system maintenance or service restarts.
Data continuity during service interruptions
If the data processing service becomes unavailable, the system uses specific rules to capture past data after the service is restored:
Completed workloads (analytics data): The system uses a two-hour recovery window for workloads in a terminal state.
- If the service is down for less than two hours, it retroactively processes all workloads that were completed during the downtime.
- If the downtime exceeds two hours, the system does not capture data for workloads that finished outside of this two-hour window.
Active workloads (Real-Time Monitoring):
Live data: Real-time visibility pauses while the service is unavailable. When the service is restored, the system resumes reporting the current state of active workloads.
Recently finished workloads: The system uses a 15-minute recovery window for real-time data. If a workload reaches a terminal state while the service is down, the system only captures the final data if the service is restored within 15 minutes of the workload completion.
