Cloudera Docs

Data Recovery Service (DRS) overview

The new DRS is a holistic backup and recovery solution encompassing the core Cloudera Control Plane and integrated Data Services (such as Cloudera Data Engineering, Cloudera Data Warehouse, and Cloudera Data Catalog).

The Cloudera Control Plane and supported Data Services are available in a unified experience.

Some of the new capabilities that DRS now offers includes:

  • Unified framework consolidating all Data Services into a single interface
  • Flexible policy management includes granular control over participating entities and scheduled and ad-hoc backups
  • Ability to restore the backup to a secondary Cloudera Embedded Container Service cluster
  • Support for incremental backups after an initial, full backup
  • Configurable backup repositories (S3 compatible storage)
  • Guided restore workflow with the ability to have configuration overrides

Core Architecture Overview and System Roles

The key operational roles and architecture components includes the following:

  • Primary Cluster: Initiates backups and hosts active Cloudera Control Plane and Data Services (Cloudera Data Engineering, Cloudera Data Warehouse)
  • Secondary Cluster: Clean target cluster receiving the restore payload. Must maintain Version Parity and adequate compute/storage capacity
  • Central S3 Storage: Externalized S3-compatible storage containing both backup payloads and backup metadata manifests acting as the definitive source of truth
  • Orchestration Layer: Cloudera wrapper that abstracts underlying execution engine, handles pre/post hooks, and coordinates with Data Services
  • Execution Engine: Core underlying tools executing Kubernetes API backups, CSI volume snapshots, and incremental data deduplication/pushes

The security and login credentials transitions during the data recovery process. All user accounts, group permissions, and identity provider (IdP) configurations are saved directly within the application's environment. After restoring this environment on the secondary cluster, the backup copies your exact security setup automatically. Users can log in just like before, with zero manual re-configuration needed.