Enable high availability for Streams Replication Manager
Streams Replication Manager is capable of running in high availability mode. This can be enabled by deploying multiple instances of the driver and service role in a cluster.
Streams Replication Manager is capable of running in high availability mode. By enabling high availability mode for Streams Replication Manager, you can ensure that the replication of data and the monitoring of replication continues even in the case of host failure. To enable Streams Replication Manager high availability, you must deploy multiple instances of the driver and service roles on the hosts in a cluster.
In Cloudera on cloud this can be done when provisioning a new cluster with Cloudera Data Hub.
Enable high availability mode in Cloudera on cloud
- Streams Messaging Light Duty
- High availability mode is enabled by default. Any cluster that you provision with this definition will start Streams Replication Manager in high availability mode. Note that it is only the driver that is started in high availability mode, the service role is only provisioned on a single host. This however, is still considered as a highly available deployment of Streams Replication Manager.
- Streams Messaging Heavy Duty
- In the heavy duty definition, Streams Replication Manager has its own host group. However, by default, the Streams Replication Manager host group is not provisioned. When provisioning a cluster with the heavy duty definition, you can decide how many nodes this host group should have. To provision Streams Replication Manager in high availability mode with this cluster definition, you have to set the instance count of the SRM nodes host group to at least 2.
For more information on creating a Streams Messaging cluster with Cloudera Data Hub, see Creating your first Streams Messaging cluster.
