Learn how to enable automatic group offset synchronization in Streams Replication
Manager (SRM). Enabling this feature can simplify the manual steps that you need to take to
migrate consumer groups in a failover or failback scenario.
By default, automatic group offset synchronization is disabled. It can be enabled
in Cloudera Manager by adding new entries to the Streams Replication Manager's
Replication Configs property.Depending on your use case, you can set up
automatic group offset synchronization on a global level or for specific replications
only.
-
In Cloudera Manager, select Streams Replication Manager.
- Go to Configuration.
- Find the Streams Replication Manager's Replication Configs
and add the following configuration entries:
sync.group.offsets.enabled = true
sync.group.offsets.interval.seconds = [***TIME IN SECONDS***]
In this example, all properties are set on a global level. This means that automatic
group offset synchronization is applied to all replications. Depending on your setup,
you can also choose to set these properties for specific replications using appropriate
replication prefixes.
The sync.group.offsets.enabled property enables automatic group offset
synchronization. The sync.group.offsets.interval.seconds property
controls how frequently offsets are synched. You only need to specify this property if
you want to customize synchronization frequency.
- Enter a Reason for change, and then click Save
Changes to commit the changes.
-
Restart Streams Replication Manager.
Automatic group offset synchronization is enabled. From now on, SRM automatically
exports the translated offsets of the configured source clusters and applies them to the
configured target clusters.
