Configuring automatic group offset synchronization

Learn how to enable automatic group offset synchronization in Streams Replication Manager (SRM). Enabling this feature can simplify the manual steps that you need to take to migrate consumer groups in a failover or failback scenario.

By default, automatic group offset synchronization is disabled. It can be enabled in Cloudera Manager by adding new entries to the Streams Replication Manager's Replication Configs property.

Depending on your use case, you can set up automatic group offset synchronization on a global level or for specific replications only.

  1. In Cloudera Manager, select Streams Replication Manager.
  2. Go to Configuration.
  3. Find the Streams Replication Manager's Replication Configs and add the following configuration entries: = true = [***TIME IN SECONDS***]

    In this example, all properties are set on a global level. This means that automatic group offset synchronization is applied to all replications. Depending on your setup, you can also choose to set these properties for specific replications using appropriate replication prefixes.

    The property enables automatic group offset synchronization. The property controls how frequently offsets are synched. You only need to specify this property if you want to customize synchronization frequency.

  4. Enter a Reason for change, and then click Save Changes to commit the changes.
  5. Restart Streams Replication Manager.
Automatic group offset synchronization is enabled. From now on, SRM automatically exports the translated offsets of the configured source clusters and applies them to the configured target clusters.