What's New in Streams Replication Manager

Internal SRM topics are now automatically added to the replication deny list🔗

SRM now ignores internal SRM topics when replicating data. If required, this behavior can be disabled by adding srm.internal.topic.exclude.enable=false to Streams Replication Manager's Replication Configs in Cloudera Manager.

Metrics and health checks for the status processor Streams application in SRM Service🔗

SRM Service health tests now show the state of the Connect status processor Streams application.

SRM topic creation timeout increased🔗

Streams Replication Manager internal topic creation timeout property defaults are increased to 20s to tolerate intermittent issues at startup.

Improvements related to raw metric collection and aggregation🔗

Replication status metrics are enhanced with task information

The SRM Service now reports the status of the connectors and tasks in the replication status with detailed descriptions. The status and detailed descriptions can be viewed on the Replications tab of SMM UI.

New metric replication-records-lag

The SRM Service now reports a new metric on its REST API called replication-records-lag. This metric provides information regarding the replication lag based on offsets. The metric is available both on the cluster and the topic level.

Raw metrics are compressed using LZ4

SRM internal metric producers from now on use LZ4 compression by default. LZ4 was chosen as it provides the best combination in terms of compression speed and performance. As a result, Cloudera recommends that you use LZ4. If required, however, you can change the compression by doing the following:

1. Add the following configuration entries to Streams Replication Manager's Replication Configs

   workers.cloudera.metrics.reporter.producer.compression.type=[***COMPRESSION***]
   connectors.cloudera.metrics.reporter.producer.compression.type=[***COMPRESSION***]

2. Add the following to Additional Configs For Streams Application Running Inside SRM Service

   producer.compression.type=[***COMPRESSION***]

For more information regarding, metrics, monitoring, as well as raw metric collection and aggregation, see Streams Replication Manager monitoring and metrics .