What's New in Streams Replication Manager
Learn about the new features of Streams Replication Manager (SRM) in Cloudera Runtime 7.3.1.
The --to option in srm-control now creates the file if it does not exist
From now on, srm-control creates the file specified with the
--to option if the file does not exist.
Configurations to customize replication-records-lag metric calculation
Three new properties are introduced that enable you to control how SRM calculates the
replication-records-lag metric. This metric provides information
regarding the replication lag based on offsets. The metric is available both on the cluster
and the topic level. The following new properties are introduced because the calculation of
the metric with default configurations might add latency to replications and impact SRM
performance. While these properties are configured in Cloudera Manager, they do not have
dedicated configuration entries. Instead, you add them to Streams Replication
Manager's Replication Configs to configure them.
| Property | Default Value | Description |
|---|---|---|
replication.records.lag.calc.enabled |
true |
Controls whether the replication-records-lag metric is
calculated. This metric provides information regarding the replication lag based
on offsets. The metric is available both on the cluster and the topic level. The
calculation of this metric might add latency to replications and impact SRM
performance. If you are experiencing performance issues, you can try setting this
property to false to disable the calculation of
replication-records-lag. Alternatively, you can try fine-tuning
how SRM calculates replication-records-lag with the
replication.records.lag.calc.period.ms and
replication.records.lag.end.offset.timeout.ms properties.
|
replication.records.lag.calc.period.ms |
0 | Controls how frequently SRM calculates the
replication-records-lag metric. The default value of 0 means
that the metric is calculated continuously. Cloudera recommends configuring this
property to 15000 ms (15 seconds) or higher if you are experiencing issues related
to the calculation of replication-records-lag. A calculation
frequency of 15 seconds or more results in the metric being available for
consumption without any significant impact on SRM performance. |
replication.records.lag.end.offset.timeout.ms |
6000 | Specifies the Kafka end offset timeout value used for calculating the
replication-records-lag metric. Setting this property to a
lower value than the default 6000 ms (1 minute) might reduce latency in
calculating replication-records-lag, however,
replication-records-lag calculation might fail. A value higher than the default
can help avoid metric calculation failures, but might increase replication latency
and lower SRM performance. |
