What's New in Streams Messaging

Learn about the new Streams Messaging features in Cloudera DataFlow for Data Hub 7.2.10.

Kafka

There are no new features for Kafka in this release.

Schema Registry

There are no new features for Schema Registry in this release.

Streams Messaging Manager

There are no new features for Streams Messaging Manager in this release.

Streams Replication Manager

Sensitive cluster connection information is now stored securely

SRM is now capable of storing all sensitive data in a secure manner. As a result of this improvement, the recommended method of how you configure clusters and cluster connection information for the SRM service (Driver and Service roles) and the srm-control tool has changed.

Previously, cluster connection information (aliases, bootstrap servers, security properties) was configured through the Streams Replication Manager's Replication Configs Cloudera Manager property. From now on, both external and co-located clusters can be defined using a new configuration pane in Cloudera Manager. In addition, co-located clusters can also be configured with a service dependency. The new configuration pane is called Kafka credentials and can be found in Administration > External Accounts> > Kafka credentials.

Additionally, an intermediary keystore that stores connection related sensitive data called SRM client's secure storage can be set up and configured in Cloudera Manager. This secure storage acts as an extension to the srm-control tool’s default configuration and must be set up for the tool if SRM is replicating a secure cluster.

Using the new configuration options and methods makes it possible to securely store all sensitive data that is added to SRM’s configuration.

New documentation is introduced that walks users through the new configuration workflows. For more information, on how to configure clusters using the new configuration options and workflow, see Defining and adding clusters for replication. For more information regarding the new configuration workflow for the srm-control tool, see Configuring srm-control. Additionally, all existing documentation affected by this change is also updated.