What's New in Streams Messaging

Kafka

Kafka Rolling Restart check—all partitions fully replicated: A new broker rolling restart check option, all partitions fully replicated has been introduced. Selecting this option ensures that all partitions are in a fully synchronized state when a broker is stopped.

Schema Registry

Enable SMM principal as trusted proxy user in Schema Registry: SMM usually connects to Schema Registry on behalf of an end user. For requests coming from SMM, Schema Registry can now extract and authorize the end user to authorize the request.

Streams Messaging Manager

Validation for duplicate property keys in Kafka Connect connector configuration

When validating Kafka Connect connector configurations, a warning is displayed if the configuration contains duplicate property keys. Duplicate property keys are highlighted with orange. The form can still be validated with the warnings present, but if there are duplicates, you are notified that only the value of the last occurrence is used.

Search supports regular expressions

The search component on the Topics, Brokers, Consumers, Producers page can now perform a regexp search.

Visual clue when restarting on Kafka Connect

When clicking restart on Kafka Connect tasks or connectors, a loading circle is displayed in case of synchronous calls. The loading circle disappears once a response is received. For asynchronous calls, a pop-up is displayed, stating that the task or connector is restarted.

UX improvements

Fixed text overflow in the side panel column headers
Listing page table headers are now sticky of the nested table headers
Listing page table styling has been improved for readability
Filter selector drop-downs are now styled consistently
Sidebar menu pop-ups are no longer hidden under tables
Class names on the Kafka Connect popup are now wrapped into the containing pop-ups
The password field is no longer obfuscated when using a file provider as a password
Fixed the alignment of values on the Connector metrics page
Source and sink connectors are now separate tabs on the connector creation modal
Fixed visual issues on the topic creation modal
Increased consistency in element contrast and text style throughout the UI
Active and Inactive statuses now have high contrast
The expand icon is now consistent throughout the UI

Expand security-related headers set by SMM

The following security related headers were added to SMM UI endpoints:

Referrer-Policy
Cross-Origin-Embedder-Policy
Cross-Origin-Opener-Policy
Cross-Origin-Resource-Policy

SMM uses trusted proxy authentication when connecting to Schema Registry

You can only interact with schemas through SMM if the necessary Ranger policies are set up for Schema Registry. For SMM UI, you must have the correct permissions to check messages deserialized with Avro on Data Explorer.

Streams Replication Manager

The --to option in srm-control now creates the file if it does not exist: From now on, srm-control creates the file specified with the --to option if the file does not exist.

Cruise Control

Cruise Control is added to Streams Messaging Manager UI

A new page is added to Streams Messaging Manager to monitor the Kafka cluster state and rebalancing process with Cruise Control. The Cruise Control User Interface (UI) enables you to review and configure the rebalancing of Kafka clusters through dashboards and a rebalancing wizard. The available goals and anomaly detectors are based on the Cloudera Manager configurations of Cruise Control. You can access Cruise Control from SMM using the on the navigation sidebar.

For more information about Cruise Control in SMM, see Monitoring and managing Kafka cluster rebalancing.