What's new in Streams Messaging Manager

Validation for duplicate property keys in Kafka Connect connector configuration

When validating Kafka Connect connector configurations, a warning is displayed if the configuration contains duplicate property keys. Duplicate property keys are highlighted with orange. The form can still be validated with the warnings present, but if there are duplicates, you are notified that only the value of the last occurrence is used.

Search supports regular expressions

The search component on the Topics, Brokers, Consumers, Producers page can now perform a regexp search.

Visual clue when restarting on Kafka Connect

When clicking restart on Kafka Connect tasks or connectors, a loading circle is displayed in case of synchronous calls. The loading circle disappears once a response is received. For asynchronous calls, a pop-up is displayed, stating that the task or connector is restarted.

UX improvements

• Fixed text overflow in the side panel column headers
• Listing page table headers are now sticky of the nested table headers
• Listing page table styling has been improved for readability
• Filter selector drop-downs are now styled consistently
• Sidebar menu pop-ups are no longer hidden under tables
• Class names on the Kafka Connect popup are now wrapped into the containing pop-ups
• The password field is no longer obfuscated when using a file provider as a password
• Fixed the alignment of values on the Connector metrics page
• Source and sink connectors are now separate tabs on the connector creation modal
• Fixed visual issues on the topic creation modal
• Increased consistency in element contrast and text style throughout the UI
• Active and Inactive statuses now have high contrast
• The expand icon is now consistent throughout the UI

Expand security-related headers set by SMM

The following security related headers were added to SMM UI endpoints:

• Referrer-Policy
• Cross-Origin-Embedder-Policy
• Cross-Origin-Opener-Policy
• Cross-Origin-Resource-Policy

SMM uses trusted proxy authentication when connecting to Schema Registry

You can only interact with schemas through SMM if the necessary Ranger policies are set up for Schema Registry. For SMM UI, you must have the correct permissions to check messages deserialized with Avro on Data Explorer.

Dedicated endpoint for connector creation

{
     "error_code": 409,
     "message": "Connector [***NAME***] already exists"
     }
    

In previous versions, PUT api/v1/admin/kafka-connect/connectors/{connector} was the only endpoint you could use to create connectors. However, this endpoint is also used to update connectors. If you specify the name of an existing connector in the request, the endpoint updates existing connector. As a result, Cloudera recommends that you use the new endpoint for connector creation going forward. The SMM UI is also updated and uses the new endpoint for connector creation.

Jersey client timeout now configurable

SMM uses internal Jersey clients to make requests to Kafka Connect and Cruise Control. The connection and read timeouts for these clients was previously hard-coded to 30 seconds. Configuring them was not possible. This release introduces new properties, which enable you to configure the connection and read timeouts of these clients. The default timeout remains 30 seconds. The properties introduced are as follows.

• Kafka Connect Client Connect timeout
• Kafka Connect Client Read timeout
• Cruise Control Client Connect timeout
• Cruise Control Client Read timeout