What's New in this Release

Hortonworks Streams Messaging Manager 1.0.0 is an operations monitoring/ management tool that provides end-to-end visibility in an enterprise Apache Kafka environment.

With SMM, you can gain clear insights about your Kafka clusters. You can understand the end-to-end flow of message streams from producers to topics to consumers. SMM helps you troubleshoot your Kafka environment to identify bottlenecks, throughputs, consumer patterns, and traffic flow. SMM enables you to analyze the stream dynamics between producers and consumers using various filters. You can optimize your Kafka environment based on the key performance insights gathered from various brokers and topics. With the tight integration of Apache Atlas, you can gain complete data lineage across multiple Kafka hops, producers and consumers with powerful data flow visualization.

Key features include:

Simplify troubleshooting Kafka environments

SMM provides intelligence-based filtering that allows a user to select a producer, broker, topic or consumer and see only related entities based on the selection. SMM is smart enough to show only those producers that are sending data to the selected topics and show only those consumer groups that are consuming from those topics. The filtering works on the selection of any of the four entities. This enables users to quickly hone in on the root cause when troubleshooting and debugging Kafka issues.

Visualize end-to-end Kafka stream flows

Another powerful feature of SMM is its ability to visualize all the data streams/flows across all your Kafka clusters. You can select any entity and visualize how data flows with respect to the entity selected.

Extend monitoring / management capabilities with REST

SMM offers REST endpoints for all of its capabilities. This enables developers to integrate SMM with their other enterprise tools such as APM or case/ticketing systems.

Track data lineage and governance from edge-to-enterprise

SMM has been fully integrated with Apache Atlas for governance and data lineage, Apache Ranger for security and access control management, Apache Ambari for infrastructure level monitoring and lifecycle actions for the cluster, and Grafana to be able to graph Kafka metrics over time. See below for an example of SMM and Atlas Integration.

Adopt hybrid cloud deployments for Kafka

SMM is delivered as a DataPlane Platform app. This enables customers to have a single SMM instance manage multiple Kafka clusters within their organization and support hybrid cloud deployments.