Fixed Issues in Streams Messaging
Review the list of Streams Messaging issues that are resolved in Cloudera DataFlow for Data Hub 7.2.14.
Kafka
- CDPD-27780: IdentityReplicationPolicy for MM2 to mimic MM1 (KAFKA-9726 backport)
- This is a backported improvement that introduces a new
replication policy called
IdentityReplicationPolicy
. This replication policy does not rename remote (replicated) topics. As a result of this backport, theIdentityReplicationPolicy
is now available for use with Streams Replication Manager. For more information, see KAFKA-9726. - CDPD-29307: Kafka producer entity stays in incomplete state in Atlas
- The Kafka-Atlas plugin now creates Producer and Consumer entities correctly.
- OPSAPS-61697: Kafka broker IDs are overridden when importing a cluster template
- Importing a cluster template to a new cluster in Cloudera
Manager no longer overrides Kafka broker IDs (
broker.id
) or other role specific unique identifiers if the unique identifiers are already set in the template.
Schema Registry
- CDPD-32192: First start failed for SR, with oracle DB, migration failed at CREATE TABLE "atlas_events"
- Fixed v009__create_registry_audit.sql to have create index refer to the lower case "atlas_events" object (the table).
- CDPD-31907: Schema Registry REST API endpoint does not show SchemaBranches
- Schema Registry’s
/api/v1/schemaregistry/schemas/aggregated
REST API endpoint shows SchemaBranches without SchemaVersions. - CDPD-30996: SR does not create new SchemaMetadata with given ID
- In DefaultSchemaRegistry class, addSchemaMetadata (Supplier<Long> id, SchemaMetadata schemaMetadata, boolean throwErrorIfExists) does not look for the given ID, but the next available ID.
- CDPD-29700: Hide Compatibility list in the website
- When the schema type is JSON, then the Compatibility field will be hidden in the website.
- CDPD-29663: Error while connecting topic with schema in Atlas
- When Schema Registry tries to make a relationship in Atlas between a schema and a non-existent corresponding topic, an error occurs.
- CDPQE-11299: Importing schemas in Confluent format might fail
- Fixed the issue where importing from the Confluent Schema Registry fails intermittently.
Streams Messaging Manager
- CDPD-30745: Broken link to the TopicDetailPage
- When a topic is selected in the Replications tab, where the topic in question is not present on the local Kafka Cluster monitored by the current SMM instance, link breaks to the TopicDetailPage.
- CDPD-30731: Knox rewrite not happening for new v2 SMM endpoints
- SMM is not showing the Replications tab on Public Cloud when Knox is enabled.
- CDPD-30370: When TLS is enabled, SMM should connect to Schema Registry
- When TLS is enabled, SMM by default cannot properly connect to Schema Registry. As a result, the SMM Data Explorer shows errors when viewing Avro formatted data.
- CDPD-28002: The Cluster Replications tab is missing from the SMM UI
- SMM UI now correctly renders Replication workflows and metrics in Public Cloud.
- CDPD-24943: Long resource names (such as topic names, hostnames etc) are truncated on SMM UI
- Resource names in listings (such as topic name, host name, consumer name and so on ) are now overflowing to the next line with breaking text on any character, instead of remaining in 1 line with hidden overflow.
Streams Replication Manager
- OPSAPS-61814: Using the service dependency method to define Kerberos enabled co-located clusters is not supported
- When the Streams Replication Manager Co-located Kafka Cluster Alias configuration is used to auto-configure the connection to the co-located Kafka cluster, and Kerberos is enabled, the JAAS configuration is dynamically generated on each host. As a result, you can now use the service dependency method to define a Kerberos enabled co-located cluster.
- CDPD-31235: Negative consumer group lag when replicating groups through SRM
- SRM no longer tries to create a checkpoint or synchronize the group offset if there is no mapping available for the topic-partition in the offset-syncs topic.
Cruise Control
- CDPD-33535: Upgrading Logredactor version
- The Logredactor version is upgraded to 2.0.13 version to fix CVE-2021-44228 issues.