Fixed Issues in Streams Messaging
Review the list of Streams Messaging issues that are resolved in Cloudera DataFlow for Data Hub 7.3.1.
Kafka
- CDPD-65649: ReplicaAlterLogDirs stuck with Offset mismatch for the future replica
- This is a backported fix, see KAFKA-9087 for more information.
- CDPD-66986: Mirrormaker 2 auto.offset.reset=latest not working
- This is a backported fix, see KAFKA-13988 for more information.
- OPSAPS-71258: Kafka, SRM, and SMM cannot process messages compressed with Zstd or Snappy is /tmp is mounted as noexec
- The issue is fixed by using JVM flags that point to a different temporary folder for extracting the native library.
- CDPD-71433: Connect logical type null values are not handled in AvroConnectTranslator
- When the
time.precision.mode
property is set toconnect
for the Debezium connector, the connect logical types are used and null values are now handled. - OPSAPS-69481: Some Kafka Connect metrics missing from Cloudera Manager due to conflicting definitions
- Cloudera Manager now registers the metrics
kafka_connect_connector_task_metrics_batch_size_avg
andkafka_connect_connector_task_metrics_batch_size_max
correctly.
Schema Registry
- OPSAPS-68708: Schema Registry might fail to start if a load balancer address is specified in Ranger
- Schema Registry now always ensures that the address it uses to connect to Ranger ends with a trailing slash (/). As a result, Schema Registry no longer fails to start if Ranger has a load balancer address configured that does not end with a trailing slash.
Streams Messaging Manager
- OPSAPS-71258: Kafka, SRM, and SMM cannot process messages compressed with Zstd or Snappy is /tmp is mounted as noexec
- The issue is fixed by using JVM flags that point to a different temporary folder for extracting the native library.
- CDPD-72543: Security headers are not set for static files in SMM
- SMM now applies the following security-related headers to static
files:
- Content-Security-Policy
- X-XSS-PROTECTION
- X-Content-Type-Options
- X-Frame-Options
- Strict-Transport-Security
- CDPD-73643: Unused CM_USER parameter is visible in /cm-configs internal endpoint
- The unused CM_USER field has been removed from the /cm-configs internal endpoint
- CDPD-70313: KNOX does not send Authentication header on FIPS configuration
- KNOX now sends the Authentication header on FIPS clusters.
Streams Replication Manager
- OPSAPS-71258: Kafka, SRM, and SMM cannot process messages compressed with Zstd or Snappy is /tmp is mounted as noexec
- The issue is fixed by using JVM flags that point to a different temporary folder for extracting the native library.
Cruise Control
- OPSAPS-69978: Cruise Control capacity.py script fails on Python 3
- The script querying the capacity information is now fully compatible with Python 3.