Fixed Issues in Streams Messaging

Review the list of Streams Messaging issues that are resolved in Cloudera DataFlow for Data Hub 7.2.11.


There are no fixed Kafka issues in this release.

Schema Registry

CDPD-26382: Schema Registry Client does not clear resources for daemon thread for Kerberos Login
Closing SchemaRegistryClient did not stop the threads managing KerberosLogin, so an application could end up with multiple open threads. This has been fixed and calling close() will also stop the Kerberos thread.
CDPD-25995: Fingerprint hashes are not consistent for Avro schemas
Previously, if there is a default null value in the schema text, the schema's fingerprint will be different with every restart of Schema Registry. With this fix, the default null values in the schema text will remain the same null values independent of restarting the Schema Registry service.
CDPD-25905: _orderByFields and name parameters on the API should not be mandatory
In the previous release, the "name" field was mandatory in the /search/schemas API endpoint. The intent was to make the API better, because searching without a "name" parameter returns an incorrect result. However, this was interpreted as a breaking change in the API and had to be reverted to maintain backward compatibility. Now it is again possible to send requests without providing a "name" parameter, and again this will return an incorrect result.
CDPD-25614: Clearing the cache throws a NPE
Fixed issue where invoking schemaRegistryClient.deleteSchema() caused a NullPointerException.
CDPD-21913: Rename properties in Schema Registry yaml file, remove the dots

Schema Registry uses the Dropwizard framework which allows overriding configuration properties from the command line. Due to implementation specifics, until now some of the properties could not be overridden. This issue is now resolved.

Schema Registry's StorageManager's init method's properties parameter has type StorageProviderConfiguration.

In Schema Registry's configuration file, StorageProviderConfiguration properties can be:

  • Dbtype
  • queryTimeoutInSecs

Properties that can be dataSourceClassName, dataSourceUrl, dataSourceUser, dataSourcePassword and connectionProperties can be:

  • oracleNetSslVersion
  • oracleNetSslServerDnMatch
  • trustStore
  • trustStoreType
  • keyStore
  • keyStoreType
CDPD-21617: Migrate lettuce to lettuce-io in cache module
The following classes have been removed from the cache module:
  • CacheServiceRegistry
  • CacheServiceLocalRegistry
  • RedisCacheServiceBuilder
  • RedisCacheService
  • DataStoreBackedCacheService
  • CacheServiceJsonFactory
  • CacheServiceId
  • CacheService
  • CacheWriterSync
  • CacheWriterAsync
  • CacheWriter
  • CacheLoaderSyncFactory
  • CacheLoaderSync
  • CacheLoaderFactory
  • CacheLoaderCallback
  • CacheLoaderAsyncFactory
  • CacheLoaderAsync
  • CacheLoader
  • RedisConnectionPoolFactory
  • RedisConnectionFactory
  • AbstractRedisConnectionFactory
  • RedisStringsCache
  • RedisHashesCache
  • RedisAbstractCache
  • GuavaCache
  • PhoenixDataStore
  • DataStoreWriter
  • DataStoreReader
  • AbstractDataStore
  • ViewConfig
  • TypeConfig
  • DataStoreConfig
  • ConnectionConfig
  • CachesConfig
  • CacheEntry
  • CacheConfig
  • StaticFactory
  • Factory
  • DataStoreBackedCache
  • CacheException
  • LoadableCache
  • AbstractCache
CDPD-17358: Add logging to Ranger filtering operations in Schema Registry
Logging added to show which schemas have been filtered out.
OPSAPS-59993: Disable admin port in Schema Registry
The following admin ports are no longer enabled in Schema Registry:
  • Port 7791 on a secure cluster.
  • Port 7789 on a unsecured cluster.
OPSAPS-59972: Disable the TRACE method on all HTTP ports
In Streams Messaging Manager and Schema Registry, the allowed HTTP methods are changed to GET, POST, PUT, DELETE, HEAD, OPTIONS.
OPSAPS-60458: Knox principal is not over-ridable in SMM and Schema Registry
Custom Knox principal can be set for Schema Registry and SMM by setting the knox_principal_name property in Schema Registry Server Advanced Configuration Snippet (Safety Valve) for registry.yaml or Streams Messaging Manager Rest Admin Server Advanced Configuration Snippet (Safety Valve) for streams-messaging-manager.yaml.

Streams Messaging Manager

CDPD-26633: SMM API exposes email notifier SMTP password
The SMM API no longer returns the SMTP password in its responses to avoid sensitive information leak. This leaves the SMTP password field blank in the SMM UI when editing an email notifier provider. The password needs to be re-entered when any changes are made to its configurations.

Streams Replication Manager

CDPD-13864 and CDPD-15327: Replication stops after the network configuration of a source or target cluster is changed
This issue is fixed.
OPSAPS-60601: The SRM client's secure storage might become corrupted if the JAAS Secret properties are used
JAAS secrets can be used in Kafka External Accounts.
OPSAPS-60601: Replication does not start when the target cluster of the replication is unsecured
Unsecure clusters can now be targeted by replications.
OPSAPS-60775: Kafka External Accounts configurations are not generated for the SRM Service
The SRM Service’s configuration now contains the Kafka External Accounts configuration, enabling SRM Service to access Kafka clusters defined through External Accounts.