What's New in HDF 3.5.2
HDF 3.5.2 is a major release that includes new features, bug fixes, and improvements. This is the last version of HDF that Cloudera will provide. Going forward Cloudera encourages customers to migrate to CFM on CDP.
log4j vulnerability patches
On December 21, 2021 Cloudera released a hotfix for Cloudera Flow Management on Private Cloud Base. It addresses 2 CVEs and other vulnerability concerns as listed below. Cloudera urges all customers to upgrade their DataFlow services to the latest version.
-
CVE-2021-44228 which affects Apache Log4j2 versions 2.0 through 2.14.1.
-
CVE-2021-45046 which affects Apache Log4j2 version 2.15.0
-
LOGBACK-1591 which affects logback versions <= 1.2.7
Important | |
---|---|
NiFi contains the vulnerable log4j2 libraries and should be updated. For information about the available hotfix, contact your Cloudera Support representative. Cloudera is not aware of known exploitation paths within CFM for Private Cloud Base, however upgrading protects against the possibility of any exploitation. |
Apache NiFi Updates
Note | |
---|---|
The NiFi version in HDF
3.5.2.0 is NiFi 1.12.1.3.5.2.0, which includes everything that is
available in Apache NiFi 1.12.1 as well as additional improvements,
bug fixes, and security patches. |
- Hazelcast implementation for the distributed map cache server - this provides a resilient implementation of the distributed map cache within NiFi without the need of external dependencies like HBase or Redis.
- ListenFTP processor - this gives the possibility to have NiFi acting as an FTP server to ingest data directly into NiFi using FTP.
- System Status History monitoring - this provides a new monitoring view in NiFi to track over time the system metrics of the NiFi cluster
- ADLS Gen2 processors - new set of processors to interact with ADLS in Azure
- Support for Kafka 2.6
- Option to empty all queues at process group level
- ScriptedTransformRecord processor - this provides a very powerful option to implement custom transformations while still leveraging the Record API
- Flow File concurrency at process group level - this provides a higher level abstraction at Process Group level to implement patterns similar to what was possible with Wait/Notify processors
- Support for a record writer in the ListX processors
- Support for version 2 and 3 of the schema encoding with the Schema Registry
Schema Registry Updates
The supported version of Schema Registry is 0.8.1.
- ISSUE 574: Re-create a delete schema does not work.
- ISSUE 568: Synchronize Kerberos ticket renewal for non-renewable ticket.
- ISSUE 640: SchemaRegistryClient doesn't take advantage of the UrlSelector for failover scenarios.