Cloudera Docs

What's new in Flow Management

Learn about the new features available when using NiFi 2 in Flow Management Data Hub clusters running on Cloudera on cloud 7.3.2.

Cloudera 7.3.2 is a platform-level release defining the base environment that can be used to create different Data Hub cluster types including Flow Management. From 7.3.2 onwards, Flow Management Data Hub clusters are only available with Apache NiFi 2.

Cloudera Flow Management 4.12.0 is built on Apache NiFi 2.6.0 and adds several new features not available in previous versions of Apache NiFi. It also includes fixes addressing multiple Common Vulnerabilities and Exposures (CVEs) to enhance stability, reliability, and compliance for enterprise deployments.

The following sections summarize the most important updates in this release.

New NiFi components
  • ConsumeKinesis - Enables users to receive messages from an AWS Kinesis source
  • PutIcebergRecord - Enables users to write record-based FlowFiles into Iceberg tables
  • AzureDevOpsFlowRegistryClient - Enables users to leverage Azure DevOps as a Flow Registry

For a full list of supported NiFi components, see the Support Matrix.

Improvements
Industrial Internet of Things (IIoT) support

ConsumeMQTTIIoT and MQTTIIoTReader allows flows to receive and parse Sparkplug messages, enabling IIoT/edge use cases as an industry standard format.

Kafka OAuth2 authentication support

Support for OAuth2 (OAUTHBEARER) authentication has been added for Kafka components. This enhancement enables secure access to Kafka brokers using an OAuth2 Token Provider controller service to obtain and manage access tokens.

The feature is available for the following Kafka component groups:

  • Kafka_2_6 / Kafka2CDP

  • Kafka3ConnectionService

New flow analysis rule

RequireServerSSLContext Flow Analysis Rule has been added to ensure that servers (using ListenHttp or ListenTCP) cannot be created without a secure communications layer.

Migration Tool

Cloudera provides a Flow Migration Tool that helps you replace deprecated processors, update configurations, and handle breaking changes automatically in your data flows.

Cloudera Flow Migration Tool 7.0.0 adds support for migrations from Cloudera Flow Management 2.2.9.700 to 4.12.0, and includes several bug fixes.

For more information, see the Migration Tool documentation documentation.