What's new in Cloudera Flow Management 4.12.0

Explore the latest features and improvements in Cloudera Flow Management and how they support modern data pipeline development and operations.

Cloudera Flow Management 4.12.0 is built on Apache NiFi 2.6.0 and introduces capabilities not available in earlier NiFi versions, combined with Cloudera-specific enhancements. This release also includes fixes for multiple Common Vulnerabilities and Exposures (CVEs), improving stability, reliability, and compliance for enterprise deployments.

The sections below highlight the most important updates in this release.

New NiFi components

  • ConsumeKinesis - Enables users to receive messages from an AWS Kinesis source
  • PutIcebergRecord - Enables users to write record-based FlowFiles into Iceberg tables
  • AzureDevOpsFlowRegistryClient - Enables users to leverage Azure DevOps as a Flow Registry

For a full list of supported NiFi components, see the Support Matrix.

Improvements

Industrial Internet of Things (IIoT) support

ConsumeMQTTIIoT and MQTTIIoTReader allows flows to receive and parse Sparkplug messages, enabling IIoT/edge use cases as an industry standard format.

Kafka OAuth2 authentication support

Support for OAuth2 (OAUTHBEARER) authentication has been added for Kafka components. This enhancement enables secure access to Kafka brokers using an OAuth2 Token Provider controller service to obtain and manage access tokens.

The feature is available for the following Kafka component groups:
  • Kafka_2_6 / Kafka2CDP
  • Kafka3ConnectionService
New flow analysis rule

The RequireServerSSLContext flow analysis rule has been added to ensure that servers (using ListenHttp or ListenTCP) cannot be created without a secure communications layer.

Flow Migration Tool

Cloudera Flow Migration Tool 7.0.0 adds support for migrations to Cloudera Flow Management 4.12.0 and includes several bug fixes.

For more information, see the Migration Tool documentation.

Upgrade and migration options

Cloudera Flow Management 4.12.0 is supported on Cloudera platform 7.3.2.

You can upgrade to Cloudera Flow Management 4.12.0 from 4.10.0 and 4.11.0 using Cloudera Manager. However, because versions 4.10.0 and 4.11.0 are supported on Cloudera Base on premises 7.3.1 and its service packs, you must first upgrade the runtime to Cloudera platform 7.3.2, and then upgrade Cloudera Flow Management to 4.12.0. For instructions, see Upgrading from Cloudera Flow Management 4.10.0 or 4.11.0 to 4.12.0.

In-place upgrades from Cloudera Flow Management 2.1.7 and lower versions to Cloudera Flow Management 4.12.0 are not supported.

Flows created in NiFi 1 must be migrated to NiFi 2 before they can be used in Cloudera Flow Management 4.12.0 (which runs NiFi 2). After the NiFi 1 - NiFi 2 migration, you can import the flows into a 4.12.0 environment. For more information about the migration process and the Cloudera Flow Migration Tool, see the Migration documentation.

Installation

To perform a fresh installation of Cloudera Flow Management 4.12.0, follow the Cloudera Flow Management installation workflow.