Homepage
/
Cloudera Flow Management
2.1.7
(Private Cloud)
Search Documentation
▶︎
Cloudera
Reference Architectures
▶︎
Cloudera on cloud
Getting Started
Patterns
Preview Features
Data Catalog
Data Engineering
Data Flow
Data Hub
Data Warehouse
Data Warehouse Runtime
Cloudera AI
Management Console
Operational Database
Replication Manager
DataFlow for Data Hub
Runtime
▼
Cloudera on premises
Data Services
Getting Started
Cloudera Manager
Management Console
Replication Manager
Data Catalog
Data Engineering
Data Warehouse
Data Warehouse Runtime
Cloudera AI
Base
Getting Started
Runtime
Upgrade
Storage
Flow Management
Streaming Analytics
Flow Management Operator
Streaming Analytics Operator
Streams Messaging Operator
▶︎
Cloudera Manager
Cloudera Manager
▶︎
Applications
Cloudera Streaming Community Edition
Data Science Workbench
Data Visualization
Edge Management
Observability SaaS
Observability on premises
Workload XM On-Prem
▶︎
Legacy
Cloudera Enterprise
Flow Management
Stream Processing
HDP
HDF
Streams Messaging Manager
Streams Replication Manager
▶︎
Data Services
Getting Started
Cloudera Manager
Management Console
Replication Manager
Data Catalog
Data Engineering
Data Warehouse
Data Warehouse Runtime
Cloudera AI
Base
Getting Started
Runtime
Upgrade
Storage
Flow Management
Streaming Analytics
Flow Management Operator
Streaming Analytics Operator
Streams Messaging Operator
«
Filter topics
Cloudera Flow Management
▼
Release Notes
What's new
▶︎
Support matrix
Component versions
System requirements
Supported operating systems
Supported NiFi Registry databases
Supported NiFi processors
Supported NiFi controller services
Supported NiFi reporting tasks
Supported NiFi parameter providers
Components supported by partners
Download locations
Unsupported features
Technical preview features
Behavioral changes
▼
Known issues
Known issues in Cloudera Flow Management 2.1.7.2000
Known issues in Cloudera Flow Management 2.1.7.1000
Known issues in Cloudera Flow Management 2.1.7
Fixed issues
Fixed CVEs
▶︎
Overview
What is NiFi?
What is NiFi Registry?
Cloudera Manager integration
▶︎
Planning
Data flow design
Cluster layout
Disk configuration
Resource-intensive processors
Sizing recommendations
▶︎
Installation & Upgrade
▶︎
Installation
CFM installation workflow
▶︎
Preparing your CDP Private Cloud Base cluster
Installing the JDK
▶︎
Installing and configuring a database for NiFi Registry
Installing MySQL
Configuring NiFi Registry Metadata Stores in MySQL
Installing PostgreSQL
Configuring NiFi Registry Metadata Stores in PostgreSQL
Installing Cloudera Manager and a CDP Private Cloud Base cluster
Installing the CFM parcel from the repository
Downloading Custom Service Descriptor files
▶︎
Installing NiFi and NiFi Registry on your Base cluster
Adding the NiFi service
Adding the NiFi Registry service
Connecting NiFi to NiFi Registry
Adding users or groups to Ranger policies
Deselecting unwanted NiFi Registry dependencies
▶︎
Installing NiFi and NiFi Registry on a Compute cluster
Creating a Shared Data Context
Adding the NiFi and NiFi Registry groups to Ranger in the Base cluster
Creating a Compute cluster
Adding the NiFi and NiFi Registry services to a Compute cluster
Connecting NiFi to NiFi Registry
Adding users or groups to Ranger policies
Deselecting unwanted NiFi Registry dependencies
▶︎
Installing NiFi on a Compute cluster and NiFi Registry on a Base cluster
Installing NiFi Registry on your Base cluster
Creating a Shared Data Context
Adding the NiFi and NiFi Registry groups to Ranger in the Base cluster
Creating Compute cluster
Adding NiFi to the Compute cluster
Setting up NiFi node users in NiFi Registry
Connecting NiFi to NiFi Registry
Adding users or groups to Ranger policies
Deselecting unwanted NiFi Registry dependencies
▶︎
Upgrade and migration
Upgrade and migration paths
Upgrade process
▶︎
Component installation and upgrade
▶︎
Installing and starting NiFi on Linux
Installing NiFi on Linux
Installing NiFi as a service
Starting and stopping NiFi on Linux
Launching the User Interface
Installing and starting NiFi Registry manually on Linux
▶︎
Installing NiFi on Windows
Installing NiFi using the MSI file
Using a local user for NiFi Windows Service
Using a domain user for NiFi Windows Service
Starting and stopping NiFi on Windows
▶︎
Upgrading NiFi manually
Before you upgrade
Installing the new NiFi version
Updating the configuration files for your new NiFi installation
Migrating dataflows with sensitive properties
Restarting the dataflow after upgrade
▶︎
Upgrading NiFi Registry manually
Installing the new version of NiFi Registry
Updating the configuration files
▶︎
Getting Started
What is Cloudera Flow Management?
▶︎
Setting up Cloudera Flow Management
Download NiFi and NiFi Registry
Install NiFi and NiFi Registry
Start NiFi and NiFi Registry
Building your first data flow
Connecting NiFi to NiFi Registry
Creating a bucket in NiFi Registry
▶︎
Versioning data flows
Start version control
Commit local changes
Change the version of your data flow
Manage versioned data flows
▶︎
How To
▶︎
Managing NiFi in Cloudera Manager
Using the Actions menu
Managing NiFi nodes
▶︎
Working with dataflows
▶︎
Tuning your dataflow
Tuning your data flow
▶︎
Timer and event driven thread pools
Viewing the total number of threads in a cluster
Viewing the total number of active threads
Viewing the number of cores
Configuring thread pool size
Concurrent tasks
Run duration
Recommendations
▶︎
Using Parameter Context Inheritance
What is Parameter Context inheritance?
▶︎
Example for configuring Parameter Context inheritance
Creating the basic Parameter Contexts
Setting up Parameter Context inheritance
Parameter overriding
▶︎
Using Parameter Providers
What are Parameter Providers?
▶︎
Example for using Parameter Providers
Creating and configuring a Parameter Provider
Fetching Parameters
Creating a Parameter Context from a Parameter Group
Updating Parameter sensitivity
Updating Parameter Context when the external source has changed
Using Parameter Context inheritance to combine Parameters
▶︎
Using DataFlow Catalog Registry Client
Creating a Machine User
Adding DataFlow Catalog as Registry Client
Checking out a ReadyFlow
Checking out your flow
Versioning a flow in the Catalog
▶︎
Using Flow Library Registry Client
Adding Cloudera Flow Library Registry Client
Checking out a flow
▶︎
Accessing NiFi Registry API Swagger UI
Authentication and permissions
Access and usage
▶︎
Moving data using NiFi site-to-site
▶︎
Moving data from Private Cloud to Public Cloud with NiFi site-to-site
Understanding the use case
Preparing your clusters
Setting up your network configuration
Configuring your truststores
Defining your CDP Public Cloud data flow
Configuring Ranger policies for site-to-site communication
Defining your CDP Private Cloud Base data flow
▶︎
Moving data between CDP and other systems
▶︎
Moving data in and out of Snowflake
Pushing data to and moving data from Snowflake using NiFi
▶︎
Moving data out of Snowflake
Before you begin
Downloading the Snowflake JDBC driver JAR file
Adding Snowflake CA certificates to NiFi truststore
Building your data flow
Creating Controller Services for your data flow
Configuring your source processor
Configuring your target processor
Confirming your data flow success
▶︎
Pushing data into Snowflake
Before you begin
Adding Snowflake CA certificates to NiFi truststore
Building your dataflow
Configuring your Controller Services
Configure your source processor
Configuring your target processor
Confirming your data flow success
Next steps
▶︎
Moving data from Salesforce
▶︎
Moving data out of Salesforce using Apache NiFi
▶︎
Moving data out of Salesforce
Before you begin
Configuring Salesforce
Building your dataflow
▶︎
Creating Controller Services for your dataflow
StandardOauth2AccessTokenProvider configurations
Configuring your source processor
Configuring your target processor
Confirming your dataflow success
▶︎
Moving data to Ozone
▶︎
Pushing data to Ozone using NiFi
Before you begin
Building your dataflow
Configuring your source processor
Configuring your target processor
Starting your dataflow
▶︎
Moving data to CDW using Iceberg format
▶︎
Moving data into CDW on CDP PvC Data Services using Iceberg table format
Understanding the use case
Prerequisites
Creating Iceberg target table
Building data flow
Creating and configuring controller services
Configuring processor for data source
Configuring processor for data target
Starting the data flow
▶︎
Security
Recommendations
Identity and policies
▶︎
TLS/SSL configuration
Enabling Auto-TLS
▶︎
Configuring TLS/SSL manually
Requirements and recommendations
Configuring TLS/SSL encryption manually
NiFi TLS/SSL properties
NiFi Registry TLS/SSL properties
▶︎
Authentication
▶︎
Kerberos authentication
Customizing Kerberos principal
LDAP authentication
SAML authentication
OpenID Connect authentication
Identity mapping properties
▶︎
Authorization
▶︎
User group providers
▶︎
LDAP Integration
LDAP and Ranger policies
LDAP and file-based policies
LDAP User Group Provider properties
Pairing LDAP with a Composite Group Provider
▶︎
Access policies providers
▶︎
Ranger authorization
Understanding Ranger authorization
Ranger-based NiFi policy descriptions
Predefined Ranger access policies for NiFi
Predefined Ranger access policies for NiFi Registry
Predefined component-level policies for NiFi
NiFi restricted components
Adding user to a pre-defined Ranger access policy
Creating a custom Ranger access policy
Authorization example
Enabling access to Knox and NiFi
File-based authorization
▶︎
Migrating file-based authorization to Ranger
Migrating NiFi file-based authorization to Ranger
Migrating NiFi Registry file-based authorization to Ranger
▶︎
Environment variables
Kerberos credentials
Local file system access
▶︎
Network
Default ports for NiFi and NiFi Registry
▶︎
Cryptography
▶︎
FIPS 140-2 compliance
Encrypting NiFi sensitive properties with FIPS 140-2 approved algorithm
Configuring NiFi to use GCM ciphers
▶︎
Integrations
▶︎
Integrating NiFi and Atlas
Manually integrating with Atlas when Auto-TLS is not enabled
Manually integrating with Atlas when Auto-TLS is enabled
Integrating NiFi and NiFi Registry with Knox
Customizing properties in Cloudera Manager
NiFi Components Reference
▶︎
Apache NiFi and NiFi Registry documentation
Getting started with Apache NiFi
Using Apache NiFi
Apache NiFi Expression Language Guide
Apache NiFi RecordPath Guide
Apache NiFi System Administrator's Guide
Using Apache NiFi Toolkit
Apache NiFi Developer Guide
Apache NiFi REST API Reference
Getting started with Apache NiFi Registry
Using Apache NiFi Registry
Apache NiFi Registry System Administrator's Guide
Apache NiFi Registry REST API
Access and usage
Access policies providers
Accessing NiFi Registry API Swagger UI
Adding Cloudera Flow Library Registry Client
Adding DataFlow Catalog as Registry Client
Adding NiFi to the Compute cluster
Adding Snowflake CA certificates to NiFi truststore
Adding Snowflake CA certificates to NiFi truststore
Adding the NiFi and NiFi Registry groups to Ranger in the Base cluster
Adding the NiFi and NiFi Registry groups to Ranger in the Base cluster
Adding the NiFi and NiFi Registry services to a Compute cluster
Adding the NiFi Registry service
Adding the NiFi service
Adding user to a pre-defined Ranger access policy
Adding users or groups to Ranger policies
Adding users or groups to Ranger policies
Adding users or groups to Ranger policies
Apache NiFi and NiFi Registry documentation
Apache NiFi Developer Guide
Apache NiFi Expression Language Guide
Apache NiFi RecordPath Guide
Apache NiFi Registry REST API
Apache NiFi Registry System Administrator's Guide
Apache NiFi REST API Reference
Apache NiFi System Administrator's Guide
Authentication
Authentication and permissions
Authorization
Authorization example
Before you begin
Before you begin
Before you begin
Before you begin
Before you upgrade
Behavioral changes
Building data flow
Building your data flow
Building your dataflow
Building your dataflow
Building your dataflow
Building your first data flow
CFM installation workflow
Change the version of your data flow
Checking out a flow
Checking out a ReadyFlow
Checking out your flow
Cloudera Flow Management
Cloudera Manager integration
Cluster layout
Commit local changes
Component installation and upgrade
Component versions
Components supported by partners
Concurrent tasks
Configure your source processor
Configuring NiFi Registry Metadata Stores in MySQL
Configuring NiFi Registry Metadata Stores in PostgreSQL
Configuring NiFi to use GCM ciphers
Configuring processor for data source
Configuring processor for data target
Configuring Ranger policies for site-to-site communication
Configuring Salesforce
Configuring thread pool size
Configuring TLS/SSL encryption manually
Configuring TLS/SSL manually
Configuring your Controller Services
Configuring your source processor
Configuring your source processor
Configuring your source processor
Configuring your target processor
Configuring your target processor
Configuring your target processor
Configuring your target processor
Configuring your truststores
Confirming your data flow success
Confirming your data flow success
Confirming your dataflow success
Connecting NiFi to NiFi Registry
Connecting NiFi to NiFi Registry
Connecting NiFi to NiFi Registry
Connecting NiFi to NiFi Registry
Creating a bucket in NiFi Registry
Creating a Compute cluster
Creating a custom Ranger access policy
Creating a Machine User
Creating a Parameter Context from a Parameter Group
Creating a Shared Data Context
Creating a Shared Data Context
Creating and configuring a Parameter Provider
Creating and configuring controller services
Creating Compute cluster
Creating Controller Services for your data flow
Creating Controller Services for your dataflow
Creating Iceberg target table
Creating the basic Parameter Contexts
Cryptography
Customizing Kerberos principal
Customizing properties in Cloudera Manager
Data flow design
Default ports for NiFi and NiFi Registry
Defining your CDP Private Cloud Base data flow
Defining your CDP Public Cloud data flow
Deselecting unwanted NiFi Registry dependencies
Deselecting unwanted NiFi Registry dependencies
Deselecting unwanted NiFi Registry dependencies
Disk configuration
Download locations
Download NiFi and NiFi Registry
Downloading Custom Service Descriptor files
Downloading the Snowflake JDBC driver JAR file
Enabling access to Knox and NiFi
Enabling Auto-TLS
Encrypting NiFi sensitive properties with FIPS 140-2 approved algorithm
Environment variables
Example for configuring Parameter Context inheritance
Example for using Parameter Providers
Fetching Parameters
File-based authorization
FIPS 140-2 compliance
Fixed CVEs
Fixed issues
Getting Started
Getting started with Apache NiFi
Getting started with Apache NiFi Registry
Identity and policies
Identity mapping properties
Install NiFi and NiFi Registry
Installation
Installing and configuring a database for NiFi Registry
Installing and starting NiFi on Linux
Installing and starting NiFi Registry manually on Linux
Installing Cloudera Manager and a CDP Private Cloud Base cluster
Installing MySQL
Installing NiFi and NiFi Registry on a Compute cluster
Installing NiFi and NiFi Registry on your Base cluster
Installing NiFi as a service
Installing NiFi on a Compute cluster and NiFi Registry on a Base cluster
Installing NiFi on Linux
Installing NiFi on Windows
Installing NiFi Registry on your Base cluster
Installing NiFi using the MSI file
Installing PostgreSQL
Installing the CFM parcel from the repository
Installing the JDK
Installing the new NiFi version
Installing the new version of NiFi Registry
Integrating NiFi and Atlas
Integrating NiFi and NiFi Registry with Knox
Integrations
Kerberos authentication
Kerberos credentials
Known issues
Known issues in Cloudera Flow Management 2.1.7
Known issues in Cloudera Flow Management 2.1.7.1000
Known issues in Cloudera Flow Management 2.1.7.2000
Launching the User Interface
LDAP and file-based policies
LDAP and Ranger policies
LDAP authentication
LDAP Integration
LDAP User Group Provider properties
Local file system access
Manage versioned data flows
Managing NiFi in Cloudera Manager
Managing NiFi nodes
Manually integrating with Atlas when Auto-TLS is enabled
Manually integrating with Atlas when Auto-TLS is not enabled
Migrating dataflows with sensitive properties
Migrating file-based authorization to Ranger
Migrating NiFi file-based authorization to Ranger
Migrating NiFi Registry file-based authorization to Ranger
Moving data between CDP and other systems
Moving data from Private Cloud to Public Cloud with NiFi site-to-site
Moving data from Salesforce
Moving data in and out of Snowflake
Moving data into CDW on CDP PvC Data Services using Iceberg table format
Moving data out of Salesforce
Moving data out of Salesforce using Apache NiFi
Moving data out of Snowflake
Moving data to CDW using Iceberg format
Moving data to Ozone
Moving data using NiFi site-to-site
Network
Next steps
NiFi Registry TLS/SSL properties
NiFi restricted components
NiFi TLS/SSL properties
OpenID Connect authentication
Overview
Pairing LDAP with a Composite Group Provider
Parameter overriding
Planning
Predefined component-level policies for NiFi
Predefined Ranger access policies for NiFi
Predefined Ranger access policies for NiFi Registry
Preparing your CDP Private Cloud Base cluster
Preparing your clusters
Prerequisites
Pushing data into Snowflake
Pushing data to and moving data from Snowflake using NiFi
Pushing data to Ozone using NiFi
Ranger authorization
Ranger-based NiFi policy descriptions
Recommendations
Recommendations
Release Notes
Requirements and recommendations
Resource-intensive processors
Restarting the dataflow after upgrade
Run duration
SAML authentication
Security
Setting up Cloudera Flow Management
Setting up NiFi node users in NiFi Registry
Setting up Parameter Context inheritance
Setting up your network configuration
Sizing recommendations
StandardOauth2AccessTokenProvider configurations
Start NiFi and NiFi Registry
Start version control
Starting and stopping NiFi on Linux
Starting and stopping NiFi on Windows
Starting the data flow
Starting your dataflow
Support matrix
Supported NiFi controller services
Supported NiFi parameter providers
Supported NiFi processors
Supported NiFi Registry databases
Supported NiFi reporting tasks
Supported operating systems
System requirements
Technical preview features
Timer and event driven thread pools
TLS/SSL configuration
Tuning your data flow
Tuning your dataflow
Understanding Ranger authorization
Understanding the use case
Understanding the use case
Unsupported features
Updating Parameter Context when the external source has changed
Updating Parameter sensitivity
Updating the configuration files
Updating the configuration files for your new NiFi installation
Upgrade and migration
Upgrade and migration paths
Upgrade process
Upgrading NiFi manually
Upgrading NiFi Registry manually
User group providers
Using a domain user for NiFi Windows Service
Using a local user for NiFi Windows Service
Using Apache NiFi
Using Apache NiFi Registry
Using Apache NiFi Toolkit
Using DataFlow Catalog Registry Client
Using Flow Library Registry Client
Using Parameter Context Inheritance
Using Parameter Context inheritance to combine Parameters
Using Parameter Providers
Using the Actions menu
Versioning a flow in the Catalog
Versioning data flows
Viewing the number of cores
Viewing the total number of active threads
Viewing the total number of threads in a cluster
What are Parameter Providers?
What is Cloudera Flow Management?
What is NiFi Registry?
What is NiFi?
What is Parameter Context inheritance?
What's new
Working with dataflows
«
Filter topics
Known issues in Cloudera Flow Management
What's new
▶︎
Support matrix
Component versions
System requirements
Supported operating systems
Supported NiFi Registry databases
Supported NiFi processors
Supported NiFi controller services
Supported NiFi reporting tasks
Supported NiFi parameter providers
Components supported by partners
Download locations
Unsupported features
Technical preview features
Behavioral changes
▼
Known issues
Known issues in Cloudera Flow Management 2.1.7.2000
Known issues in Cloudera Flow Management 2.1.7.1000
Known issues in Cloudera Flow Management 2.1.7
Fixed issues
Fixed CVEs
»
Release Notes
Known issues in
Cloudera Flow Management
Review the list of known issues in
Cloudera Flow Management
.
Known issues in Cloudera Flow Management 2.1.7.2000
Review the list of known issues in
Cloudera Flow Management
2.1.7.2000
.
Known issues in Cloudera Flow Management 2.1.7.1000
Review the list of known issues in
Cloudera Flow Management
2.1.7.1000.
Known issues in Cloudera Flow Management 2.1.7
Review the list of known issues in
Cloudera Flow Management
2.1.7.
Feedback
We want your opinion
How can we improve this page?
What kind of feedback do you have?
I like something
I have an idea
Something's not working
Can we contact you for follow-up on this?
Back
Submit
OK
4.0.0
2.1
2.1.7
2.1.6
2.1.5
2.1.4
2.1.3
2.1.2
2.1.1
2.0
2.0.4
2.0.1
