Homepage/Cloudera Flow Management2.1.5

(Private Cloud)

Search Documentation

▶︎Cloudera
1. Reference Architectures
▶︎Cloudera Public Cloud
▼Cloudera Private Cloud
▶︎Cloudera Manager
1. Cloudera Manager
▶︎Applications
▶︎Legacy
▶︎

Data Services
Getting Started
Cloudera Manager
Management Console
Replication Manager
Data Catalog
Data Engineering
Data Warehouse
Data Warehouse Runtime
Cloudera AI
Base
Getting Started
Runtime
Upgrade
Storage
Flow Management
Streaming Analytics
Flow Management Operator
Streaming Analytics Operator
Streams Messaging Operator

«

Filter topics

Cloudera Flow Management
▶︎Release Notes
▶︎Overview
▶︎Planning
▼Installation & Upgrade
▶︎How To
▶︎Security
▶︎Reference
▶︎Getting Started with Cloudera Flow Management

Access Policies providers
Activating parcel
Add user to a pre-defined Ranger access policy
Adding a new Registry Client
Adding and configuring Cloudera Management Services
Adding and configuring the NiFi Registry service
Adding and configuring the NiFi service
Adding CFM parcel in Cloudera Manager
Adding Cloudera Management Services
Adding NiFi to the Compute cluster
Adding Snowflake CA certificates to NiFi truststore
Adding Snowflake CA certificates to NiFi truststore
Adding the NiFi and NiFi Registry groups to Ranger in the Base cluster
Adding the NiFi and NiFi Registry groups to Ranger in the Base cluster
Adding the NiFi and NiFi Registry services to a Compute cluster
Adding the NiFi Registry service
Adding the NiFi service
Adding users or groups to Ranger policies
Adding users or groups to Ranger policies
Adding users or groups to Ranger policies
Additional post-upgrade steps for some upgrade scenarios
Apache NiFi Developer Guide
Apache NiFi Expression Language Guide
Apache NiFi RecordPath Guide
Apache NiFi Registry REST API
Apache NiFi Registry System Administrator Guide
Apache NiFi REST API Reference
Apache NiFi System Administrator Guide
Authentication
Authorization
Authorization example
Backing up NiFi keystore and truststore settings
Backing up NiFi Registry keystore and truststore settings
Before you begin
Before you begin
Before you begin
Before you begin
Before you begin
Before you begin
Before you upgrade
Before you upgrade
Before you upgrade
Before you upgrade
Behavioral changes
Bootstrap and Properties file enhancements
Build your first data flow
Building data flow
Building your data flow
Building your dataflow
Building your dataflow
Building your dataflow
CFM component versions
CFM installation workflow
Change the version of your data flow
Checking cluster services
Checking out a ReadyFlow
Checking out your flows
Checking preinstallation setup
Checking service accounts
Clearing activity and shutting down source services
Cloudera Flow Management
Cloudera Manager integration
Cluster layout
Collecting data for upgrade
Collecting Nifi Registry database password
Collecting Ranger passwords
Commit local changes
Component installation and upgrade
Components supported by partners
Concurrent tasks
Configure your source processor
Configuring Cloudera agents and hosts
Configuring Cloudera Manager repository
Configuring database for Cloudera Manager
Configuring Kerberos for NiFi
Configuring Kerberos for NiFi Registry
Configuring NiFi Registry Metadata Stores in MySQL
Configuring NiFi Registry Metadata Stores in PostgreSQL
Configuring NiFi Registry settings
Configuring NiFi settings
Configuring NiFi to use GCM ciphers
Configuring parcels
Configuring processor for data source
Configuring processor for data target
Configuring Ranger for NiFi
Configuring Ranger for NiFi Registry
Configuring Ranger policies for site-to-site communication
Configuring Ranger settings
Configuring Salesforce
Configuring Solr settings
Configuring thread pool size
Configuring TLS/SSL encryption manually for NiFi and NiFi Registry
Configuring TLS/SSL manually
Configuring YARN settings
Configuring your Controller Services
Configuring your source processor
Configuring your source processor
Configuring your source processor
Configuring your target processor
Configuring your target processor
Configuring your target processor
Configuring your target processor
Configuring your truststores
Confirming your data flow success
Confirming your data flow success
Confirming your dataflow success
Connect NiFi to NiFi Registry
Connecting NiFi to NiFi Registry
Connecting NiFi to NiFi Registry
Connecting NiFi to NiFi Registry
Create a bucket in NiFi Registry
Create a custom Ranger access policy
Creating a Compute cluster
Creating a Machine User
Creating a Parameter Context from a Parameter Group
Creating a Ranger user for the Initial Admin Identity
Creating a Shared Data Context
Creating a Shared Data Context
Creating and configuring a Parameter Provider
Creating and configuring controller services
Creating Compute cluster
Creating Controller Services for your data flow
Creating Controller Services for your dataflow
Creating Iceberg target table
Creating the basic Parameter Contexts
Customizing Kerberos principal
Data flow design
Default ports for NiFi and NiFi Registry
Defining your CDP Private Cloud Base data flow
Defining your CDP Public Cloud data flow
Deploying Cloudera Manager
Deselecting unwanted NiFi Registry dependencies
Deselecting unwanted NiFi Registry dependencies
Deselecting unwanted NiFi Registry dependencies
Disk configuration
Download locations
Download NiFi and NiFi Registry
Downloading and extending Ambari blueprint
Downloading the Snowflake JDBC driver JAR file
Enable access to Knox and NiFi
Enabling Auto-TLS
Enabling Auto-TLS for CFM
Enabling security
Encrypting NiFi sensitive properties with FIPS 140-2 approved algorithm
Enhancing or overwriting properties in Cloudera Manager
Environment variables
Example for configuring Parameter Context inheritance
Example for using Parameter Providers
Extracting Kafka broker IDs
Fetching Parameters
File-based authorization
FIPS compliance
Fixed CVEs
Fixed issues
Generating Cloudera Manager Deployment template
Getting started with Apache NiFi
Getting started with Apache NiFi Registry
Getting Started with Cloudera Flow Management
Identity and policies in NiFi
Identity-Mapping properties
In-place upgrade from HDF 3.5.x
Initializing Solr
Install NiFi and NiFi Registry
Installation
Installing and configuring a database for NiFi Registry
Installing and setting up Cloudera Manager
Installing and starting NiFi on Linux
Installing and starting NiFi Registry manually on Linux
Installing CFM 2.1.5
Installing CFM parcel and CSD files
Installing Cloudera Manager and a CDP Private Cloud Base cluster
Installing Cloudera Manager server and agents
Installing MySQL
Installing NiFi and NiFi Registry on a Compute cluster
Installing NiFi and NiFi Registry on your Base cluster
Installing NiFi as a service
Installing NiFi on a Compute cluster and NiFi Registry on a Base cluster
Installing NiFi on Linux
Installing NiFi on Windows
Installing NiFi Registry on your Base cluster
Installing NiFi using the MSI file
Installing PostgreSQL
Installing Solr service
Installing the JDK
Installing the new NiFi version
Installing the new version of NiFi Registry
Integrating NiFi and Atlas
Integrating NiFi and NiFi Registry with Knox
Integrating with Atlas manually
Integrating with Atlas when Auto-TLS is enabled
Integrations
Kerberos authentication
Kerberos credentials
Known issues
Launching the User Interface
LDAP and File-Based Policies
LDAP and Ranger Policies
LDAP authentication
LDAP Integration
LDAP User Group Provider Properties
Local file system access
Manage versioned data flows
Managing NiFi in Cloudera Manager
Manually integrating with Atlas when Auto-TLS is enabled
Manually integrating with Atlas when Auto-TLS is not enabled
Migrating authorization policies
Migrating bundle storage configurations
Migrating dataflows with sensitive properties
Migrating file-based authorization to Ranger
Migrating file-based authorization to Ranger
Migrating file-based user handling and policies
Migrating flow storage
Migrating Kafka Ranger policies
Migrating LDAP authentication configuration
Migrating NiFi File-Based authorization to Ranger
Migrating NiFi File-Based authorization to Ranger
Migrating NiFi file-based policies
Migrating NiFi Ranger-based policies
Migrating NiFi Registry data storage
Migrating NiFi Registry directories
Migrating NiFi Registry file-based authorization to Ranger
Migrating NiFi Registry file-based authorization to Ranger
Migrating NiFi Registry file-based policies
Migrating NiFi Registry Ranger-based policies
Migrating NiFi state and custom components
Migrating the metadata database
Migrating the NiFi data directories
Migrating the NiFi flow.xml.gz file
Migration from HDF 3.5.x or CFM 1.x
Modifying host monitor port number
Modifying the service name in Ranger
Modifying the service name in Ranger
Moving data between CDP and other systems
Moving data from CDP Private Cloud Base to Public Cloud with NiFi site-to-site
Moving data from Salesforce
Moving data in and out of Snowflake
Moving data into CDW on CDP PvC Data Services using Iceberg table format
Moving data out of Salesforce
Moving data out of Salesforce using Apache NiFi
Moving data out of Snowflake
Moving data to CDW using Iceberg format
Moving data to Ozone
Moving data using NiFi site-to-site
Network
Next steps
NiFi files to preserve
NiFi Registry files to preserve
NiFi Registry TLS/SSL properties
NiFi Restricted Components
NiFi TLS/SSL properties
OpenID Connect authentication
Overview
Pairing LDAP with a Composite Group Provider
Parameter overriding
Planning
Post-upgrade steps on CDP
Predefined component-level policies for NiFi
Predefined Ranger Access Policies for Apache NiFi
Predefined Ranger Access Policies for Apache NiFi Registry
Preparing your CDP Private Cloud Base cluster
Preparing your clusters
Prerequisites
Preserving custom processors/NARs
Preserving source cluster files and directories
Property enhancements
Pushing data into Snowflake
Pushing data to and moving data from Snowflake using Apache NiFi
Pushing data to Ozone using NiFi
Ranger authorization
Recommendations
Recommendations
Reference
Release Notes
Removing unnecessary reporting tasks
Resource-intensive processors
Restarting the dataflow after upgrade
Restoring NiFi keystore and truststore settings
Restoring your NiFi Registry keystore and truststore settings
Reviewing NiFi components
Run duration
SAML authentication
Security
Set up Cloudera Flow Management
Setting Ambari environment variables
Setting core configuration service
Setting database password for NiFi Registry
Setting up NiFi node users in NiFi Registry
Setting up Parameter Context inheritance
Setting up your network configuration
Sizing recommendations
StandardOauth2AccessTokenProvider configurations
Start NiFi and NiFi Registry
Start version control
Starting and stopping NiFi on Linux
Starting and stopping NiFi on Windows
Starting Cloudera Manager server and adding license
Starting the data flow
Starting your dataflow
Starting your NiFi and NiFi Registry services
Starting Zookeeper service
Support matrix
Supported NiFi controller services
Supported NiFi parameter providers
Supported NiFi processors
Supported NiFi Registry databases
Supported NiFi reporting tasks
Supported operating systems
System requirements
Technical preview features
Timer and event driven thread pools
TLS/SSL certificate requirements and recommendations
TLS/SSL Configuration
Troubleshooting HDF upgrade
Tuning your data flow
Tuning your data flow
Turning off identity mapping
Turning off TLS regeneration
Understanding the Ranger Authorization Process for CFM
Understanding the use case
Understanding the use case
Unsupported customizations
Unsupported features
Updating a flow with sensitive properties
Updating encryption algorithm for sensitive properties
Updating Parameter Context when the external source has changed
Updating Parameter sensitivity
Updating references to cluster nodes
Updating the configuration files
Updating the configuration files for your new NiFi installation
Updating the Registry Client
Upgrade and migration
Upgrade and migration paths
Upgrading from CFM 1.x
Upgrading from CFM 2.x
Upgrading HDF to CFM on CDP Private Cloud Base
Upgrading NiFi manually
Upgrading NiFi Registry manually
Upgrading to CFM 2.1.5
Upgrading to CFM 2.1.5 from CFM 2.x
User group providers
Using a domain user for NiFi Windows Service
Using a local user for NiFi Windows Service
Using Apache NiFi
Using Apache NiFi
Using Apache NiFi Registry
Using Apache NiFi Registry
Using Apache NiFi Toolkit
Using Apache NiFi Toolkit
Using DataFlow Catalog Registry Client
Using Parameter Context Inheritance
Using Parameter Context inheritance to combine Parameters
Using Parameter Providers
Using the Actions menu
Verifying CFM 2.1.5
Verifying Ranger configurations
Version data flows
Versioning a flow in the Catalog
Viewing the number of cores
Viewing the total number of active threads
Viewing the total number of threads in a cluster
What are Parameter Providers
What is Cloudera Flow Management?
What is NiFi
What is NiFi Registry
What is Parameter Context inheritance?
What's new in this release?
Working with data flows
XML property enhancements

«

Filter topics

Installing and setting up Cloudera Manager

Upgrade and migration paths
▶︎Upgrading from CFM 2.x
1. Before you upgrade
2. Upgrading to CFM 2.1.5 from CFM 2.x
▶︎Upgrading from CFM 1.x
▶︎Migration from HDF 3.5.x or CFM 1.x
▼In-place upgrade from HDF 3.5.x

»

Upgrade and migration

Installing and setting up Cloudera Manager

After you successfully complete the prerequisites, you can install and configure Cloudera Manager in your cluster.

Checking preinstallation setup
You must ensure that the Ambari blueprint, that you download, contains extended hostgroups with hosts, and hosts and all hostgroups contain host entries.
Configuring Cloudera Manager repository
You need to download the Cloudera Manager repository, configure the repository file, and copy the file on all hosts in the cluster. You configure the repository to deploy Cloudera Manager and daemons on the machines.
Installing Cloudera Manager server and agents
You need to install Cloudera Manager server on the Ambari server host, and Cloudera Manager agents and daemons on all hosts. Otherwise, you will not be able to upgrade your cluster.
Configuring database for Cloudera Manager
You need to configure the database for Cloudera Manager to use.
Starting Cloudera Manager server and adding license
To use Cloudera Manager after the installation, you must start the Cloudera Manager server, open the Cloudera Manager web UI, and add Cloudera Manager license.
Configuring Cloudera agents and hosts
You need to add Cloudera agents and hosts before you perform the HDF upgrade.
Adding and configuring Cloudera Management Services
You need to add and configure Cloudera Management Services before you perform the HDF upgrade.

Parent topic: In-place upgrade from HDF 3.5.x to CFM 2.x on CDP

© 2019–2023 by Cloudera, Inc. All rights reserved.

This site uses cookies and related technologies, as described in our privacy policy, for purposes that may include site operation, analytics, enhanced user experience, or advertising. You may choose to consent to our use of these technologies, or

4.0.0
2.1
2.0
1. 2.0.4
2. 2.0.1