Homepage/Cloudera Flow Management2.1.4

(Private Cloud)

Search Documentation

▶︎Cloudera
1. Reference Architectures
▶︎Cloudera Public Cloud
▼Cloudera Private Cloud
▶︎Cloudera Manager
1. Cloudera Manager
▶︎Applications
▶︎Legacy
▶︎

Data Services
Getting Started
Cloudera Manager
Management Console
Replication Manager
Data Engineering
Data Warehouse
CDW Runtime
Machine Learning
Base
Getting Started
Runtime & Cloudera Manager
Upgrade
Storage
Flow Management
Streaming Analytics

«

Filter topics

Cloudera Flow Management
▶︎Release Notes
▶︎Overview
▶︎Planning
▼Installation & Upgrade
▶︎How To
▶︎Security
▶︎Reference
▶︎Getting Started with Cloudera Flow Management

Access Policies providers
Activating parcel
Add and configure the NiFi Registry service
Add and configure the NiFi service
Add NiFi and NiFi Registry groups to Ranger
Add NiFi to the Compute cluster
Add the NiFi and NiFi Registry groups to Ranger in the Base cluster
Add the NiFi and NiFi Registry services to a Compute cluster
Add the NiFi Registry service
Add the NiFi service
Add user to a pre-defined Ranger access policy
Add users or groups to Ranger
Add users or groups to Ranger policies
Add users or groups to Ranger policies
Adding CFM parcel in Cloudera Manager
Adding Cloudera Management services
Adding Snowflake CA certificates to NiFi truststore
Adding Snowflake CA certificates to NiFi truststore
Additional post-upgrade steps for some upgrade scenarios
Apache NiFi Developer Guide
Apache NiFi Expression Language Guide
Apache NiFi RecordPath Guide
Apache NiFi Registry REST API
Apache NiFi Registry System Administrator Guide
Apache NiFi REST API Reference
Apache NiFi System Administrator Guide
Authentication
Authorization
Authorization example
Back up NiFi keystore and truststore settings
Back up NiFi Registry keystore and truststore settings
Before you begin
Before you begin
Before you begin
Before you begin
Before you begin
Before you begin
Before you upgrade
Before you upgrade
Behavioral changes
Bootstrap and Properties file enhancements
Building your data flow
Building your dataflow
Building your dataflow
Building your dataflow
Building your first data flow
CFM component versions
CFM deployment workflow
CFM upgrade and migration paths
Change the version of your data flow
Checking cluster services
Checking pre-installation setup
Checking service accounts
Clear activity and shut down source services
Cloudera Flow Management
Cloudera Manager installation and setup
Cloudera Manager integration
Cluster layout
Collecting data for upgrade
Collecting NiFi Registry database password
Collecting Ranger passwords
Commit local changes
Component installation and upgrade
Components supported by partners
Concurrent tasks
Configure your source processor
Configuring Cloudera agents and hosts
Configuring Cloudera Manager repository
Configuring database for Cloudera Manager
Configuring Kerberos for NiFi
Configuring Kerberos for NiFi Registry
Configuring NiFi Registry Metadata Stores in MySQL
Configuring NiFi Registry Metadata Stores in PostgreSQL
Configuring NiFi Registry settings
Configuring NiFi settings
Configuring parcel
Configuring Ranger for NiFi
Configuring Ranger for NiFi Registry
Configuring Ranger policies for site-to-site communication
Configuring Ranger settings
Configuring Salesforce
Configuring Solr settings
Configuring thread pool size
Configuring TLS/SSL encryption manually for NiFi and NiFi Registry
Configuring TLS/SSL manually
Configuring YARN settings
Configuring your Controller Services
Configuring your source processor
Configuring your source processor
Configuring your source processor
Configuring your target processor
Configuring your target processor
Configuring your target processor
Configuring your target processor
Configuring your truststores
Confirming your data flow success
Confirming your data flow success
Confirming your dataflow success
Connect NiFi to NiFi Registry
Connect NiFi to NiFi Registry
Connect NiFi to NiFi Registry
Connecting NiFi to NiFi Registry
Create a Compute cluster
Create a custom Ranger access policy
Create a Ranger user for the Initial Admin Identity
Create a Shared Data Context
Create a Shared Data Context
Create Compute cluster
Creating a bucket in NiFi Registry
Creating Controller Services for your data flow
Creating Controller Services for your dataflow
Creating the basic Parameter Contexts
Cryptography
Customizing Kerberos principal
Data flow design
Default ports for NiFi and NiFi Registry
Defining your CDP Private Cloud Base data flow
Defining your CDP Public Cloud data flow
Deploying Cloudera Manager
Deployment
Deselect unwanted NiFi Registry dependencies
Deselect unwanted NiFi Registry dependencies
Deselect unwanted NiFi Registry dependencies
Disk configuration
Download locations
Downloading Ambari blueprint
Downloading Custom Service Descriptor files
Downloading NiFi and NiFi Registry
Downloading the Snowflake JDBC driver JAR file
Enable access to Knox and NiFi
Enable Auto-TLS for CFM
Enabling Auto-TLS
Enabling security
Encrypting NiFi sensitive properties with FIPS 140-2 approved algorithm
Enhancing or overwriting properties in Cloudera Manager
Environment variables
Example for configuring Parameter Context inheritance
Extending the JSON file
Extracting Kafka broker IDs
File-based authorization
FIPS 140-2 compliance
Fixed CVEs
Fixed issues
Getting ready to upgrade
Getting started with Apache NiFi
Getting started with Apache NiFi Registry
Getting Started with Cloudera Flow Management
Identity and policies in NiFi
Identity-Mapping properties
In-place upgrade
In-place Upgrade
Initializing Solr
Install and configure a database for NiFi Registry
Install CFM 2.1.4
Install Cloudera Manager and a CDP Private Cloud Base cluster
Install NiFi and NiFi Registry on a Compute cluster
Install NiFi and NiFi Registry on your Base cluster
Install NiFi on a Compute cluster and NiFi Registry on a Base cluster
Install NiFi Registry on your Base cluster
Install the CFM parcel from the repository
Install the JDK
Installing and starting NiFi Registry manually
Installing Cloudera Manager server and agents
Installing MySQL
Installing new NiFi version
Installing new version of NiFi Registry
Installing NiFi and NiFi Registry
Installing NiFi as a Service
Installing NiFi on Linux
Installing NiFi on Linux
Installing NiFi on Windows
Installing NiFi using MSI file
Installing PostgreSQL
Installing Solr service
Integrate with Atlas when Auto-TLS is enabled
Integrating NiFi and Atlas
Integrating NiFi and NiFi Registry with Knox
Integrations
Kafka in-place migration with Ranger
Kerberos authentication
Kerberos credentials
Known issues
Launching the User Interface
LDAP and File-Based Policies
LDAP and Ranger Policies
LDAP authentication
LDAP Integration
LDAP User Group Provider Properties
Local file system access
Manage versioned data flows
Managing NiFi in Cloudera Manager
Manually integrate with Atlas
Manually integrating with Atlas when Auto-TLS is enabled
Manually integrating with Atlas when Auto-TLS is not enabled
Migrate authorization policies
Migrate bundle storage configurations
Migrate file-based authorization to Ranger
Migrate file-based authorization to Ranger
Migrate flow storage
Migrate NiFi File-Based Authorization to Ranger
Migrate NiFi File-Based Authorization to Ranger
Migrate NiFi file-based policies
Migrate NiFi Ranger-based policies
Migrate NiFi Registry data storage
Migrate NiFi Registry File-Based Authorization to Ranger
Migrate NiFi Registry File-Based Authorization to Ranger
Migrate NiFi Registry file-based policies
Migrate NiFi Registry Ranger-based policies
Migrate NiFi state and custom components
Migrate the metadata database
Migrate the NiFi data directories
Migrate the NiFi flow.xml.gz file
Migrating a dataflow with sensitive properties
Migrating file-based user handling and policies
Migrating Kafka Ranger policies
Migrating LDAP authentication configuration
Migrating NiFi Registry directories
Migration
Modifying host monitor port number
Modifying the service name in Ranger
Modifying the service name in Ranger
Moving data between CDP and other systems
Moving data from CDP Private Cloud Base to Public Cloud with NiFi site-to-site
Moving data in and out of Ozone
Moving data in and out of Snowflake
Moving data out of Salesforce
Moving data out of Salesforce
Moving data out of Salesforce using Apache NiFi
Moving data out of Snowflake
Moving data using NiFi Site-to-Site
Network
Next steps
NiFi files to preserve
NiFi Registry files to preserve
NiFi Registry TLS/SSL properties
NiFi Restricted Components
NiFi TLS/SSL properties
OpenID Connect authentication
Overview
Pairing LDAP with a Composite Group Provider
Parameter overriding
Planning
Post migration steps
Post-upgrade steps on CDP
Post-upgrade steps on CDP for HDF on HDP
Predefined component-level policies for NiFi
Predefined Ranger Access Policies for Apache NiFi
Predefined Ranger Access Policies for Apache NiFi Registry
Prepare your CDP Private Cloud Base cluster
Preparing your clusters
Preserve custom processors/NARs
Preserve source cluster files and directories
Preserving customizations prior to upgrade
Preserving your custom NAR files
Preserving your custom processors
Property enhancements
Pushing data into Snowflake
Pushing data to and moving data from Snowflake using Apache NiFi
Pushing data to Ozone using NiFi
Ranger authorization
Recommendations
Recommendations
Reference
Release Notes
Remove unnecessary reporting tasks
Resource-intensive processors
Restarting the dataflow after upgrade
Restore NiFi keystore and truststore settings
Restore your NiFi Registry keystore and truststore settings
Run duration
SAML authentication
Security
Setting core configuration service
Setting database password for NiFi Registry
Setting up Cloudera Flow Management
Setting up NiFi node users in NiFi Registry
Setting up Parameter Context inheritance
Setting up your network configuration
Sizing recommendations
StandardOauth2AccessTokenProvider configurations
Start version control
Start your NiFi and NiFi Registry services
Starting and Stopping NiFi on Linux
Starting and stopping NiFi on Windows
Starting Cloudera Manager server and adding license
Starting NiFi and NiFi Registry
Starting your dataflow
Starting Zookeeper service
Support matrix
Supported NiFi controller services
Supported NiFi processors
Supported NiFi Registry databases
Supported NiFi reporting tasks
Supported operating systems
System requirements
Technical preview features
Timer and event driven thread pools
TLS/SSL certificate requirements and recommendations
TLS/SSL Configuration
Troubleshooting HDF upgrade
Tuning your data flow
Tuning your data flow
Turn off identity mapping
Turn off TLS regeneration
Understand your Base cluster layout
Understand your Compute cluster layout
Understand your deployment scenario
Understand your mixed cluster layout
Understanding the Ranger Authorization Process for CFM
Understanding the use case
Unsupported customizations
Unsupported features
Update a flow with sensitive properties
Update references to cluster nodes
Update the Registry Client
Updating configuration files
Updating configuration files for your new NiFi installation
Upgrade
Upgrade paths
Upgrading HDF to CFM on CDP Private Cloud Base
Upgrading NiFi manually
Upgrading NiFi Registry manually
Upgrading to CFM 2.1.4
Upgrading to CFM 2.1.4 from CFM 1.1.0
Upgrading to CFM 2.1.4 from CFM 2.x
User group providers
Using Apache NiFi
Using Apache NiFi
Using Apache NiFi Registry
Using Apache NiFi Registry
Using Apache NiFi Toolkit
Using Apache NiFi Toolkit
Using domain user for NiFi Windows Service
Using local user for NiFi Windows Service
Using Parameter Context Inheritance
Using the Actions menu
Verify CFM 2.1.4
Verifying Ranger configurations
Versioning data flows
Viewing the number of cores
Viewing the total number of active threads
Viewing the total number of threads in a cluster
What is Cloudera Flow Management?
What is NiFi
What is NiFi Registry
What is Parameter Context inheritance?
What's new in this release?
Working with data flows
XML property enhancements

«

Filter topics

Cloudera Manager installation and setup

In-place Upgrade
▶︎Before you upgrade
▶︎Downloading Ambari blueprint
1. Extending the JSON file
▼Cloudera Manager installation and setup
▶︎Upgrading HDF to CFM on CDP Private Cloud Base
▶︎Post-upgrade steps on CDP
▶︎Post-upgrade steps on CDP for HDF on HDP
1. Configuring YARN settings
▶︎Kafka in-place migration with Ranger
1. Migrating Kafka Ranger policies

»

In-place upgrade

Cloudera Manager installation and setup

After you successfully complete the prerequisites, you can install and configure Cloudera Manager in your cluster.

Checking pre-installation setup
You must ensure that the Ambari blueprint, that you download, contains extended hostgroups with hosts, and hosts and all hostgroups contain host entries.
Configuring Cloudera Manager repository
You need to download the Cloudera Manager repository, configure the repository file, and copy the file on all hosts in the cluster. You configure the repository to deploy Cloudera Manager and daemons on the machines.
Installing Cloudera Manager server and agents
You need to install Cloudera Manager server on the Ambari server host, and Cloudera Manager agents and daemons on all hosts. Otherwise, you will not be able to upgrade your cluster.
Configuring database for Cloudera Manager
You need to configure the database for Cloudera Manager to use.
Starting Cloudera Manager server and adding license
To use Cloudera Manager after the installation, you must start the Cloudera Manager server, open the Cloudera Manager web UI, and add Cloudera Manager license.
Configuring Cloudera agents and hosts
You need to add Cloudera agents and hosts before you perform the HDF upgrade.
Adding Cloudera Management services
You need to add Cloudera Management services before you perform the HDF upgrade.

© 2019–2022 by Cloudera, Inc. All rights reserved.

This site uses cookies and related technologies, as described in our privacy policy, for purposes that may include site operation, analytics, enhanced user experience, or advertising. You may choose to consent to our use of these technologies, or

4.0.0
2.1
2.0
1. 2.0.4
2. 2.0.1