Moving data with NiFi using Flow Management clusters in Data Hub

You can find here comprehensive documentation on data movement using Apache NiFi in CDP Public Cloud. You can use Flow Management Data Hub clusters to ingest data into various locations within CDP Public Cloud or transfer data between Public Cloud and Private Cloud. These use cases provide step-by-step instructions to help you achieve your data integration goals. From setting up data flows and addressing security requirements to configuring processors and controller services, these guides cover all aspects of building efficient and secure data movement pipelines in Data Hub.

Ingesting Data into HBase in CDP Public Cloud

Describes how to use an Apache NiFi data flow to ingest data into Apache HBase in CDP Public Cloud.

Ingesting Data into Hive in CDP Public Cloud

Describes how to use an Apache NiFi data flow to ingest data into Apache Hive in CDP Public Cloud.

Ingesting Data into Kafka in CDP Public Cloud

Describes how to use an Apache NiFi data flow to ingest data into Apache Kafka in CDP Public Cloud.

Ingesting Data into Kudu in CDP Public Cloud

Describes how to use an Apache NiFi data flow to ingest data into Apache Kudu in CDP Public Cloud.

Ingesting Data into Solr in CDP Public Cloud

Describes how to use an Apache NiFi data flow to ingest data into Apache Solr in CDP Public Cloud.

Ingesting data into CDW using Iceberg table format

Describes how to use an Apache NiFi data flow to ingest data in Iceberg table format into Cloudera Data Warehouse in CDP Public Cloud.

Processing mainframe / EBCDIC data in NiFi [Technical Preview]

Describes how to use Apache NiFi to process mainframe data encoded in the EBCDIC scheme while building dataflows in CDP Public Cloud.

Ingesting Data into Amazon S3 Buckets

Describes how to use an Apache NiFi data flow to ingest data into Amazon S3 buckets in CDP Public Cloud.

Ingesting Data into Azure Data Lake Storage

Describes how to use an Apache NiFi data flow to ingest data into Azure Data Lake Storage in CDP Public Cloud.

Ingesting Data into Google Cloud Storage

Describes how to use an Apache NiFi data flow to ingest data into Google Cloud Storage in CDP Public Cloud.

Ingesting Data into Cloud Object Stores with RAZ Authorizations

Describes how to use an Apache NiFi data flow to ingest data into Cloud object stores with RAZ authorization in CDP Public Cloud.

Moving data in and out of Snowflake

Describes how to use an Apache NiFi data flow to pull data out of Snowflake and push data into Snowflake in CDP Public Cloud.

Moving data using NiFi site-to-site

Describes how to use an Apache NiFi data flow to move data from CDP Private Cloud Base to CDP Public Cloud with NiFi site-to-site.