Comparing NiFi deployment types
NiFi 2 represents a major milestone for Apache NiFi, introducing several significant new features and including a powerful Python API for developing native NiFi components using Python. However, upgrading from NiFi 1 to NiFi 2 involves substantial breaking changes, making migration complex and challenging.
Cloudera Flow Management is a data ingestion and management solution powered by Apache NiFi that delivers highly scalable data movement, transformation, and management capabilities to the enterprise. It offers Cloudera-specific components on top of Apache NiFi to maintain compatibility with Cloudera’s ecosystem.
When using NiFi in Cloudera Flow Management, you also gain access to the Cloudera Flow Management Migration Tool, which simplifies and accelerates the transition from NiFi 1 to NiFi 2.
As part of the transition from NiFi 1 to NiFi 2, Cloudera is moving a large number of components downstream that were removed from the open-source Apache NiFi project. These adjustments aim to provide better support for Cloudera customers by aligning with specific Cloudera technologies and minimizing disruptive changes.
- Hive components: NiFi in Cloudera Flow Management includes Hive components built against Cloudera’s version of Hive, which has diverged from Apache Hive, ensuring compatibility with Cloudera’s ecosystem.
- Kafka components: Cloudera has retained Kafka 2.6 components in Cloudera Flow Management to facilitate smoother transitions from legacy Kafka components to the new Kafka architecture based on controller services, reducing the risk of breaking changes.
For more information, see Breaking changes in NiFi 2.
