Deployment Scenarios
Your deployment scenario for installing, configuring, or upgrading your Hortonworks DataFlow (HDF) components depends on your particular use case.
Scenario | Installation Scenario | Steps |
---|---|---|
This scenario applies if you want to install the entire HDF platform, consisting of all flow management and stream processing components on a new cluster. The stream processing components include the new Streaming Analytics Manager (SAM) modules that are in GA (General Availability). This includes the SAM Stream Builder and Stream Operations modules but does not include installing the technical preview version of SAM Stream Insight, which is powered by Druid and Superset. This scenario requires that you install an HDF cluster. |
|
|
This scenario applies to you if you are both an Hortonworks Data Platform (HDP) and HDF customer and you want to install a fresh cluster of HDP and add HDF services. The stream processing components include the new (SAM) and all of its modules. This includes installing the technical preview version of the SAM Stream Insight module, which is powered by Druid and Apache Superset. This scenario requires that you install both an HDF cluster and an HDP cluster. |
|
|
You have an existing HDP cluster with Apache Storm and or Apache Kafka services and want to install Apache NiFi or NiFi Registry modules on that cluster. This requires that you upgrade to the latest version of Apache Ambari and HDP, and then use Ambari to add HDF services to the upgraded HDP cluster. |
|
Scenario | Upgrade Scenario | Documentation |
---|---|---|
Upgrading an HDF-only cluster |
You have an existing Ambari-managed HDF cluster and want to upgrade it using an Express upgrade. |
Resources for each upgrade scenario are available in the Ambari-Managed HDF Upgrade Guide. |
Upgrading HDF 3.1.x services on an HDP cluster. |
You have an existing Ambari-managed HDP cluster with HDF 3.1.x services installed. In the HDF 3.1.x release, NiFi and NiFi Registry were available to install on HDP. You want to upgrade your HDP cluster to HDP 3.0.0 and you want to upgrade your HDF services to the services available with HDF 3.2.0. |
|
Upgrading an HDP cluster with HDF 3.0.x |
You have an existing Ambari-managed HDP cluster with HDF 3.0.x services installed. In the HDF 3.0.x release, NiFi, SAM, and Schema Registry were available to install on HDP. |