Planning your deployment
Also available as:
PDF

Deployment Scenarios

Your deployment scenario for installing, configuring, or upgrading your Hortonworks DataFlow (HDF) components depends on your particular use case.

Table 1. Installation Scenarios
Scenario Installation Scenario Steps

Installing an HDF Cluster

This scenario applies if you want to install the entire HDF platform, consisting of all flow management and stream processing components on a new cluster.

The stream processing components include the new Streaming Analytics Manager (SAM) modules that are in GA (General Availability). This includes the SAM Stream Builder and Stream Operations modules but does not include installing the technical preview version of SAM Stream Insight, which is powered by Druid and Superset.

This scenario requires that you install an HDF cluster.

  1. Install Ambari.
  2. Install databases.
  3. Install the HDF management pack.
  4. Install an HDF cluster using Ambari.

Installing HDF Services on a New HDP Cluster

This scenario applies to you if you are both an Hortonworks Data Platform (HDP) and HDF customer and you want to install a fresh cluster of HDP and add HDF services.

The stream processing components include the new (SAM) and all of its modules. This includes installing the technical preview version of the SAM Stream Insight module, which is powered by Druid and Apache Superset.

This scenario requires that you install both an HDF cluster and an HDP cluster.

  1. Install Ambari.
  2. Install databases.
  3. Install an HDP cluster using Ambari.
  4. Install the HDF management pack.
  5. Update the HDF base URL.
  6. Add HDF services to an HDP cluster

Installing HDF Services on an Existing HDP Cluster

You have an existing HDP cluster with Apache Storm and or Apache Kafka services and want to install Apache NiFi or NiFi Registry modules on that cluster.

This requires that you upgrade to the latest version of Apache Ambari and HDP, and then use Ambari to add HDF services to the upgraded HDP cluster.

  1. Upgrade Ambari
  2. Upgrade HDP
  3. Install Databases
  4. Install HDF Management Pack
  5. Update HDF Base URL
  6. Add HDF Services to HDP cluster
Table 2. Upgrade Scenarios
Scenario Upgrade Scenario Documentation

Upgrading an HDF-only cluster

You have an existing Ambari-managed HDF cluster and want to upgrade it using an Express upgrade.

Resources for each upgrade scenario are available in the Ambari-Managed HDF Upgrade Guide.

Upgrading HDF 3.4.x services on an HDP cluster.

You have an existing Ambari-managed HDP cluster with HDF 3.4.x services installed. In the HDF 3.4.x release, NiFi and NiFi Registry were available to install on HDP.

You want to upgrade your HDP cluster to HDP 3.1.5 and you want to upgrade your HDF services to the services available with HDF 3.5.1.

Upgrading an HDP cluster with HDF 3.3.x

You have an existing Ambari-managed HDP cluster with HDF 3.3.x services installed. In the HDF 3.3.x release, NiFi, SAM, and Schema Registry were available to install on HDP.