Deploy a flow definition

Learn about the steps to deploy a flow definition so that you can start to run and monitor flow deployments within Cloudera DataFlow.

Once you import a flow definition into the Catalog, stay in the Catalog and use the Deployment wizard to deploy a version of that flow definition. The Deployment wizard only displays environments:

  • For which DataFlow is enabled
  • That are in a healthy state
  • To which you have access

  • You have an enabled and healthy CDF environment.

  • You have imported at least one flow definition.

  • You have been assigned the DFCatalogAdmin role granting you access to the Catalog.

  • You have been assigned the DFFlowAdmin role for the environment to which you want to deploy the flow definition.

  1. Launch the Deployment wizard.
    • Click the row to display the flow definition details and versions.

    • Click on a row representing a flow definition version to display flow definition version details and the Deploy New Flow button.

    • Click Deploy New Flow to launch the Deployment wizard.

  2. From the Deployment wizard, select the environment to which you want to deploy this version of your flow definition.
  3. From the Overview, give your flow deployment a unique name.
  4. In Parameters, specify parameter values like connection strings, usernames and similar, and upload files like truststores, and similar.
  5. In Sizing and Scaling, specify your initial flow deployment size, whether to enable auto-scaling, and up to how many nodes:
    • The size of your NiFi nodes from Extra Small to Large

    • Whether you want to automatically scale your cluster according to flow deployment resource utilization.

    • The number of nodes from 1 to 64

  6. In KPIs, identify key performance indicators, the metrics to track those KPIs, and when and how to receive alerts about the KPI metrics tracking.
  7. Review a summary of the information provided and make any necessary edits by clicking Previous. When you are finished, complete your flow deployment by clicking Deploy.

Once you click Deploy, you are being redirected to the Alerts tab in the detail view for the deployment where you can track its progress.