Cloudera Docs

Building your dataflow

Set up the elements of your NiFi dataflow that enables you to move data out of Salesforce using Apache NiFi. This involves opening NiFi in CDP Public Cloud or CDP Private Cloud Base cluster, adding processors to your NiFi canvas, and connecting the processors.

When you are building a dataflow to move data out of Salesforce using Apache NiFi, you use the following source processor to build your dataflow:
  • QuerySalesforceObject
  1. Launch NiFi from your CDP Public Cloud or CDP Private Cloud Base cluster.
  2. Add the NiFi processors to your canvas.
    1. Select the Processor icon from the Cloudera Flow Management Actions pane, and drag a processor to the canvas.
    2. Use the Add Processor filter box to search for the processor you want to add, and then click Add.
    3. Add each of the processors you want to use for your dataflow.
  3. Connect the two processors to create a data flow.
    1. Click the Connection icon for the first processor, and drag it to the second processor.
      A Create Connection dialog displays. It has two tabs: Details and Settings, where you can configure the connection properties.
    2. Click Add to close the dialog box and add the connection to your flow.
      Optionally, you can add success and failure funnels to your data flow, which help you to view where the flow files are routed when your dataflow is running.
After you have finished building the dataflow, move on to the following steps:
  1. Create Controller Services for your dataflow
  2. Configure your source processor
  3. Configure your target processor