Cloudera Docs

Configuring your source processor

You use the QuerySalesforceObject processor to get data from your Salesforce table. To do this, launch the Configure Processor window, specify the necessary configurations, and start the process to verify that you can view the Salesforce table.

  • You must have built the dataflow.
  • You must have created your controller services.
  1. Launch the Configure Process window, by right-clicking the processor and selecting Configure.
  2. Go to the Properties tab.


  3. Enter the value for URL.

    You can obtain the base URL from the Salesforce account profile menu and prefix it with https://.

  4. Enter the value for API Version.

    This is the Salesforce REST API version. For more information, see Introduction to REST API.

  5. Specify the value for sObject.

    The sObject name specifies the Salesforce object to be queried.

  6. Specify the value(s) for Field Names.

    The field names are the Salesforce object's fields. Due to Salesforce limitations, it cannot be empty in order to obtain every field of an entity.

  7. Set the value for Age Field.

    The age property is important if you only want to query and process a record once. It provides a sliding window that starts with the processor’s prior runtime and ends with the current runtime minus the age delay. Only records that are within the sliding window are queried and processed.

    You need to define how to compare the records with the runtime. The Age Field property must be a datetime field of the queried object and this is subject to the condition that it is greater than the processor's previous runtime but less than the current runtime (for example, LastModifiedDate).

    The first run, for example, queries records whose LastModifiedDate field is earlier than the current runtime. The second run looks for records with LastModifiedDate fields that are later than the previous runtime but earlier than the current runtime.


    The Initial Age Filter is used to specify a specific datetime that sets the start of the sliding window from which processing starts in the first processor run. The format must meet the Salesforce SOQL standards. The Initial Age Filter is used to provide a specific datetime that sets the beginning of the sliding window from which processing occurs in the first processor run. Here, the format must adhere to the Salesforce SOQL requirements. For more information, see SOQL and SOSL Reference.

    The purple line in the above image represents Age Delay. It moves the time of the records to be processed earlier than the current runtime if necessary.

You can confirm that you have configured QuerySalesforceObject correctly by starting the processor and confirming that you can view the Salesforce table.
After you have finished configuring your source processor, proceed to:
  • Configure your target processor.
  • Confirm your data flow is running.