Cloudera Docs

List of required configuration parameters for the Salesforce filter to S3/ADLS ReadyFlow

When deploying the Salesforce filter to S3/ADLS ReadyFlow, you have to provide the following parameters. Use the information you collected in Prerequisites.

Table 1. Salesforce filter to S3/ADLS ReadyFlow configuration parameters
Parameter Name Description
Age Field Specify the name of a TIMESTAMP field that will be used to filter records using a bounded time window. The QuerySalesforceObject processor will return only those records with a timestamp value newer than the timestamp recorded after the last processor run.
CDP Workload User Specify the Cloudera machine user or workload username that you want to use to authenticate to the object stores. Ensure this user has the appropriate access rights to the object store locations in Ranger or IDBroker.
CDP Workload User Password Specify the password of the Cloudera machine user or workload user you are using to authenticate against the object stores (via IDBroker).
CSV Delimiter If your source data is CSV, specify the delimiter here.
Data Output Format Specify the desired format for your output data. You can use CSV, JSON or AVRO with this ReadyFlow.
Destination S3 or ADLS Path Specify the name of the destination S3 or ADLS path you want to write to. Make sure that the path starts with "/".
Destination S3 or ADLS Storage Location Specify the name of the destination S3 bucket or ADLS container you want to write to.
  • For S3, enter a value in the form: s3a://[***Destination S3 Bucket***]
  • For ADLS, enter a value in the form: abfs://[***Destination ADLS File System***]@[***Destination ADLS Storage Account***].dfs.core.windows.net
Filter Rule

Specify the filter rule expressed in SQL to filter events for the destination object store.

Records matching the filter will be written to the destination object store. The default value forwards all records.
Salesforce Consumer Key Specify your Salesforce consumer key.
Salesforce Consumer Secret Specify your Salesforce consumer secret.
Salesforce Domain Name Specify your Salesforce domain name.
Salesforce Field Names Specify the field names requested from the sObject to be queried as a comma separated list.
Salesforce Password and Security Token Specify your Salesforce password concatenated with your Salesforce security token.
Salesforce Username Specify your Salesforce username.
Salesforce sObject Name Specify the Salesforce sObject to be queried.