List of required configuration parameters for the Airtable to S3/ADLS ReadyFlow

When deploying the Airtable to S3/ADLS ReadyFlow, you have to provide the following parameters. Use the information you collected in Prerequisites.

Table 1. Airtable to S3/ADLS ReadyFlow configuration parameters
Parameter name Description
Airtable API Key Specify your Airtable API key.
Airtable Base ID Specify the ID of the Airtable base to be queried.
Airtable Field Names Specify the field names requested from the Airtable table to be queried as a comma separated list.
Airtable Table ID or Name Specify the ID or name of the Airtable table to be queried.
CDP Workload User Specify the CDP machine user or workload username that you want to use to authenticate to the object stores. Ensure this user has the appropriate access rights to the object store locations in Ranger or IDBroker.
CDP Workload User Password Specify the password of the CDP machine user or workload user you are using to authenticate against the object stores (via IDBroker).
CSV Delimiter If your desired output data is CSV, specify the delimiter here.
Data Output Format Specify the desired format for your output data. You can use CSV, JSON or AVRO with this ReadyFlow.
Destination S3 or ADLS Path Specify the name of the destination S3 or ADLS path you want to write to. Make sure that the path starts with "/".
Destination S3 or ADLS Storage Location Specify the name of the destination S3 bucket or ADLS container you want to write to.
  • For S3, enter a value in the form: s3a://[***Destination S3 Bucket***]
  • For ADLS, enter a value in the form: abfs://[***Destination ADLS File System***]@[***Destination ADLS Storage Account***].dfs.core.windows.net
Include Metadata Specify whether to return Airtable fields only or include metadata fields in the result.

Set to "true" to include metadata fields in the result. Airtable fields will be stored in the "fields" field.

Set to "false" to include only Airtable fields in the result.

The default value is "true".