List of required configuration parameters for the HubSpot to S3/ADLS ReadyFlow
When deploying the HubSpot to S3/ADLS ReadyFlow, you have to provide the following parameters. Use the information you collected in Prerequisites.
Parameter name | Description |
---|---|
CDP Workload User | Specify the CDP machine user or workload username that you want to use to authenticate to the object stores. Ensure this user has the appropriate access rights to the object store locations in Ranger or IDBroker. |
CDP Workload User Password | Specify the password of the CDP machine user or workload user you are using to authenticate against the object stores (via IDBroker). |
CSV Delimiter | If your desired output data is CSV, specify the delimiter here. |
Data Output Format | Specify the desired format for your output data. You can use CSV, JSON or AVRO with this ReadyFlow. |
Destination S3 or ADLS Path | Specify the name of the destination S3 or ADLS path you want to write to. Make sure
that the path starts with "/ ". |
Destination S3 or ADLS Storage Location | Specify the name of the destination S3 bucket or ADLS container you want to write
to. For S3, enter a value in the form: For ADLS, enter a value in the form: |
HubSpot Access Token | Specify the HubSpot access token to authenticate requests. |
HubSpot Object Type | Specify the HubSpot object type to request. An Object Type is prefixed with
/crm/v3/objects/ where the following suffixes are supported:
|
HubSpot Result Limit | Specify the maximum number of results returned by the HubSpot processor (The maximum
you can specify is 100). The default value is |
Include Metadata | Specify whether to return HubSpot fields only or include metadata fields in the result.
Set to Set to The default value is
|
Incremental Delay | Specify a value for this HubSpot processor property to avoid missing objects when the
clocks of your local machines and of HubSpot servers are not in sync. This property is only
used if Incremental Loading is set to true .The
default value is |
Incremental Loading | Specify a value for this HubSpot processor property to decide whether to load queried
objects incrementally. Set to true to query each object exactly once. Set to
false to query each object at least once.The default value is
|