Extraction Command

The extractor script is located in the extractors/bin directory in $ATLAS_HOME.

By default, the location is /opt/cloudera/parcels/CDH/lib/atlas/extractors/bin/aws-s3-extractor.sh

Using the following command to start S3 extraction:

$ aws-s3-extractor.sh [--config <config file>]
                      [--extraction <mode>] 
                      [--failOnError]
                      [--logdir <log directory>]


Command Line Option	Description
`-c <config file> --config <config file>`	The path of the configuration file containing extraction configuration properties. See Extractor configuration properties. Defaults to `$ATLAS_HOME/extractors/conf/aws-s3.conf`
`-e <mode> --extraction <mode>`	The type of extraction to be done, “Incremental” or “Bulk”. If not specified, the extraction mode is "Bulk".
`-f` `--failOnError`	Flag to set the extraction to stop when it encounters an exception. Without the flag, the extraction continues after exceptions.