Reference Amazon S3 in URIs

The protocol in the URI must be specified when Amazon S3 service is added.

By default, files are still placed on the local HDFS and not on S3 if the protocol is not specified in the URI.

Use one of the following options to construct the URIs to reference when submitting jobs:
  • Amazon S3:
    s3a://bucket_name/path
  • HDFS:
    hdfs://path
    or
    /path