Accessing Cloud Data
Also available as:
PDF
loading table of contents...

Using the Directory Committer in MapReduce

Once the propertyfs.s3a.committer.name is set, Hadoop MapReduce jobs writing to paths using the s3a:// schema will automatically switch to the new committers.

Jobs using any other filesystem as a destination will still use the normal file committer.