Accessing Cloud Data
Also available as:
PDF
loading table of contents...

Enabling Speculative Execution

The S3A committers all support speculative execution

For MapReduce, enable the following properties in the job:

mapreduce.map.speculative true
mapreduce.reduce.speculative true

For Spark, set the following configuration option:

spark.speculation true