Accessing Cloud Data
Also available as:
PDF
loading table of contents...

Accelerating Azure Read Performance

The Azure WASB connector uses the same dynamic read policy as the S3A “normal” policy: files are opened for sequential IO, switching to random IO if the client application starts to make random IO calls.

The Azure ADL connector always reads data in blocks of the byte size set by the configuration option adl.feature.client.cache.readahead; the default value is 4194304, that is, four megabytes.