Cloud Data Access
Also available as:
PDF
loading table of contents...

Configuring Multithread Support

Rename and delete blob operations on directories with a large number of files and sub directories are currently very slow as these operations are done serially, one blob at a time. These files and sub-folders can be deleted or renamed parallel. The following configurations can be used to enable threads to do parallel processing:

Delete

To enable 10 threads for delete operation, set the following configuration value in core-site.xml:

<property>
  <name>fs.azure.delete.threads</name>
  <value>10</value>
</property>

To disable threads, set it to 0 or 1. The default behavior is threads disabled.

Rename

To enable 20 threads for "rename" operation, set the following configuration value in core-site.xml:

<property>
  <name>fs.azure.rename.threads</name>
  <value>20</value>
</property>

To disable threads, set it to 0 or 1. The default behavior is threads disabled.