Configuring Multithread Support
Rename and delete blob operations on directories with a large number of files and sub directories are currently very slow as these operations are done serially, one blob at a time. These files and sub-folders can be deleted or renamed parallel. The following configurations can be used to enable threads to do parallel processing:
Delete
To enable 10 threads for delete operation, set the following configuration value in
core-site.xml
:
<property> <name>fs.azure.delete.threads</name> <value>10</value> </property>
To disable threads, set it to 0 or 1. The default behavior is threads disabled.
Rename
To enable 20 threads for "rename" operation, set the following configuration value in
core-site.xml
:
<property> <name>fs.azure.rename.threads</name> <value>20</value> </property>
To disable threads, set it to 0 or 1. The default behavior is threads disabled.