Test access to ADLS Gen1

To test access to ADLS Gen1, SSH to a cluster node and run a few hadoop fs shell commands against your existing storage account.

To test access, SSH to any cluster node and switch to the hdfs user by using sudo su hdfs.

ADLS access path syntax is:

adl://account_name.azuredatalakestore.net/dir/file

For example, the following Hadoop FileSystem shell commands demonstrate access to a storage account named “myaccount”:

hadoop fs -mkdir adl://myaccount.azuredatalakestore.net/testdir
hadoop fs -put testfile adl://myaccount.azuredatalakestore.net/testdir/testfile

To use DistCp against ADLS Gen1, use the following syntax:

hadoop distcp
    [-D hadoop.security.credential.provider.path=localjceks://file/home/user/adls.jceks]
    hdfs://namenode_hostname:9001/user/foo/007020615
    adl://myaccount.azuredatalakestore.net/testDir/

For more information about configuring the adl connector and working with data stored in ADLS Gen1, refer to Cloud Data Access HDP documentation.