Creating an Ozone bucket and installing AWS CLI

Learn how to create an Ozone bucket under the s3v volume, upload a sample text file, and install the AWS CLI utility.

  • Ensure you have SSH access to the target server with root or other required permissions.
  • Valid Kerberos keytab file for the hdfs principal located at /cdep/keytabs/hdfs.keytab.
  1. Open a terminal and connect to the cluster host using SSH:
    ssh root@[***CLOUDERA_MANAGER_HOST_NAME***]

    Example,

    ssh root@cm_hostname_1.example.com
  2. When prompted, enter the password.
  3. Authenticate as the hdfs user in Kerberos using the keytab:
    kinit -kt /cdep/keytabs/hdfs.keytab hdfs
  4. Create a bucket:
    ozone sh bucket create /[***VOLUME_NAME***]/[***BUCKET_NAME***]

    Example,

    ozone sh bucket create /s3v/iceberg
  5. Create a sample text file for testing:
    echo "string for demo" > ./[***FILE_NAME***].txt

    Example,

    echo "string for demo" > ./demotest.txt
  6. Upload the test file to the bucket:
    ozone sh key put /[***VOLUME_NAME***]/[***BUCKET_NAME***]/[***FILE_NAME***].txt ./[***FILE_NAME***].txt

    Example,

    ozone sh key put /s3v/iceberg/demotest.txt ./demotest.txt
  7. Download and install the AWS CLI package on the server:
    curl "https://awscli.amazonaws.com/[***AWS_PACKAGE_NAME***]" -o "awscliv2.zip"
    unzip awscliv2.zip
    sudo ./aws/install

    Example for a Linux server:

    curl "https://awscli.amazonaws.com/awscli-exe-linux-x86_64.zip" -o "awscliv2.zip"
    unzip awscliv2.zip
    sudo ./aws/install