Scaling storage on Kudu master and tablet servers in the cloud

If you find that the size of your Kudu cloud deployment has exceeded previous expectations, or you simply wish to allocate more storage to Kudu, use the following set of high-level steps as a guide to increasing storage on your Kudu master or tablet server hosts. You must work with your cluster's Hadoop administrators and the system administrators to complete this process. Replace the file paths in the following steps to those relevant to your setup.

  1. Run a consistency check on the cluster hosts using ksck.
  2. On all Kudu hosts, create a new file system with the storage capacity you require. For example, /new/data/dir.
  3. Shutdown the cluster services. For a cluster managed by Cloudera Manager, see Stopping a cluster.
  4. Copy the contents of your existing data directory, /current/data/dir, to the new filesystem at /new/data/dir.
  5. Move your existing data directory, /current/data/dir, to a separate temporary location such as /tmp/data/dir.
  6. Create a new /current/data/dir directory.
    mkdir /current/data/dir
  7. Mount /new/data/dir as /current/data/dir. Make changes to fstab as needed.
  8. Perform steps 4-7 on all Kudu hosts.
  9. Startup cluster services.
  10. Run a consistency check on the cluster hosts using ksck.
  11. After 10 days, if everything is in working order on all the hosts, get approval from the Hadoop administrators to remove the /backup/data/dir directory.