Monitoring Data Explorer database backup

To monitor the Data Explorer database backup, log into the cluster and monitor the job status under the Database Catalog namespace.

The backup-cluster command starts a job to load the database dump file, but does not wait for the job to complete. If you have a large database, the job can take up to an hour to complete. Ensure you allow enough time for the job to succeed.

SSH in to a cluster host as an Administrator.

Run the following command to fetch the details of the backup job:

kubectl get jobs -n [***DATABASE-CATALOG-ID***]

Following is a sample output:

$ kubectl get jobs -n warehouse-1692037411-96hk
  NAME                                              COMPLETIONS   DURATION   AGE
  hue-backup-ede2b8bd-1d53-4d23-a0f9-87d8ec658f74   1/1           11s        113s
  hue-query-processor-db-create-job                 1/1           8s         42h

The Data Explorer backup is stored in the following location:

hdfs://cdw-backups/[***TIMESTAMP***]_[***JOB-ID***]/[***ENVIRONMENT-NAME***]/hue-backup