Cloudera Docs

Downloading Hive diagnostic bundles in Data Warehouse Private Cloud

You can download diagnostic bundles for troubleshooting a Hive Virtual Warehouse in Cloudera Data Warehouse (CDW) Private Cloud. The diagnostic bundles contain log files for the sidecar containers that support Hive components and for the components themselves. These diagnostic bundles are stored on HDFS in the form of ZIP files.

The log files are generated when you run some workloads on your Hive Virtual Warehouse.
  1. Log in to the Data Warehouse service as a DWAdmin.
  2. Go to a Hive Virtual Warehouse and click > Collect Diagnostic Bundle.
    The options for generating the diagnostic bundles are displayed as shown in the following image:

    Image showing the various options for generating Hive diagnostic bundles.
  3. Select the time period for which you want to generate the logs.
    • Select the By Time Range option to generate logs from last 30 minutes, one hour, 12 hours, or 24 hours.
    • Select By Custom Time Interval option to generate logs for a specific time period based on your requirement.
  4. Select the categories for which you want to generate the logs by selecting the options from the Collect For section.
    By default, ERRORDUMP, GCLOG, HEAPDUMP, HMS, LOGS, CRINFO, K8S-RESOURCE-INFO are selected. Click X to remove the ones you do not need.
    • ERRORDUMP contains exceptions from the containers
    • CGLOG contains JVM garbage collector-related logs
    • HEAPDUMP contains JVM heapdump
    • HMS contains sidecar container logs that support the metastore
    • LOGS contains logs of Hive, Coordinator, and Executor processes and their supporting containers
  5. Optional: Select the Run even if there is an existing job option to trigger another diagnostic bundle creation when one job is running.
  6. Click Collect.
    The following message is displayed: Collection of Diagnostic Bundle for compute-1651060643-c97l initiated. Please go to details page for more information.
  7. Go to the Virtual Warehouses details page by clicking > Edit.
  8. Go to the DIAGNOSTIC BUNDLE tab.
    The jobs that have been triggered for generating the diagnostic bundles are displayed, as shown in the following image:

    Image showing the DIAGNOSTIC BUNDLE tab from which you can download the logs and see the status of the job for generating the diagnostic bundle.
  9. Click on the link in the Location column to download the diagnostic bundle to your computer.