Logs for Cloudera AI Workbenches

You can access logs to troubleshoot issues with the Cloudera AI service and your workloads on Cloudera AI Workbenches.

Access to logs

When you create a Cloudera Data Platform environment, you specify an S3 bucket (on AWS) or an Azure Storage container (on Azure) in that environment for storing logs. If you have access to the log storage, you can use the AWS or Azure console to access certain Cloudera AI and Spark logs directly. You can get the details of the specific bucket or container from the Troubleshooting Cloudera AI Workbenches on AWS page for the environment.

Cloudera AI Workbench access to logs

Cloudera AI Workbench users also have access to these logs depending on their authorization level:

  • Site Administrators

    Site administrators can download the same logs directly from their workbench Site Admin panel (Admin > Support). For more details, see Downloading diagnostic bundles for a workbench.

  • Data Scientists

    While data scientists do not have access to the full set of workbench logs, they do have access to engine logs for their own workloads (sessions/jobs/experiments). While in an interactive session or on a job/experiment's Overview page, click Download Logs at any time to review the full set of logs for that workload's engine. In the case of Spark workloads, Spark executor and event logs are also downloaded as part of this bundle.