Cloudera Docs

Running Airflow jobs using Cloudera Data Engineering

Jobs in Cloudera Data Engineering (CDE) can be run on demand, or scheduled to run on an ongoing basis. Learn about how to run a job in CDE.

  1. In the Cloudera Data Platform (CDP) management console, click the Data Engineering tile and click Overview.
  2. In the CDE Services column, select the environment containing the virtual cluster where you want to run the job.
  3. In the Virtual Clusters column on the right, click the View Jobs icon on the virtual cluster containing the job you want to run.
  4. To run a job immediately, click in the Actions column next to the job, and then click Run Now. The job must not be paused. If the Job is paused, there is an option named Resume Schedule in the menu, which allows you unpause it.

    Job Run Notices: The running jobs provide notifications, in the form of a Bell icon next to the Job Run ID, when certain conditions are met, without having to parse low level logs, or navigating away to a cloud provider or Kubernetes interface. This allows you to identify why certain job is running slow or stuck, and take actions to rectify this.