Orchestrating workflows and pipelinesPDF version

Supported Airflow operators and hooks

Apache Airflow Python DAG files can be used to automate workflows or data pipelines in Cloudera Data Engineering. Cloudera Data Engineering currently supports a specified list of Airflow operators and hooks that can be used.

Cloudera Data Engineering supports the following Airflow operators:

  • airflow.operators.bash
  • airflow.operators.branch
  • airflow.operators.datetime
  • airflow.operators.email
  • airflow.operators.empty
  • airflow.operators.generic_transfer
  • airflow.operators.latest_only
  • airflow.operators.python
  • airflow.operators.trigger_dagrun
  • airflow.operators.weekday

Cloudera Data Engineering supports the following Airflow hooks:

  • airflow.hooks.filesystem
  • airflow.hooks.package_index
  • airflow.hooks.subprocess