Cloudera Docs

Supported Airflow operators and hooks

Apache Airflow Python DAG files can be used to automate workflows or data pipelines in Cloudera Data Engineering (CDE). Cloudera Data Engineering currently supports a specified list of Airflow operators and hooks that can be used.

Airflow operators

Cloudera Data Engineering supports the following Airflow operators:

  • airflow.operators.bash
  • airflow.operators.branch
  • airflow.operators.datetime
  • airflow.operators.email
  • airflow.operators.empty
  • airflow.operators.generic_transfer
  • airflow.operators.latest_only
  • airflow.operators.python
  • airflow.operators.trigger_dagrun
  • airflow.operators.weekday

Airflow hooks

Cloudera Data Engineering supports the following Airflow hooks:

  • airflow.hooks.filesystem
  • airflow.hooks.package_index
  • airflow.hooks.subprocess