Supported Airflow operators and hooks
Apache Airflow in Cloudera Data Engineering supports most of the base operators and hooks. Additionally the following third party provider packages and custom operators are installed by default. Additional third party operators can be installed using the Custom Operators and Libraries feature, however their versions must comply with the release-specific constraints file.
Cloudera Data Engineering on cloud version 1.24.1 supports the following components:
- Airflow 2.10.4
- Python 3.11.11
Airflow operators:
Cloudera Data Engineering on cloud version 1.24.1 supports the following Airflow operators:
- airflow.operators.bash
- airflow.operators.branch
- airflow.operators.datetime
- airflow.operators.email
- airflow.operators.empty
- airflow.operators.generic_transfer
- airflow.operators.latest_only
- airflow.operators.python
- airflow.operators.smooth
- airflow.operators.trigger_dagrun
- airflow.operators.weekday
Airflow hooks:
Cloudera Data Engineering on cloud version 1.24.1 supports the following Airflow hooks:
- airflow.hooks.dbapi
- airflow.hooks.filesystem
- airflow.hooks.package_index
- airflow.hooks.subprocess
Airflow provider packages:
- apache-airflow-providers-amazon 9.1.0
- apache-airflow-providers-apache-hive 8.2.1
- apache-airflow-providers-apache-impala 1.5.2
- apache-airflow-providers-celery 3.8.5
- apache-airflow-providers-cncf-kubernetes 10.0.1
- apache-airflow-providers-common-compat 1.2.2
- apache-airflow-providers-common-io 1.4.2
- apache-airflow-providers-common-sql 1.20.0
- apache-airflow-providers-docker 3.14.1
- apache-airflow-providers-elasticsearch 5.5.3
- apache-airflow-providers-fab 1.5.1
- apache-airflow-providers-ftp 3.11.1
- apache-airflow-providers-google 11.0.0
- apache-airflow-providers-grpc 3.6.0
- apache-airflow-providers-hashicorp 3.8.0
- apache-airflow-providers-http 4.13.3
- apache-airflow-providers-imap 3.7.0
- apache-airflow-providers-microsoft-azure 11.1.0
- apache-airflow-providers-mysql 5.7.4
- apache-airflow-providers-odbc 4.8.1
- apache-airflow-providers-openlineage 1.14.0
- apache-airflow-providers-postgres 5.14.0
- apache-airflow-providers-redis 3.8.0
- apache-airflow-providers-sendgrid 3.6.0
- apache-airflow-providers-sftp 4.11.1
- apache-airflow-providers-slack 8.9.2
- apache-airflow-providers-smtp 1.8.1
- apache-airflow-providers-snowflake 5.8.1
- apache-airflow-providers-sqlite 3.9.1
- apache-airflow-providers-ssh 3.14.0
- cloudera-airflow-provider 2.1.4
- cloudera_cdp_airflow_internal 1.0.0
- google-cloud-orchestration-airflow 1.15.1
Cloudera Data Engineering on cloud version 1.23.0 supports the following components:
- Airflow 2.9.3
- Python 3.11.9
Airflow operators:
Cloudera Data Engineering on cloud version 1.23.0 supports the following Airflow operators:
- airflow.operators.bash
- airflow.operators.branch
- airflow.operators.datetime
- airflow.operators.email
- airflow.operators.empty
- airflow.operators.generic_transfer
- airflow.operators.latest_only
- airflow.operators.python
- airflow.operators.smooth
- airflow.operators.trigger_dagrun
- airflow.operators.weekday
Airflow hooks:
Cloudera Data Engineering on cloud version 1.23.0 supports the following Airflow hooks:
- airflow.hooks.dbapi
- airflow.hooks.filesystem
- airflow.hooks.package_index
- airflow.hooks.subprocess
Airflow provider packages:
- apache-airflow-providers-amazon 8.25.0
- apache-airflow-providers-apache-hive 8.1.2
- apache-airflow-providers-apache-impala 1.4.1
- apache-airflow-providers-celery 3.7.2
- apache-airflow-providers-cncf-kubernetes 8.3.3
- apache-airflow-providers-common-io 1.3.2
- apache-airflow-providers-common-sql 1.14.2
- apache-airflow-providers-docker 3.12.2
- apache-airflow-providers-elasticsearch 5.4.1
- apache-airflow-providers-fab 1.2.1
- apache-airflow-providers-ftp 3.10.0
- apache-airflow-providers-google 10.21.0
- apache-airflow-providers-grpc 3.5.2
- apache-airflow-providers-hashicorp 3.7.1
- apache-airflow-providers-http 4.12.0
- apache-airflow-providers-imap 3.6.1
- apache-airflow-providers-microsoft-azure 10.3.0
- apache-airflow-providers-mysql 5.6.2
- apache-airflow-providers-odbc 4.6.2
- apache-airflow-providers-openlineage 1.9.1
- apache-airflow-providers-postgres 5.11.2
- apache-airflow-providers-redis 3.7.1
- apache-airflow-providers-sendgrid 3.5.1
- apache-airflow-providers-sftp 4.10.2
- apache-airflow-providers-slack 8.7.1
- apache-airflow-providers-smtp 1.7.1
- apache-airflow-providers-snowflake 5.6.0
- apache-airflow-providers-sqlite 3.8.1
- apache-airflow-providers-ssh 3.11.2
- cloudera-airflow-provider 2.1.4
- cloudera-cdp-airflow-internal 1.0.0
- google-cloud-orchestration-airflow 1.13.0
Cloudera Data Engineering on cloud version 1.22.0 supports the following components:
- Airflow 2.7.3
- Python 3.8.16
Airflow operators:
Cloudera Data Engineering on cloud version 1.22.0 supports the following Airflow operators:
- airflow.operators.bash
- airflow.operators.branch
- airflow.operators.datetime
- airflow.operators.email
- airflow.operators.empty
- airflow.operators.generic_transfer
- airflow.operators.latest_only
- airflow.operators.python
- airflow.operators.smooth
- airflow.operators.trigger_dagrun
- airflow.operators.weekday
Airflow hooks:
Cloudera Data Engineering on cloud version 1.22.0 supports the following Airflow hooks:
- airflow.hooks.dbapi
- airflow.hooks.filesystem
- airflow.hooks.subprocess
Airflow provider packages:
- apache-airflow-providers-amazon 8.10.0
- apache-airflow-providers-apache-hive 6.2.0
- apache-airflow-providers-apache-impala 1.2.0
- apache-airflow-providers-celery 3.4.1
- apache-airflow-providers-cncf-kubernetes 7.8.0
- apache-airflow-providers-common-sql 1.8.0
- apache-airflow-providers-daskexecutor 1.1.0
- apache-airflow-providers-docker 3.8.0
- apache-airflow-providers-elasticsearch 5.1.0
- apache-airflow-providers-ftp 3.6.0
- apache-airflow-providers-google 10.11.0
- apache-airflow-providers-grpc 3.3.0
- apache-airflow-providers-hashicorp 3.5.0
- apache-airflow-providers-http 4.6.0
- apache-airflow-providers-imap 3.4.0
- apache-airflow-providers-microsoft-azure 8.1.0
- apache-airflow-providers-mysql 5.4.0
- apache-airflow-providers-odbc 4.1.0
- apache-airflow-providers-openlineage 1.2.0
- apache-airflow-providers-postgres 5.7.1
- apache-airflow-providers-redis 3.4.0
- apache-airflow-providers-sendgrid 3.3.0
- apache-airflow-providers-sftp 4.7.0
- apache-airflow-providers-slack 8.3.0
- apache-airflow-providers-snowflake 5.1.0
- apache-airflow-providers-sqlite 3.5.0
- apache-airflow-providers-ssh 3.8.1
- cloudera-airflow-provider 2.1.2
- google-cloud-orchestration-airflow 1.9.2
