Cloudera Data Engineering support for Atlas Lineage for Spark Iceberg tables

Learn about Cloudera Data Engineering support for Atlas Lineage for Spark Iceberg tables.

You can generate Atlas Lineage for Spark Iceberg tables using Cloudera Data Engineering jobs and interactive sessions.

Cloudera Data Engineering automatically captures lineage for the following table creation patterns:

• Create Table As Select (CTAS): Creates a target Iceberg table directly from a source table.
• Create | Insert-Select: Creates an empty target Iceberg table first, then inserts data from a source table.