Apache Iceberg in Cloudera Data Platform

Apache Iceberg is a cloud-native, high-performance open table format for organizing petabyte-scale analytic datasets on a file system or object store. Combined with Cloudera Data Platform (CDP), users can build an open data lakehouse architecture for multi-function analytics and to deploy large scale end-to-end pipelines.

Open data lakehouse on CDP simplifies advanced analytics on all data with a unified platform for structured and unstructured data and integrated data services to enable any analytics use case from ML, BI to stream analytics and real-time analytics. Apache Iceberg is the secret sauce of the open lakehouse.

The following table shows the support for Iceberg in CDP and below the table Iceberg versions v1 and v2 are defined:

Table 1. Iceberg Support Matrix

Release	Iceberg support level	SQL Engine
		Impala	Hive	Spark	NiFi	Flink
Public Cloud Data Services	GA	v1, v2: create table, read, insert, delete, update	v1, v2: create table, read, insert, update, and delete	v1, v2: create table, read, insert, update, and delete	v1, v2: read and insert	N/A
Data Hub 7.2.16.2	GA	v1, v2: create table, read	v1: create table, read, insert, update, delete	v1, v2: create table, read, insert, update, and delete	v1, v2: read and insert	v1: create table, read, and insert
Data Hub 7.2.17	GA	v1, v2: create table, read, insert,	v1, v2: create table, read, insert, update, delete	v1, v2: create table, read, insert, update, and delete	v1, v2: read and insert	v1, v2: create table, read, append, overwrite ***
Data Hub 7.2.18	GA	v1, v2: create table, read, insert, update, and delete	v1, v2: create table, read, insert, update, delete	v1, v2: create table, read, insert, update, and delete	v1, v2: read and insert	v1, v2: create table, read, append, overwrite ***
Private Cloud Data Services 1.5.1 2023.0.13.0-20	Technical Preview (7.1.7 Base, 7.1.8 Base)	v1, v2: create table, read	v1, v2: create table, read, insert, update, and delete	v1, v2: create table, read, insert, update, and delete	No Private Cloud support	No Private Cloud support
Private Cloud Data Services 1.5.2	GA (7.1.9 Base) Technical Preview (7.1.7 Base, 7.1.8 Base)	v1, v2: create table, read, insert, and delete	v1, v2: create table, read, insert, update, and delete	v1, v2: create table, read, insert, update, and delete	v1, v2: read and insert (7.1.9 Base)	v1, v2: create table, read, and insert (7.1.9 Base)
Private Cloud Data Services 1.5.3	GA (7.1.9 Base) Technical Preview (7.1.7 Base, 7.1.8 Base)	v1, v2: create table, read, insert, update, and delete	v1, v2: create table, read, insert, update, and delete	v1, v2: create table, read, insert, update, and delete	v1, v2: read and insert (7.1.9 Base)	v1, v2: create table, read, and insert (7.1.9 Base)
Base 7.1.7 SP2, 7.1.8	No Iceberg support
Base 7.1.9	GA	v1, v2: create table, read, insert	No Iceberg support	v1, v2: create table, read, insert, update, and delete	v1, v2: read and insert	v1, v2: create table, read, and insert

** The support for delete operations, except from Flink, shown in this table is limited to position deletes. Equality deletes are not supported in these releases except from Flink.

*** Iceberg v2 updates and deletes from Flink are a technical preview in CDP Public Cloud 7.2.17.