Creating a new Iceberg table from Spark 3
In Cloudera Data Engineering (CDE), you can create a Spark job that creates a new Iceberg table or import an existing Hive table. Once created, the table can be used for subsequent operations.
An example Spark SQL creation command to create a new Iceberg table is as
follows:
spark.sql("""CREATE EXTERNAL TABLE ice_t (idx int, name string, state string)
USING iceberg
PARTITIONED BY (state)""")
For information about creating tables, see the Iceberg documentation.