Managing Cloudera Data Engineering jobs
Creating Jobs
Support for Spark Structured Streaming in Cloudera Data Engineering (Technical Preview)
CDE example jobs and sample data
Accessing Amazon S3 data
Using Apache Iceberg
Prerequisites and limitations for using Iceberg
Accessing Iceberg tables
Editing a storage handler policy to access Iceberg files on the file system
Creating a SQL policy to query an Iceberg table
Creating Virtual Cluster with Spark 3
Creating a new Iceberg table from Spark 3
Configuring Hive Metastore for Iceberg column changes
Importing and migrating Iceberg table in Spark 3
Importing and migrating Iceberg table format v2
Configuring Catalog
Loading data into an unpartitioned table
Querying data in an Iceberg table
Updating Iceberg table data
Iceberg library dependencies for Spark applications
Creating a Git repository in Cloudera Data Engineering (Technical Preview)
Managing jobs
Running jobs
Scheduling Jobs
Creating ad-hoc jobs
Configuring logging in jobs
Deleting Jobs
Best practices for building Apache Spark applications