August 27, 2024

This release (1.22.0-h1) of the Cloudera Data Engineering (CDE) service on CDP Public Cloud introduces the following changes.

This release does not contain new features, but includes the following fixes:

DEX-13103: Fix dex-runtime-python-builder to use python 3.8 even for Spark 3.3+

Apache Spark now comes with Python 3.8 installed for versions 3.3 and 3.5.

DEX-14027: Spark 3.5.1 on RAZ; few jobs are failing with error 'org.apache.hadoop.fs.s3a.impl.InstantiationIOException'

Jobs running on RAZ-enabled clusters on Apache Spark 3.5.1 failed with the org.apache.hadoop.fs.s3a.impl.InstantiationIOException error.

DEX-14037: Restore tries to create deleted default VC

When you performed the CDE jobs backup and restore operation, CDE tried to restore a default VC as well that had been deleted before the backup was created. This has been corrected, and now, only those VCs are restored that are included in the Backup archive.

DEX-14231: Allow setting Spark configs to empty & multiple '=' separators values in the UI

You can use the empty value and multiple '=' separator values in the UI for Spark configurations in the create-job and VC-level Spark configurations.

DEX-14313: CDE Backup/Restore Upgrade Does Not Update K8 version

When you performed the CDE jobs backup and restore operation, during the upgrade, the Kubernetes version was not upgraded.

DEX-14412: Runtime API sometimes crashes due to panic: interface conversion: interface {} is cache.DeletedFinalStateUnknown, not *v1.Event

The Runtime API sometimes crashed with the panic: interface conversion: interface {} is cache.DeletedFinalStateUnknown, not *v1.Event error.

DEX-14424: TGT Secret name validation and sanitisation incorrect

The TGT Kerberos tickets are saved as a secret with a name that is based on the CDP username. An issue related to the validation and sanitization of the CDP usernames has been fixed.

DEX-14556: Unhide 1.22 CDP CLI changes related to custom private DNS zone

The CDP CLI commands related to private DNS zones have been made available.