Cloudera Data Engineering Private Cloud 1.5.4 SP1

Review the features, fixes, and known issues in the Cloudera Data Engineering 1.5.4 Service Pack 1 release.

What's new in 1.5.4 SP1

This section lists the new features added in this release for Cloudera Data Engineering Private Cloud.

Support for SAML authentication: Cloudera Data Engineering supports users to configure using SAML as Identity Provider along with LDAP. For more information about how to configure users using SAML authentication, see Configuring users for Identity Providers.

This section lists the current known issues and limitations that you might run into while using the Cloudera Data Engineering service.

DEX-15429: Data connectors jobs are failing with "UNKNOWN: Channel Pipeline: [ProtocolNegotiators$ProxyProtocolNegotiationHandler#0, WriteBufferingAndExceptionHandler#0" in the proxy setup: Ozone data connector does not work when proxy is enabled.; Add the IP addresses of all the base cluster nodes to the NO_PROXY list so that request to Ozone does not use proxy.
DEX-15472: Cloudera Data Engineering service upgrade fails during backup and restore when SAML is enabled: Script-based upgrade of Cloudera Data Engineering service doesn't not work when SAML is enabled.; Make sure that the Cloudera Data Engineering service is upgraded using the dex-upgrade-utils solution before enabling the SAML (both IdP and SP initiated) in the Control Plane.

Review the list of issues that are resolved in the Cloudera Data Engineering (CDE) service in the CDP Data Services 1.5.4 SP1 release.

DEX-14484: PvC DS- Fix dex-runtime-python-builder to use python 3.8 even for Spark 3.3+: In Spark 3.3.2 virtual cluster, Python 3.8 is now used in Python virtual environment resource instead of old Python 3.6 which is not supported in Spark 3.3 or higher.