What's New in Livy

New features and functional updates for Livy are introduced in Cloudera Runtime 7.3.2, its service packs, and cumulative hotfixes.

Cloudera Runtime 7.3.2.10000 SP1

FIPS 140-3 support with Spark 3

Livy for Spark 3 supports FIPS 140-3 on FIPS-enabled clusters alongside Spark 3 in this service pack.

For configuration details, see Spark and Livy on FIPS 140-3 clusters.

Encryption in transit for Livy Server

Livy for Spark 3 inherits shared Spark 3 configuration from Cloudera Manager and supports TLS for the Livy Server REST API, including TLS 1.3 when your Cloudera Manager TLS policy allows it.

For configuration details, see Encryption in transit for Spark and Livy in Cloudera Runtime 7.3.2.10000 SP1, Configuring TLS/SSL encryption manually for Livy, and Behavioral Changes in Livy.

Cloudera Runtime 7.3.2.100 CHF 1

There are no new features introduced in this release.

Cloudera Runtime 7.3.2.0

Livy for Spark 3 in Cloudera Runtime: Livy for Spark 3 is the Livy service in Cloudera Runtime 7.3.2.0. It submits and manages Spark 3 sessions using the default Apache Spark 3.5.4 runtime shipped with this release.

important

Apache Livy 2 is not available in Cloudera Runtime 7.3.2. Livy for Spark 3 is the supported Livy service.

Refer to Upgrading Spark for more information on upgrading Spark clusters to 7.3.2.0, and Migrating Spark applications for more information on migrating your existing Spark applications between versions 2 and 3.