Fixed issues in Spark

This section lists the issues that have been fixed since the previous version.

CDPD-2650: Spark can't write ZSTD and LZ4 compressed Parquet to dynamically partitioned table.

This issue is resolved.

CDPD-3783: Unable to create database in spark.

This issue is resolved.

CDPD-10532: Update log4j to address CVE-2019-17571

Replaced log4j with an internal version to fix CVE-2019-17571.

CDPD-7882: Spark cannot insert into a Hive table with a subset of partition columns dynamic

This issue is now fixed.

CDPD-7373: Spark - Upgrade to Jetty 9.4.26 to avoid CVEs

Spark now uses Jetty 9.4.26, which addresses the following CVEs: CVE‑2017‑7656, CVE‑2017‑7657,CVE‑2017‑7658, CVE‑2018‑12536, CVE‑2017‑9735, CVE‑2019‑10247.

CDPD-7823: Upgrade to Guava 28.1 to avoid CVE-2018-10237

Spark has been upgraded to use Guava version 28.1 to avoid CVE-2018-10237. Applications that previously depend on old Guava versions (such as guava 11.0.2) may require extensive rewrite to be compatible with Guava 28.1. Applications should ensure they do not introduce older versions of Guava at runtime.

CDPD-10515: Incorrect version of jackson-mapper-asl

Use an internal version of jackson-mapper-asl to address CVE-2017-7525.