Spark 2 Incompatible Changes

The following sections describe changes in CDS 2 Powered by Apache Spark that might require special handling during upgrades, or code changes within existing applications.

Continue reading:

Incompatible Changes in CDS 2.1

No new incompatible changes in this release.

Incompatible Changes in CDS 2.0

  • HiveContext and SQLContext have been removed.

  • DataFrames have been removed from the Scala API. DataFrame is now a special case of Dataset.

  • Spark 2.0 and higher do not use an assembly JAR for standalone applications.