What's New in Apache Spark

Learn about the new features of Spark in Cloudera Runtime 7.2.17.

Apache Spark 3 version support

  • Support for virtual clusters powered by Apache Spark 3 is now available.
  • The following functionalities are not currently supported:
    • Deep analysis (visual profiler)
    • HWC - that is, Hive managed ACID tables (Direct Reader & JDBC mode)
    • Phoenix Connector
    • SparkR

See Running Apache Spark 3 applications and Data Engineering clusters.