Dataset and DataFrame API explode deprecated
Dataset and DataFrame API explode has been deprecated.
Type of change: Syntactic/Spark SQL change
Spark 1.6
Dataset and DataFrame API explode are supported.
Spark 2.4
Dataset
and DataFrame API explode have been deprecated. If explode is used, for example
dataframe.explode()
, the following warning is thrown:
warning: method explode in class Dataset is deprecated: use flatMap() or select() with functions.explode() instead
Action Required
Use functions.explode()
or flatMap (import
org.apache.spark.sql.functions.explode)
.