union replaces unionAll
The dataset and DataFrame API unionAll has been deprecated and replaced by union.
Type of change: Syntactic/Spark core change
unionAll is supported.
unionAll is deprecated and replaced by union.
Replace unionAll with union. For example:
val df3 = df.unionAll(df2) with val
df3 = df.union(df2)