2.4.15.  Upgrade Spark

Save the old Spark configuration and add symlink from /etc/spark/conf:

mv /etc/spark/conf /etc/spark/conf.saved

ln -s /usr/hdp/current/spark-client/conf /etc/spark/conf

ls -la /etc/spark

total 4 
drwxr-xr-x 3 root root 4096 Jun 19 21:51 2.3.0.0-2323 
lrwxrwxrwx 1 root root 35 Jun 19 21:54 conf -> /usr/hdp/current/spark-client/conf 
drwxr-xr-x 2 root root 4096 Jun 14 00:11 conf.saved

From Ambari Web, browse to Services > Spark.

From the Service Actions menu, select Start.

After Spark has started, select Run Service Check. Confirm the Service Check passes.