Optional: Spark Manual Downgrade Procedure
When upgrading to HDP 2.4.2 using Ambari, Spark 1.6.0 is automatically upgraded to 1.6.1. However, if you want to return to using 1.6.0, complete the following steps:
Remove Spark 1.6.1 from your HDP cluster using Ambari:
curl -u admin:admin -H "X-Requested-By: ambari" -X DELETEhttp://:8080/api/v1/clusters/<AMBARI_HOST><CLUSTER_NAME>/services/SPARKManually install Spark 1.6.0 by following the directions in HDP 2.3.0 Installing HDP Manually: Installing and Configuring Apache Spark.