Spark Guide
Also available as:
loading table of contents...

(Optional) Configuring Spark for Hive Access

When you install Spark using Ambari, the hive-site.xml file is populated with the Hive metastore location.

If you move Hive to a different server, edit the SPARK_HOME/conf/hive-site.xml file so that it contains only the hive.metastore.uris property. Make sure that the hostname points to the URI where the Hive Metastore is running.


hive-site.xml contains a number of properties that are not relevant to or supported by the Spark thrift server. Ensure that your Spark hive-site.xml file contains only the following configuration property.

  <!-- hostname must point to the Hive Metastore URI in your cluster -->
    <description>URI for client to contact metastore server</description>