Accessing the Hive Metastore in Secure Mode
Requirements for accessing the Hive Metastore in secure mode (with Kerberos):
The Spark Thrift Server must be co-located with the Hive Thrift Server.
The
spark
user must be able to access the Hive keytab.In yarn-client mode on a secure cluster you can use HiveContext to access the Hive Metastore. (HiveContext is not supported for yarn-cluster mode on a secure cluster.)