Livy interpreter configuration
You can use the Hive Warehouse Connector in Zeppelin notebooks with the Livy
interpreter by modifying or adding properties to your livy interpreter
settings. The Livy interpreter accesses processing engines and data sources from the Zeppelin
UI.
Requirements
- Configurations require a
livyprefilx. - A reference to the HWC jar on the local file system is required.
Interpreter properties
livy.spark.hadoop.hive.metastore.uris-thrift://<domain name>:<port>Example:
thrift://hwc-secure-1.hwc-secure.root.hwx.site:9083livy.spark.jars-local:/opt/cloudera/parcels/<version>/jars/hive-warehouse-connector-assembly-<version>.jarExample:
local:/opt/cloudera/parcels/CDH-7.2.1-1.cdh7.2.1.p0.4847773/jars/hive-warehouse-connector-assembly-<version>.jarUse the local file ("local:").
livy.spark.kryo.registrator-com.qubole.spark.hiveacid.util.HiveAcidKyroRegistratorlivy.spark.security.credentials.hiveserver2.enabled-truelivy.spark.sql.extensions-com.hortonworks.spark.sql.rule.Extensionslivy.spark.sql.hive.hiveserver2.jdbc.url-jdbc:hive2://<domain name>:<port>/default;retries=5;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2Example:
jdbc:hive2://hwc-secure-1.hwc-secure.root.hwx.site:2181/default;retries=5;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2livy.spark.sql.hive.hiveserver2.jdbc.url.principal-hive/_HOST@ROOT.HWX.SITE
