Configuring Apache Hive Hook
Atlas requires changes to hive-site.xml
as well as additional configuration files as
follows:
Create a new file in
/etc/hive/conf
named client.properties and another new file in/etc/hive/conf/conf.server
namedclient.properties
with the following contents:atlas.http.authentication.enabled=false|true
atlas.http.authentication.type=simple|kerberos
Configure the Hive post execution hook by manually adding the following properties to hive-site.xml:
<property> <name>atlas.cluster.name</name> <value>NAME-OF-CLUSTER</value> </property> <property> <name>atlas.rest.address</name> <value>http://ATLAS-FQDN:21000</value> </property>
Add the Atlas hook to list of any existing Hive post execution hooks. For example:
<property> <name>hive.exec.post.hooks</name> <value>org.apache.hadoop.hive.ql.hooks.ATSHook, org.apache.atlas.hive.hook.HiveHook</value> </property>
Add
export HIVE_AUX_JARS_PATH=<atlas package>/hook/hive
tohive-env.sh
of your Hive configuration.Copy
<atlas-conf>/client.properties
and<atlas-conf>/application.properties
to the hive conf directory.If Hive actions are executed with Oozie, add the JAR files that are included with the Atlas server to the
/user/oozie/share/lib/lib_$DATE/hive
directory, where $DATE represents the name of the Oozie directory. You can obtain the name of the Oozie directory by executing the command:hdfs dfs -ls /user/oozie/share/lib
.To populate the Oozie directory with the Atlas server JAR files, run the following commands from the Atlas Hive package installation directory:
hdfs dfs -copyFromLocal . /usr/hdp/current/atlas-server/bridge/hive/atlas-client-*.jar /user/oozie/share/lib/lib_$DATE/hive/ hdfs dfs -copyFromLocal . /usr/hdp/current/atlas-server/bridge/hive/atlas-typesystem*.jar /user/oozie/share/lib/lib_$DATE/hive/ hdfs dfs -copyFromLocal . /usr/hdp/current/atlas-server/hook/hive/hive-bridge*jar /user/oozie/share/lib/lib_$DATE/hive/ hdfs dfs -copyFromLocal . /usr/hdp/current/atlas-server/bridge/hive/json4s-ast*.jar /user/oozie/share/lib/lib_$DATE/hive/ hdfs dfs -copyFromLocal . /usr/hdp/current/atlas-server/bridge/hive/json4s-core*jar /user/oozie/share/lib/lib_$DATE/hive/ hdfs dfs -copyFromLocal . /usr/hdp/current/atlas-server/bridge/hive/json4s-native*.jar /user/oozie/share/lib/lib_$DATE/hive/ hdfs dfs -copyFromLocal . /usr/hdp/current/atlas-server/bridge/hive/scala-compiler*.jar /user/oozie/share/lib/lib_$DATE/hive/ hdfs dfs -copyFromLocal . /usr/hdp/current/atlas-server/bridge/hive/scala-library*.jar /user/oozie/share/lib/lib_$DATE/hive/ hdfs dfs -copyFromLocal . /usr/hdp/current/atlas-server/bridge/hive/scalap*.jar /user/oozie/share/lib/lib_$DATE/hive/ hdfs dfs -copyFromLocal . /usr/hdp/current/atlas-server/bridge/hive/scala-reflect*.jar /user/oozie/share/lib/lib_$DATE/hive/