Procedure 1.1. Setting up Multiple LLAP Instances on the Same HDP Cluster

Prerequisites

1. In Ambari ensure that the Enable Interactive Query slider is set to Yes. This setting enables HiveServer2 Interactive.

2. Access the HiveServer2 Interactive node running the pre-existing LLAP instance:

   1. Select the Hosts tab of Ambari.

   2. Use the search field to locate the HiveServer2 Interactive node.

   3. On a command-line, log in to the node as root.

3. Clone the configuration of the HiveServer2 Interactive node. Choose a name for the clone that identifies the nature of the configuration and log files for the new Hive LLAP setup. The steps of this procedure assume that a second Hive LLAP instance is created, so the name myhive2 is used continuously in the following examples.

   1. Run the following commands:

      HIVE_INSTANCE_NAME=myhive2

      mkdir -p /etc/hive2/conf.${HIVE_INSTANCE_NAME}

      cd /etc/hive2/conf.${HIVE_INSTANCE_NAME}

      cp -p /etc/hive2/2.6.1*/0/conf.server/*

      mkdir -p /var/log/hive.${HIVE_INSTANCE_NAME}

      chown hive:hadoop /var/log/hive.${HIVE_INSTANCE_NAME}

4. Adjust the configuration files for the new HiveServer2 Interactive instance:

   1. Change HIVE_CONF_DIR in /etc/hive2/conf.${HIVE_INSTANCE_NAME}/hive-env.sh to the new configuration path.

      Example: HIVE_CONF_DIR=/etc/hive2/conf.myhive2

   2. Change the values of the following properties in the /etc/hive2/conf.${HIVE_INSTANCE_NAME}/hive-site.xml file:

      • hive.server2.tez.default.queues: change the value to the queue where container jobs run or to default. If you do not change the value of hive.server2.tez.default.queues, there is not enough capacity for jobs to run in the environment that you are creating.

      • hive.server2.zookeeper.namespace: change the value to hiveserver2-${HIVE_INSTANCE_NAME}, substituting the variable with your real value. For example, hiveserver2-myhive2.

      • hive.server2.thrift.port: replace the default value (10000 in Hive 1; 10500 in Hive 2) with a number that does not clash with the port number of an existing HiveServer2 instance

      • hive.server2.thrift.http.port: replace the default value (10001 in Hive 1; 10501 in Hive 2) with a number that does not clash with the port number of an existing HiveServer2 instance

      • hive.server2.webui.port: replace the default value (10002 in Hive 1; 10502 in Hive 2) with a number that does not clash with the port number of an existing HiveServer2 instance

   3. Change the value of property.hive.log.dir in the hive-log4j2.properties file to the new HiveServer2 configuration path.

      Example: property.hive.log.dir = /var/log/hive.myhive2

5. Create a Hive LLAP package for your application by following the steps in Installing LLAP on an Unsecured Cluster or Installing LLAP on a Secured Cluster, depending on the environment that you have. Ensure that the --queue option is included in the command and that it directs the execution to the YARN queue to be used for the new LLAP instance. The following is an example of an executing command:

   hive --service llap --name llap_extra --queue my_queue --instances 5 \
   --cache 50000m --xmx 50000m --size 100000m --executors 12 --loglevel WARN \
   --args "-XX:+UseG1GC -XX:+ResizeTLAB -XX:+UseNUMA  -XX:-ResizePLAB"

6. Launch LLAP using the run.sh file that was created after you completed Step 5.

   Example:sh llap-slider-${DATE}/run.sh

7. Confirm the Hive LLAP instance is running. Wait a moment for the LLAP application to start within YARN. After startup of the application you can validate that the LLAP instance is running properly using the llapstatus command.

   Example of llapstatus command:

   /usr/hdp/current/hive-server2-hive2/bin/hive --service llapstatus -w -r 0.8 -i 2 -t 200

   If LLAP started successfully, you see output similar to the following message:

   SLF4J: Class path contains multiple SLF4J bindings.
   SLF4J: Found binding in [jar:file:/usr/hdp/2.6.3.0-159/hive2/lib/log4j-slf4j-impl-2.6.2.jar!/org/slf4j/impl/StaticLoggerBinder.class]
   SLF4J: Found binding in [jar:file:/usr/hdp/2.6.3.0-159/hadoop/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
   SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
   SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
   WARN conf.HiveConf: HiveConf of name hive.llap.daemon.service.ssl does not exist
   WARN conf.HiveConf: HiveConf hive.llap.daemon.vcpus.per.instance expects INT type value
   
   LLAPSTATUS WatchMode with timeout=200 s
   --------------------------------------------------------------------------------
   LLAP Application running with ApplicationId=application_1507473809953_0012
   --------------------------------------------------------------------------------
   LLAP Application running with ApplicationId=application_1507473809953_0012
   --------------------------------------------------------------------------------
   
   {
     "amInfo" : {
       "appName" : "llap1",
       "appType" : "org-apache-slider",
       "appId" : "application_1507473809953_0012",
       "containerId" : "container_e01_1507473809953_0012_01_000001",
       "hostname" : "ctr-e134-1499953498516-207726-02-000006.hwx.site",
       "amWebUrl" : "http://ctr-e134-1499953498516-207726-02-000006.hwx.site:44549/"
     },
     "state" : "RUNNING_ALL",
     "originalConfigurationPath" : "hdfs://ctr-e134-1499953498516-207726-02-000010.hwx.site:8020/user/hive/.slider/cluster/llap1/snapshot",
     "generatedConfigurationPath" : "hdfs://ctr-e134-1499953498516-207726-02-000010.hwx.site:8020/user/hive/.slider/cluster/llap1/generated",
     "desiredInstances" : 1,
     "liveInstances" : 1,
     "launchingInstances" : 0,
     "appStartTime" : 1507542670971,
     "runningThresholdAchieved" : true,
     "runningInstances" : [ {
       "hostname" : "ctr-e134-1499953498516-207726-02-000005.hwx.site",
       "containerId" : "container_e01_1507473809953_0012_01_000002",
       "logUrl" : "http://ctr-e134-1499953498516-207726-02-000005.hwx.site:54321/node/containerlogs/container_e01_1507473809953_0012_01_000002/hive",
       "statusUrl" : "http://ctr-e134-1499953498516-207726-02-000005.hwx.site:15002/status",
       "webUrl" : "http://ctr-e134-1499953498516-207726-02-000005.hwx.site:15002",
       "rpcPort" : 44315,
       "mgmtPort" : 15004,
       "shufflePort" : 15551,
       "yarnContainerExitStatus" : 0
     } ]
   }

8. Start the new HiveServer2 instance by running the following command:

   export HIVE_CONF_DIR=/etc/hive2/conf.${HIVE_INSTANCE_NAME} \
   /usr/hdp/current/hive-server2-hive2/bin/hive --service hiveserver2

   For validation purposes, run this HiveServer2 instance in the foreground until you confirm it is functioning in the next step.

9. Validate the HiveServer2 instance started and check its version by running the select version() command.

   Command example:

   beeline \
       -u "jdbc:hive2://hs2host.example.com:port/" \
       -e "select version()"

   Output example:

   The following sample output assumes that the hive.server2.thrift.port property in Step 4 was set to 20500.

   beeline -u "jdbc:hive2://ambari.example.com:20500/" -e "select version()"
   Connecting to jdbc:hive2://ambari.example.com:20500/
   Connected to: Apache Hive (version 2.1.0.2.6.1.0-129)
   Driver: Hive JDBC (version 1.2.1000.2.6.1.0-129)
   Transaction isolation: TRANSACTION_REPEATABLE_READ
   DEBUG : Acquired the compile lock
   INFO  : Compiling command(queryId=hive_20170628220829_dbb26dfe-0f65-4492-8b8c-fa1469065f74): select version()
   INFO  : We are setting the hadoop caller context from HIVE_SSN_ID:917c22bf-9998-413d-88c1-4b641391e060 to hive_20170628220829_dbb26dfe-0f65-4492-8b8c-fa1469065f74
   INFO  : Semantic Analysis Completed
   INFO  : Returning Hive schema: Schema(fieldSchemas:[FieldSchema(name:_c0, type:string, comment:null)], properties:null)
   INFO  : Completed compiling command(queryId=hive_20170628220829_dbb26dfe-0f65-4492-8b8c-fa1469065f74); Time taken: 0.136 seconds
   INFO  : We are resetting the hadoop caller context to HIVE_SSN_ID:917c22bf-9998-413d-88c1-4b641391e060
   INFO  : Concurrency mode is disabled, not creating a lock manager
   INFO  : Setting caller context to query id hive_20170628220829_dbb26dfe-0f65-4492-8b8c-fa1469065f74
   INFO  : Executing command(queryId=hive_20170628220829_dbb26dfe-0f65-4492-8b8c-fa1469065f74): select version()
   INFO  : Resetting the caller context to HIVE_SSN_ID:917c22bf-9998-413d-88c1-4b641391e060
   INFO  : Completed executing command(queryId=hive_20170628220829_dbb26dfe-0f65-4492-8b8c-fa1469065f74); Time taken: 0.033 seconds
   INFO  : OK
   DEBUG : Shutting down query select version()
   +--------------------------------------------------------------+--+
   |                         	_c0                          	|
   +--------------------------------------------------------------+--+
   | 2.1.0.2.6.1.0-129 rf65a7fce6219dbd86a9313bb37944b89fa3551b1  |
   +--------------------------------------------------------------+--+
   1 row selected (0.345 seconds)
   Beeline version 1.2.1000.2.6.1.0-129 by Apache Hive
   Closing: 0: jdbc:hive2://ambari.example.com:20500/
   

10. You can also choose to use the ZooKeeper endpoint, based on the value of the hive.server2.zookeeper.namespace property.

    Example:

    beeline \
      -u "jdbc:hive2://ambari.example.com:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2-myhive2" \
      -e "select version()"
    

11. Run HiveServer2 in the background after validation.

    Command example:

    su - hive
    export HIVE_CONF_DIR=/etc/hive2/conf.${HIVE_INSTANCE_NAME}
    nohup /usr/hdp/current/hive2-server2/bin/hiveserver2 \
    -hiveconf hive.metastore.uris=" " -hiveconf hive.log.file=hiveserver2.log \
    >/var/log/hive/hiveserver2.out 2> /var/log/hive/hiveserver2err.log &