3. Set Up the Hive/HCatalog Configuration Files

Use the following instructions to set up the Hive/HCatalog configuration files:

  1. Extract the Hive/HCatalog configuration files.

    From the downloaded scripts.zip file, extract the files in configuration_files/hive directory to a temporary directory.

  2. Modify the configuration files.

    In the temporary directory, locate the following file and modify the properties based on your environment. Search for TODO in the files for the properties to replace.

    1. Edit hive-site.xml and modify the following properties:

      <property>       
       <name>javax.jdo.option.ConnectionURL</name>       
       <value>jdbc:mysql://$mysql.full.hostname:3306/$database.name?createDatabaseIfNotExist=true</value>  
       <description>Enter your JDBC connection string. </description>
      </property>
      <property>       
       <name>javax.jdo.option.ConnectionUserName</name>       
       <value>$dbusername</value>  
       <description>Enter your MySQL credentials. </description>
      </property>
      <property>       
       <name>javax.jdo.option.ConnectionPassword</name>       
       <value>$dbuserpassword</value>  
       <description>Enter your MySQL credentials. </description>
      </property>

      Enter your MySQL credentials from Install MySQL (Optional).

      <property>       
       <name>hive.metastore.uris</name>       
       <value>thrift://$metastore.server.full.hostname:9083</value>  
       <description>URI for client to contact metastore server. To enable HiveServer2, leave the property value empty. </description>
      </property>

      If you plan on storing Hive data in a columnar format, such as ORC, verify that the hive.optimize.sort.dynamic.partition property is set to true, the default value for Hive 0.13. Enabling dynamic partitions improves Hive performance when using columnar formats.

      <property>
        <name>hive.optimize.sort.dynamic.partition</name>
        <value>true</value>
      </property>

  3. Copy the configuration files.

    1. On all Hive hosts create the Hive configuration directory.

      rm -r $HIVE_CONF_DIR ;
      mkdir -p $HIVE_CONF_DIR ;
    2. Copy all the configuration files to $HIVE_CONF_DIR directory.

    3. Set appropriate permissions:

      chown -R $HIVE_USER:$HADOOP_GROUP $HIVE_CONF_DIR/../ ;
      chmod -R 755 $HIVE_CONF_DIR/../ ;

    where:

    • $HIVE_CONF_DIR is the directory to store the Hive configuration files. For example, /etc/hive/conf.

    • $HIVE_USER is the user owning the Hive services. For example, hive.

    • $HADOOP_GROUP is a common group shared by services. For example, hadoop.


loading table of contents...