Non-Ambari Cluster Installation Guide
Also available as:
PDF
loading table of contents...

Configure HDP

If you are using an Ambari-managed cluster, use Ambari to update the service configurations (core-site.xml, mapred-site.xml, webhbcat-site.xml and oozie-site.xml). Do not edit the configuration files directly and use Ambari to start and stop the services.

su - $HDFS_USER

/usr/hdp/current/hadoop-client/sbin/hadoop-daemon.sh stop namenode

  1. Modify the hdfs-site.xml file.

    On the NameNode, Secondary NameNode, and all the DataNodes, add the following property to the $HADOOP_CONF_DIR/hdfs-site.xml file, where $HADOOP_CONF_DIR is the directory for storing the Hadoop configuration files. For example, /etc/hadoop/conf.

    <property>
         <name>dfs.webhdfs.enabled</name>
         <value>true</value>
    </property>
  2. Modify the core-site.xml file.

    On the NameNode, Secondary NameNode, and all the DataNodes, add the following properties to the $HADOOP_CONF_DIR/core-site.xml file, where $HADOOP_CONF_DIR is the directory for storing the Hadoop configuration files. For example, /etc/hadoop/conf.

    <property>
         <name>hadoop.proxyuser.hue.hosts</name>
         <value>*</value>
    </property>
     
    <property>
         <name>hadoop.proxyuser.hue.groups</name>
         <value>*</value>
    </property>
     
    <property>
         <name>hadoop.proxyuser.hcat.groups</name>
         <value>*</value>
    </property>
     
    <property>
         <name>hadoop.proxyuser.hcat.hosts</name>
         <value>*</value>
    </property>
  3. Modify the webhcat-site.xml file. On the WebHCat Server host, add the following properties to the $WEBHCAT_CONF_DIR/webhcat-site.xml file, where $WEBHCAT_CONF_DIR is the directory for storing WebHCat configuration files. For example, /etc/webhcat/conf.

    vi $WEBHCAT_CONF_DIR/webhcat-site.xml

    <property>
         <name>webhcat.proxyuser.hue.hosts</name>
         <value>*</value>
    </property>
     
    <property>
         <name>webhcat.proxyuser.hue.groups</name>
         <value>*</value>
    </property> 
  4. Modify the oozie-site.xml file. On the Oozie Server host, add the following properties to the $OOZIE_CONF_DIR/oozie-site.xml file, where $OOZIE_CONF_DIR is the directory for storing Oozie configuration files. For example, /etc/oozie/conf.

    vi $OOZIE_CONF_DIR/oozie-site.xml

    <property>
         <name>oozie.service.ProxyUserService.proxyuser.hue.hosts</name>
         <value>*</value>
    </property>
     
    <property>
         <name>oozie.service.ProxyUserService.proxyuser.hue.groups</name>
         <value>*</value>
    </property>
  5. Modify the hive-site.xml file. On the HiveServer2 host, add the following properties to the $HIVE_CONF_DIR/hive-site.xml file, where $HIVE_CONF_DIR is the directory for storing Hive configuration files. For example, /etc/hive/conf.

    vi $HIVE_CONF_DIR/hive-site.xml

    <property>
         <name>hive.server2.enable.doAs</name>
         <value>true</value>
    </property>