4. Set Up the HDFS User and Prepare WebHCat Directories On HDFS

  1. Set up the HDFS user. Login as $HDFS_USER

     hadoop fs -mkdir /user/$WEBHCAT_USER 
    hadoop fs -chown -R $WEBHCAT_USER:$WEBHCAT_USER /user/$WEBHCAT_USER 
    hadoop fs -mkdir /apps/webhcat 
  2. Prepare WebHCat directories on HDFS.

    hadoop dfs -copyFromLocal /usr/share/HDP-webhcat/pig.tar.gz /apps/webhcat/
    hadoop dfs -copyFromLocal /usr/share/HDP-webhcat/hive.tar.gz /apps/webhcat/
    hadoop dfs -copyFromLocal /usr/lib/hadoop/contrib/streaming/hadoop-streaming*.jar /apps/webhcat/
  3. Set appropriate permissions for the HDFS user and the webhcat directory.

    hadoop fs -chown -R $WEBHCAT_USER:users /apps/webhcat 
    hadoop fs -chmod -R 755 /apps/webhcat

    where:

    • $HDFS_USER is the user owning the HDFS services. For example, hdfs.

    • $WEBHCAT_USER is the user owning the WebHCat services. For example, hcat.


loading table of contents...