On all client/gateway nodes:
Install the Tez RPMs on all client/gateway nodes:
For RHEL/CentOS/Oracle Linux:
yum install tez
For SLES:
zypper install tez
For Ubuntu:
apt-get install tez
Execute the following commands to create the Tez configuration directories. These HDFS directories must be publicly accessible.
Note The
$HDFS_USER
is the user that owns the HDFS service. For example,hdfs
.su $HDFS_USER hdfs dfs -mkdir -p /apps/tez
Execute the following commands from any one of the cluster client nodes to upload the Tez jar files and their dependencies into HDFS:
su $HDFS_USER hdfs dfs -copyFromLocal /usr/lib/tez/* /apps/tez hdfs dfs -chown -R hdfs:users /apps/tez hdfs dfs -chmod 755 /apps hdfs dfs -chmod 755 /apps/tez hdfs dfs -chmod 755 /apps/tez/lib/ hdfs dfs -chmod 644 /apps/tez/*.jar hdfs dfs -chmod 644 /apps/tez/lib/*.jar
Execute the following command to verify that the files were copied with the preceeding step:
hdfs dfs -ls /apps/tez
This should return a list of files that looks similar to this:
Found 10 items drwxr-xr-x - hdfs users 0 2014-06-04 14:07 /apps/tez/conf drwxr-xr-x - hdfs users 0 2014-06-04 14:07 /apps/tez/lib -rwxr-xr-x 3 hdfs users 748252 2014-06-04 14:07 /apps/tez/tez-api-0.4.0.2.1.2.0-402.jar -rwxr-xr-x 3 hdfs users 29846 2014-06-04 14:07 /apps/tez/tez-common-0.4.0.2.1.2.0-402.jar -rwxr-xr-x 3 hdfs users 980888 2014-06-04 14:07 /apps/tez/tez-dag-0.4.0.2.1.2.0-402.jar -rwxr-xr-x 3 hdfs users 242111 2014-06-04 14:07 /apps/tez/tez-mapreduce-0.4.0.2.1.2.0-402.jar -rwxr-xr-x 3 hdfs users 195627 2014-06-04 14:07 /apps/tez/tez-mapreduce-examples-0.4.0.2.1.2.0-402.jar -rwxr-xr-x 3 hdfs users 110388 2014-06-04 14:07 /apps/tez/tez-runtime-internals-0.4.0.2.1.2.0-402.jar -rwxr-xr-x 3 hdfs users 348559 2014-06-04 14:07 /apps/tez/tez-runtime-library-0.4.0.2.1.2.0-402.jar -rwxr-xr-x 3 hdfs users 2615 2014-06-04 14:07 /apps/tez/tez-tests-0.4.0.2.1.2.0-402.jar