Configure and Start Apache Tez
Note | |
---|---|
The |
To upgrade Apache Tez:
Copy your previously backed-up copy of tez-site.xml into the /etc/tez/conf directory.
Upload the Tez tarball to HDFS.
su - hdfs hdfs dfs -mkdir -p /hdp/apps/<hdp_version>/tez/ hdfs dfs -put /usr/hdp/<hdp_version>/tez/lib/tez.tar.gz /hdp/apps/<hdp_version>/tez/ hdfs dfs -chown -R hdfs:hadoop /hdp hdfs dfs -chmod -R 555 /hdp/apps/<hdp_version>/tez hdfs dfs -chmod -R 444 /hdp/apps/<hdp_version>/tez/tez.tar.gz
Where <hdp_version> is the current HDP version, for example 2.5.5.0-2800.
Edit the tez.lib.uris property in the tez-site.xml file to point to /hdp/apps/<hdp_version>/tez/tez.tar.gz
... <property> <name>tez.lib.uris</name> <value>/hdp/apps/<hdp_version>/tez/tez.tar.gz</value> </property> ...
Where
<hdp_version>
is the current HDP version, for example2.5.5.0-2800
.Optional Earlier releases of Tez did not have access control. In the current version of Tez, the default behavior restricts the ability to view the Tez history to only the owner of the job. To retain unrestricted access for non-secure clusters, set
tez.am.view-acls
set to "*".Change the value of the tez.tez-ui.history-url.base property to the url for the upgraded Tez View. For information on setting up the Tez view, see Deploying the Tez View in the HDP Ambari Views Guide.
Run Tez Smoke Test
To smoke test your Tez upgrade, you can run the following Tez Example job as a regular user.
MRRSleep Tez Example job sleeps for a defined period of time in mapper and reducer
hadoop jar /usr/hdp/current/tez-client/tez-tests-<version>.jar mrrsleep -m 1 -r 1 -mt 100 -rt 100
You should see messages similar to:
…DAG: State: SUCCEEDED Progress: 100% DAG completed. FinalState=SUCCEEDED
Tez upgraded successfully. You can now upgrade your other components.