Command Line Upgrade
Also available as:
PDF
loading table of contents...

Configure and Start Apache Tez

[Note]Note

The su commands in this section use keywords to represent the Service user. For example, "hdfs" is used to represent the HDFS Service user. If you are using another name for your Service users, you need to substitute your Service user name in each of the su commands.

To upgrade Apache Tez:

  1. Copy your previously backed-up copy of tez-site.xml into the /etc/tez/conf directory.

  2. Upload the Tez tarball to HDFS.

    su - hdfs
    hdfs dfs -mkdir -p /hdp/apps/<hdp_version>/tez/
    hdfs dfs -put /usr/hdp/<hdp_version>/tez/lib/tez.tar.gz /hdp/apps/<hdp_version>/tez/
    hdfs dfs -chown -R hdfs:hadoop /hdp
    hdfs dfs -chmod -R 555 /hdp/apps/<hdp_version>/tez
    hdfs dfs -chmod -R 444 /hdp/apps/<hdp_version>/tez/tez.tar.gz

    Where <hdp_version> is the current HDP version, for example 2.5.0.0-2800.

  3. Edit the tez.lib.uris property in the tez-site.xml file to point to /hdp/apps/<hdp_version>/tez/tez.tar.gz

    ...
    <property>
     <name>tez.lib.uris</name>
     <value>/hdp/apps/<hdp_version>/tez/tez.tar.gz</value>
    </property>
    ...

    Where <hdp_version> is the current HDP version, for example 2.5.0.0-2800.

  4. Optional Earlier releases of Tez did not have access control. In the current version of Tez, the default behavior restricts the ability to view the Tez history to only the owner of the job. To retain unrestricted access for non-secure clusters, set tez.am.view-acls set to "*".

  5. Change the value of the tez.tez-ui.history-url.base property to the url for the upgraded Tez View. For information on setting up the Tez view, see Deploying the Tez View in the HDP Ambari Views Guide.

  6. Run Tez Smoke Test

    To smoke test your Tez upgrade, you can run the following Tez Example job as a regular user.

    MRRSleep Tez Example job sleeps for a defined period of time in mapper and reducer

    hadoop jar /usr/hdp/current/tez-client/tez-tests-<version>.jar mrrsleep -m 1 -r 1 -mt 100 -rt 100

    You should see messages similar to:

    …DAG: State: SUCCEEDED Progress: 100%
    DAG completed. FinalState=SUCCEEDED

    Tez upgraded successfully. You can now upgrade your other components.