Upgrading HDP Manually
Also available as:
PDF
loading table of contents...

Configure and Start Apache Oozie

Before you can upgrade Apache Oozie, you must have first upgraded your HDP components to the latest version (in this case, 2.3.6). This section assumes that you have already upgraded your components for HDP 2.3.6. If you have not already completed these steps, return to Getting Ready to Upgrade and Upgrade 2.0 Components for instructions on how to upgrade your HDP components to 2.3.6.

[Note]Note

The su commands in this section use keywords to represent the Service user. For example, "hdfs" is used to represent the HDFS Service user. If you are using another name for your Service users, you will need to substitute your Service user name in each of the su commands.

Upgrading Oozie is a complex process. Although the instructions are straightforward, set aside a dedicated block of time to upgrade oozie clients and servers.

Perform the following preparation steps on each oozie server host:

  1. You must restore oozie-site.xml from your backup to the conf directory on each oozie server and client.

  2. Copy the JDBC jar to libext-customer.

    1. Create the /usr/hdp/2.3.6.0-<version>/oozie-server/libext-customer directory.

      cd /usr/hdp/2.3.6.0-<version>/oozie-server

      mkdir libext-customer

    2. Grant read/write/execute access to all users for the libext-customer directory.

      chmod -R 777 /usr/hdp/2.3.6.0-<version>/oozie-server/libext-customer

  3. Copy these files to the libext-customer directory

    cp /usr/hdp/2.3.6.0-<version>/hadoop-client/lib/hadoop*lzo*.jar /usr/hdp/current/oozie-server/libext-customer

    cp /usr/share/HDP-oozie/ext.zip /usr/hdp/2.3.6.0-<version>/oozie-server/libext-customer/

    Also, copy Oozie db jar in libext-customer.

  4. Extract share-lib.

    cd /usr/hdp/2.3.6.0-<version>/oozie

    tar xzvf /usr/hdp/2.3.6.0-<version>/oozie/oozie-sharelib.tar.gz

    su - hdfs -c "hdfs dfs -mkdir -p /user/oozie"

    su - hdfs -c "hdfs dfs -copyFromLocal /usr/hdp/current/oozie/share /user/oozie/."

    You can expect to see complaints that some files already exist. Delete any existing /oozie/share and replace it with the newly-extracted files.

    su - hdfs -c "hdfs dfs -chown oozie:hadoop /user/oozie" su -l hdfs -c "hdfs dfs -chmod -R 755 /user/oozie"

  5. if a previous version of Oozie was created using auto schema creation, run the following SQL query:

    insert into oozie_sys (name, data) values ('db.version', '2.5');

  6. As the Oozie user (not root), run the upgrade.

    su - oozie -c "/usr/hdp/current/oozie-server/bin/ooziedb.sh upgrade -run"

  7. As root, prepare the Oozie WAR file.

    su - oozie -c "/usr/hdp/current/oozie/bin/oozie-setup.sh prepare-war -d /usr/hdp/current/oozie/libext-customer"

    Look for console output to indicate success. For example, if you are using MySQL you should see something similar to:

    INFO: Adding extension: libext-customer/mysql-connector-java.jar
    New Oozie WAR file with added 'JARs' at /var/lib/oozie/oozie-server/webapps/oozie.war 
  8. Add the following property to oozie-log4j.properties:

    log4j.appender.oozie.layout.ConversionPattern=%d{ISO8601} %5p %c{1}:%L - SERVER[${oozie.instance.id}] %m%n

    where ${oozie.instance.id} is determined by oozie, automatically.

  9. Start Oozie as the Oozie user:

    su - oozie -c "cd /grid/0/var/log/oozie; /usr/hdp/current/oozie/oozie-server/bin/catalina.sh /usr/hdp/current/oozie/oozie-server/bin/setclasspath.sh /usr/hdp/current/oozie-server/bin/oozied.sh start"

  10. Check processes.

    ps -ef | grep -i oozie