Command Line Installation
Also available as:
PDF
loading table of contents...

Set Up the Oozie Configuration Files

Hortonworks provides a set of configuration files that represent a working Oozie configuration. (See Download Companion Files. You can use these files as a reference point, however, you need to modify them to match your own cluster environment.

If you choose to use the provided configuration files to set up your Oozie environment, complete the following steps to set up Oozie configuration files:

  1. Extract the Oozie configuration files to a temporary directory. The files are located in the configuration_files/oozie directory where you decompressed the companion files.

  2. Add the following property to the oozie-log4j.properties file:

    log4j.appender.oozie.layout.ConversionPattern=%d{ISO8601} %5p %c{1}:%L - SERVER[${oozie.instance.id}] %m%n

    where ${oozie.instance.id} is automatically determined by Oozie.

  3. If you have custom Oozie actions, you must define them in /etc/oozie/​conf/oozie-site.xml.

    • Edit the /etc/oozie/​conf/oozie-site.xml file and add the following properties:

      <property>
      <name>oozie.service.SchemaService.wf.ext.schemas</name>
      <value>[Comma seperated list of custom actions]</value>
      </property>
      

      For example, if you have added Spark Action, enter the following:

      <property>
      <name>oozie.service.SchemaService.wf.ext.schemas</name>
      <value>spark-action-0.1.xsd</value>
      </property>
      ​
    • Oozie runs a periodic purge on the shared library directory. The purge can delete libraries that are needed by jobs that started before the installation. To minimize the chance of job failures, you should extend the oozie.service.ShareLibService.purge.interval and oozie.service.ShareLibService.temp.sharelib.retention.days settings.

      Add the following content to the the oozie-site.xml file:

      <property>
      <name>oozie.service.ShareLibService.purge.interval</name>
      <value>1000</value>
      <description>
      How often, in days, Oozie should check for old ShareLibs and LauncherLibs to purge from HDFS.
      </description>
      </property>
      
      <property>
      <name>oozie.service.ShareLibService.temp.sharelib.retention.days</name>
      <value>1000</value>
      <description>
      ShareLib retention time in days.
      </description>
      </property>
    • Add the following property for Spark action configuration:

      <property>
      <name>oozie.service.SparkConfigurationService.spark.configuration</name>
      <value>*=/etc/spark/conf/</value>
      </property>

      Addition of this property requires that you to restart the Oozie server.

  4. Modify the configuration files, based on your environment and database type as described in the following sections.