YARN Resource Management
Also available as:
PDF
loading table of contents...

Configuring the Timeline Server Store

In tez-site.xml:

[Note]Note

If you do not have Tez enabled on your system, you can safely ignore this setting.

  • tez.history.logging.service.class

    Class name for the Implementation to be used for logging history data.

    Example:

    <property>
     <description>Class name for the Implementation to be used for logging history data.</description>
     <name>tez.history.logging.service.class</name>
     <value>org.apache.tez.dag.history.logging.ats.ATSV15HistoryLoggingService</value>
    </property>

In yarn-site.xml:

  • yarn.timeline-service.entity-group-fs-store.active-dir

    DFS path to store active application’s timeline data. This DFS path must exist and be set up with the following permissions:

    • Permissions: 01777

    • Owner: yarn (or equivalent user for yarn services)

    • Group: hadoop (or the relevant group used for admins)

    Example:

    <property>
     <description>DFS path to store active application’s timeline data</description>
     <name>yarn.timeline-service.entity-group-fs-store.active-dir</name>
     <value>/ats/active/</value>
    </property>
  • yarn.timeline-service.entity-group-fs-store.cleaner-interval-seconds

    Scan interval for ATS v1.5 entity group file system storage cleaner.This value controls how frequent the reader will scan the HDFS done directory for stale application data.

    Example:

    <property>
     <description>Scan interval for ATS v1.5 entity group file system storage cleaner.This value controls how frequent the reader will scan the HDFS done directory for stale application data. </description>
     <name>yarn.timeline-service.entity-group-fs-store.cleaner-interval-seconds</name>
     <value>3600</value>
    </property>
  • yarn.timeline-service.entity-group-fs-store.done-dir

    DFS path to store done application’s timeline data. This DFS path must exist and be set up with the following permissions:

    • Permissions: 0700

    • Owner: yarn (or equivalent user for yarn services)

    • Group: hadoop (or the relevant group used for admins)

    Example:

    <property>
     <description>DFS path to store done application’s timeline data.</description>
     <name>yarn.timeline-service.entity-group-fs-store.done-dir</name>
     <value>/ats/done/</value>
    </property>
  • yarn.timeline-service.entity-group-fs-store.group-id-plugin-classes

    Plugins that can translate a timeline entity read request into a list of timeline cache ids, separated by commas. The classes specified here must be on the class path for the ATS.

    Example:

    <property>
     <description>Plugins that can translate a timeline entity read request into a list of timeline cache ids, separated by commas.</description>
     <name>yarn.timeline-service.entity-group-fs-store.group-id-plugin-classes</name>
     <value>org.apache.tez.dag.history.logging.ats.TimelineCachePluginImpl</value>
    </property>
  • yarn.timeline-service.entity-group-fs-store.retain-seconds

    How long the ATS v1.5 entity group file system storage system will keep an application's data in the done directory.

    Example:

    <property>
     <description>How long the ATS v1.5 entity group file system storage system will keep an application's data in the done directory.</description>
     <name>yarn.timeline-service.entity-group-fs-store.retain-seconds</name>
     <value>604800</value>
    </property>
  • yarn.timeline-service.entity-group-fs-store.scan-interval-seconds

    Scan interval for ATS v1.5 entity group file system storage reader.This value controls how frequent the reader will scan the HDFS active directory for application status.

    Example:

    <property>
     <description>Scan interval for ATS v1.5 entity group file system storage reader.This value controls how frequent the reader will scan the HDFS active directory for application status.</description>
     <name>yarn.timeline-service.entity-group-fs-store.scan-interval-seconds</name>
     <value>60</value>
    </property>
  • yarn.timeline-service.entity-group-fs-store.summary-store

    Summary storage for ATS v1.5.

    Example:

    <property>
     <description>DFS path to store active application’s timeline dataSummary storage for ATS v1.5.</description>
     <name>yarn.timeline-service.entity-group-fs-store.summary-store</name>
     <value>org.apache.hadoop.yarn.server.timeline.RollingLevelDBTimelineStore</value>
    </property>
  • yarn.timeline-service.leveldb-timeline-store.path

    Local FS path to store the leveldbs that hold the application summary data.

    Example:

    <property>
     <description>Local FS path to store the leveldbs that hold the application summary data.</description>
     <name>yarn.timeline-service.leveldb-timeline-store.path</name>
     <value><Data disk>/ats/leveldb/</value>
    </property>
  • yarn.timeline-service.leveldb-timeline-store.path

    The store file path and name for the Timeline Server LevelDB store (if the LevelDB store is used).

    Example:

    <property>
     <description>Store file name for leveldb timeline store</description>
     <name>yarn.timeline-service.leveldb-timeline-store.path</name>
     <value>${yarn.log.dir}/timeline</value>
    </property>
  • yarn.timeline-service.store-class

    Main storage class for YARN timeline server.

    Example:

    <property>
     <description>Main storage class for YARN timeline server. </description>
     <name>yarn.timeline-service.store-class</name>
     <value>org.apache.hadoop.yarn.server.timeline.EntityGroupFSTimelineStore</value>
    </property>
  • yarn.timeline-service.ttl-enable

    Enable age-off of timeline store data.

    Example:

    <property>
     <description>Enable age off of timeline store data.</description>
     <name>yarn.timeline-service.ttl-enable</name>
     <value>true</value>
    </property>
  • yarn.timeline-service.ttl-ms

    The Time-to-live for timeline store data (in milliseconds).

    Example:

    <property>
     <description>Time to live for timeline store data in milliseconds.</description>
     <name>yarn.timeline-service.ttl-ms</name>
     <value>604800000</value>
    </property>