Configuring the Timeline Server Store
In tez-site.xml:
Note | |
---|---|
If you do not have Tez enabled on your system, you can safely ignore this setting. |
tez.history.logging.service.class
Class name for the Implementation to be used for logging history data.
Example:
<property> <description>Class name for the Implementation to be used for logging history data.</description> <name>tez.history.logging.service.class</name> <value>org.apache.tez.dag.history.logging.ats.ATSV15HistoryLoggingService</value> </property>
In yarn-site.xml:
yarn.timeline-service.entity-group-fs-store.active-dir
DFS path to store active application’s timeline data. This DFS path must exist and be set up with the following permissions:
Permissions: 01777
Owner: yarn (or equivalent user for yarn services)
Group: hadoop (or the relevant group used for admins)
Example:
<property> <description>DFS path to store active application’s timeline data</description> <name>yarn.timeline-service.entity-group-fs-store.active-dir</name> <value>/ats/active/</value> </property>
yarn.timeline-service.entity-group-fs-store.cleaner-interval-seconds
Scan interval for ATS v1.5 entity group file system storage cleaner.This value controls how frequent the reader will scan the HDFS done directory for stale application data.
Example:
<property> <description>Scan interval for ATS v1.5 entity group file system storage cleaner.This value controls how frequent the reader will scan the HDFS done directory for stale application data. </description> <name>yarn.timeline-service.entity-group-fs-store.cleaner-interval-seconds</name> <value>3600</value> </property>
yarn.timeline-service.entity-group-fs-store.done-dir
DFS path to store done application’s timeline data. This DFS path must exist and be set up with the following permissions:
Permissions: 0700
Owner: yarn (or equivalent user for yarn services)
Group: hadoop (or the relevant group used for admins)
Example:
<property> <description>DFS path to store done application’s timeline data.</description> <name>yarn.timeline-service.entity-group-fs-store.done-dir</name> <value>/ats/done/</value> </property>
yarn.timeline-service.entity-group-fs-store.group-id-plugin-classes
Plugins that can translate a timeline entity read request into a list of timeline cache ids, separated by commas. The classes specified here must be on the class path for the ATS.
Example:
<property> <description>Plugins that can translate a timeline entity read request into a list of timeline cache ids, separated by commas.</description> <name>yarn.timeline-service.entity-group-fs-store.group-id-plugin-classes</name> <value>org.apache.tez.dag.history.logging.ats.TimelineCachePluginImpl</value> </property>
yarn.timeline-service.entity-group-fs-store.retain-seconds
How long the ATS v1.5 entity group file system storage system will keep an application's data in the done directory.
Example:
<property> <description>How long the ATS v1.5 entity group file system storage system will keep an application's data in the done directory.</description> <name>yarn.timeline-service.entity-group-fs-store.retain-seconds</name> <value>604800</value> </property>
yarn.timeline-service.entity-group-fs-store.scan-interval-seconds
Scan interval for ATS v1.5 entity group file system storage reader.This value controls how frequent the reader will scan the HDFS active directory for application status.
Example:
<property> <description>Scan interval for ATS v1.5 entity group file system storage reader.This value controls how frequent the reader will scan the HDFS active directory for application status.</description> <name>yarn.timeline-service.entity-group-fs-store.scan-interval-seconds</name> <value>60</value> </property>
yarn.timeline-service.entity-group-fs-store.summary-store
Summary storage for ATS v1.5.
Example:
<property> <description>DFS path to store active application’s timeline dataSummary storage for ATS v1.5.</description> <name>yarn.timeline-service.entity-group-fs-store.summary-store</name> <value>org.apache.hadoop.yarn.server.timeline.RollingLevelDBTimelineStore</value> </property>
yarn.timeline-service.leveldb-timeline-store.path
Local FS path to store the leveldbs that hold the application summary data.
Example:
<property> <description>Local FS path to store the leveldbs that hold the application summary data.</description> <name>yarn.timeline-service.leveldb-timeline-store.path</name> <value><Data disk>/ats/leveldb/</value> </property>
yarn.timeline-service.leveldb-timeline-store.path
The store file path and name for the Timeline Server LevelDB store (if the LevelDB store is used).
Example:
<property> <description>Store file name for leveldb timeline store</description> <name>yarn.timeline-service.leveldb-timeline-store.path</name> <value>${yarn.log.dir}/timeline</value> </property>
yarn.timeline-service.store-class
Main storage class for YARN timeline server.
Example:
<property> <description>Main storage class for YARN timeline server. </description> <name>yarn.timeline-service.store-class</name> <value>org.apache.hadoop.yarn.server.timeline.EntityGroupFSTimelineStore</value> </property>
yarn.timeline-service.ttl-enable
Enable age-off of timeline store data.
Example:
<property> <description>Enable age off of timeline store data.</description> <name>yarn.timeline-service.ttl-enable</name> <value>true</value> </property>
yarn.timeline-service.ttl-ms
The Time-to-live for timeline store data (in milliseconds).
Example:
<property> <description>Time to live for timeline store data in milliseconds.</description> <name>yarn.timeline-service.ttl-ms</name> <value>604800000</value> </property>