Including and Excluding Log Files in YARN Applications Running on Slider
For YARN applications running on Slider, log aggregation is specified in the global
section of the
resources.json
: configuration file:
"global": { "yarn.log.include.patterns": "", "yarn.log.exclude.patterns": "" },
If yarn.log.include.patterns
is empty, all container logs are included.
You can specify the name(s) of log files (for example, agent.log
) that you
do not want to aggregate using yarn.log.exclude.patterns
.
For example, the following resources.json
property settings will aggregate all logs beginning with "std", but exclude the stderr
log.
"global": { "yarn.log.include.patterns": "std*", "yarn.log.exclude.patterns": "stderr" },
The aggregated logs are stored in the HDFS /app-logs/
directory. The following command can be used to retrieve the logs:
yarn logs -applicationId <app_id>
Note | |
---|---|
For applications deployed directly on YARN, you can use
|