Use the YARN CLI to view logs for applications
You can use the YARN CLI (Command Line Interface) to view log files for applications.
You can access container log
files using the YARN ResourceManager web UI, but more options are available when you use
the yarn logs
CLI command.
View all Log Files for an Application
Use the following command format to view all logs for an
application:
yarn logs -applicationId <Application ID>
View a Specific Log Type for an Application
Use the following command format to view all logs of a particular type for an
application:
yarn logs -applicationId <Application ID> -log_files <log_file_type>
For example, to view only the
stderr
error
logs:yarn logs -applicationId <Application ID> -log_files stderr
The -logFiles
option also supports Java regular expressions, so the
following format would return all types of log files:
yarn logs -applicationId <Application ID> -log_files .*
View ApplicationMaster Log Files
Use the following command format to view all ApplicationMaster container log files for
an
application:
yarn logs -applicationId <Application ID> -am ALL
Use the following command format to view only the first ApplicationMaster container log
files:
yarn logs -applicationId <Application ID> -am 1
List Container IDs
Use the following command format to list all container IDs for an application:
yarn logs -applicationId <Application ID> -show_application_log_info
View Log Files for One Container
Once you have the container IDs, you can use the following command format to list the
log files for a particular
container:
yarn logs -applicationId <Application ID> -containerId <Container ID>
Show Container Log File Information
Use the following command format to list all of the container log file names (types) for
an
application:
yarn logs -applicationId <Application ID> -show_container_log_info
You
can then use the -logFiles
option to view a particular log type.View a Portion of the Log Files for One Container
For large container log files, you can use the following command format to list only a
portion of the log files for a particular
container:
yarn logs -applicationId <Application ID> -containerId <Container ID> -size <bytes>
To view the first 1000
bytes:
yarn logs -applicationId <Application ID> -containerId <Container ID> -size 1000
To view the last 1000
bytes:
yarn logs -applicationId <Application ID> -containerId <Container ID> -size -1000
Download Logs for an Application
Use the following command format to download logs to a local
folder:
yarn logs -applicationId <Application ID> -out <path_to_local_folder>
The container log files are organized in parent folders labeled with the applicable node ID.
Display Help for YARN Logs
To display Help for
yarn logs
, run the following
command:yarn logs -help