Monitoring SQL Stream jobs

You can use the Streaming SQL Console to review the status, properties and log of your SQL Stream jobs executed in SQL Stream Builder. Using the Flink Dashboard, you can also monitor the Flink job that is submitted when you execute a SQL query.

Using the Streaming SQL Console

To monitor your jobs with Streaming SQL Console:
  1. Click Console on the main menu.
  2. Go to the SQL Jobs tab, and choose a State.
    You can choose from Running, Stopped, Cancelled, and Failed state.
  3. Click on the job you want to monitor.
  4. Select Details tab on the bottom panel.
  5. Select Log tab on the bottom panel.
The Logs tab shows detailed logging from the Flink job - any exceptions is logged here. While the job processes messages, a count of messages processed is spooled to the log every 5 seconds:
8/13/2019, 9:42:49 AM - INFO - 2019-08-08 19:24:17.752157 : 5 Second Count:
        2502

History of SQL jobs

You can review all the SQL jobs that were executed on the History main tab. When you click on one of the SQL jobs, the SQL query and the job parameters are automatically imported to the SQL window for execution. You can filter the SQL jobs by the Last time they run or by the SQL statement that was executed before.

Using the Flink Dashboard

You can also monitor your running SQL jobs using the Flink Dashboard. You can easily reach the Flink Dashboard on the SQL jobs tab below the Console main menu. After clicking on the Flink Dashboard, you are redirected to the Flink Dashboard interface.