Verifying metadata collection

After enabling Atlas metadata collection, newly submitted Flink jobs on the cluster are also submitting their metadata to Atlas. You can verify the metadata collection with messages in the command line by requesting information regarding the Atlas hook.

To verify the metadata collection, you can run the "Streaming WordCount" example from Running a Flink Job.

In the log, the following new lines appear:
20/05/13 06:28:12 INFO hook.FlinkAtlasHook: Collecting metadata for a new Flink Application: Streaming WordCount
20/05/13 06:30:35 INFO hook.AtlasHook: <== Shutdown of Atlas Hook

Flink communicates with Atlas through a Kafka topic, by default the one named ATLAS_HOOK.