Running a simple Flink application

In this example, you will use the Stateless Monitoring Application from the Flink Tutorials to build your Flink project, submit a Flink job and monitor your Flink application using the Flink Dashboard in an unsecured environment.

  • You have a Cloudera on cloud environment.
  • You have a Cloudera username (it can be your own Cloudera user or a Cloudera machine user) and a password set to access Cloudera Data Hub clusters.

    The predefined resource role of this user is at least EnvironmentUser. This resource role provides the ability to view Cloudera Data Hub clusters and set the FreeIPA password for the environment.

  • Your user is synchronized to the Cloudera on cloud environment.
  • You have a Cloudera Streaming Analytics cluster.
  1. Clone the simple tutorial from git:
    git clone https://github.com/cloudera/flink-tutorials.git
  2. Access the simple tutorial folder:
    cd flink-tutorials/flink-simple-tutorial
  3. Build your Flink project using maven:
    mvn clean package
  4. Upload the Flink project to your cluster.
    scp <location>/flink-stateful-tutorial-1.2-SNAPSHOT.jar <your_workload_username>@<master_node_FQDN>:.
    Password:<your_workload_password>
  5. Run the Flink application:
    flink run -d -p 2 -ynm HeapMonitor target/flink-simple-tutorial-1.2-SNAPSHOT.jar
  6. Navigate to Cloudera Management Console > Environments, and select the environment where you have created your cluster.
  7. Select the Cloudera Streaming Analytics cluster.
  8. Click Flink Dashboard from the services.
    The Flink Dashboard opens in a new window.
  9. Click Task Manager on the left side menu.
  10. Monitor your Flink application under logs.