Adding Flink as a Service

You need to use the Add Service wizard in Cloudera Manager to include the Flink service on your cluster. When assigning roles, you must install Flink, HDFS, and YARN roles on the same node from where the Flink jobs are submitted.

  • Make sure that the Flink CSD file is in the /opt/cloudera/csd folder.
  • Make sure that the CSA parcel is added to Cloudera Manager.
  • Check that the following components are installed on your cluster:
    Mandatory components Optional components
    YARN Kafka
    HDFS HBase
    Zookeeper Schema Registry
    Streams Messaging Manager
  1. Open Cloudera Manager.
  2. On the Home screen, select the drop-down menu to the right of your cluster.
  3. Select Add Service.
  4. From the list, select Flink as the type of service, then click Continue.
    The Add Service wizard is displayed.
  5. Choose HBase and Hive as Optional dependency if needed for the source and sink solution, then click Continue.
  6. Assign the Flink Dashboard role to one of the hosts, and the Flink Gateway role to every host.
  7. Click Continue.
  8. Review the changes needed for your service.
    You can leave this page blank as the settings can be configured after the Flink service is added. You can configure the security settings at Flink > Configuration > Security.
  9. Click Continue and wait until the first run of the Flink service is completed.
  10. Click Continue and then Finish.
You have added Flink as a service in Cloudera Manager.