Adding Flink as a Service

You need to use the Add Service wizard in Cloudera Manager to have the Flink service on your cluster. When assigning roles, you must install Flink, HDFS and YARN Gateway roles on the same node from where the Flink jobs are submitted.

Make sure that the Flink CSD file is in the /opt/cloudera/csd folder.
Make sure that the CSA parcel is added to Cloudera Manager.

Check that the following components are installed on your cluster:


Mandatory components	Optional components
YARN	Kafka
HDFS	HBase
Zookeeper	Schema Registry
	Streams Messaging Manager
	Kudu
	Hive
	Atlas

Open Cloudera Manager.
On the Home screen, select the drop-down menu to the right of your cluster.
Select Add Service.
From the list, select Flink as the type of service, then click Continue.
The Add Service wizard will launch.
Choose HBase and Hive as Optional dependency if needed for the source and sink solution, then click Continue.
Assign roles to the History Server and Gateway, then click Continue.

note

Install Flink, HDFS, and YARN Gateway roles on the same machine that will be used to submit Flink jobs. The Flink HistoryServer role also depends on having HDFS client configurations on the same machine. The HDFS client configurations can either be provided by an HDFS daemon role implicitly or can be deployed by an HDFS Gateway role explicitly.
Review the changes needed for your service.

note

You can leave this page blank as the settings are configured automatically. You can later change the security settings at Flink > Configuration > Security.
Click Continue and wait until the first run of the Flink service is completed.
Click Continue and then Finish.

You have added Flink as a service in Cloudera Manager.