Installing CSD and parcel

For installing Cloudera Streaming Analytics (CSA), you need to add the downloaded Flink Custom Service Descriptor (CSD) file to the default CSD directory, and add the parcel to your cluster using Cloudera Manager.

  • Download the CSD and parcel file.
  • Install CDP Private Cloud Base.
  • Check that the following components are installed:
    Required components Optional components
    YARN Kafka
    HDFS HBase
    Zookeeper Schema Registry
    Streams Messaging Manager
  1. Place the CSD file in the /opt/cloudera/csd/ folder (default CSD directory).
    This way Cloudera Manager will automatically detect the CSD file.
  2. Change the ownership of the CSD file.
    > chown cloudera-scm:cloudera-scm FLINK-1.10.0-csa1.2.0.0-cdh7.1.1.0-565-3525501.jar
  3. Restart Cloudera Manager and CMS services for the changes to take effect.
    > systemctl restart cloudera-scm-server
  4. Log into Cloudera Manager.
  5. Select Parcels on the Home > Hosts tab in the main navigation bar.
  6. Click the Parcel Repositories & Network Settings tab.
  7. Check that Cloudera Manager successfully auto-detected the Remote Parcel Repository URL for CSA.
  8. Enter your download credentials to HTTP authentication username override for Cloudera Repositories and HTTP authentication password override for Cloudera Repositories.
  9. Click Save & Verify Configuration to commit the change.
  10. Click Close.
    You will be redirected to the Parcels page.
  11. Search for Flink and click Download to download the parcel to the local repository.
  12. After the download is completed, click Distribute to distribute the parcel to all clusters.
  13. After the parcel is distributed, click Activate to activate the parcel.
  14. Click OK when confirmation is required.

    For more details, follow the standard procedure from the GUI or the API.

You have added the Flink CSD file and parcel to your cluster. You can test your installation using the following command on any node in your cluster:
> flink --version
Version: 1.10.0-csa1.2.0.0, Commit ID: 04dddd1
Add Flink as a service in Cloudera Manager.