Cloudera Docs

Upgrading Cloudera Streaming Analytics artifacts and services

You need to upgrade the Cloudera Streaming Analytics artifacts to the newer version by manually deleting the old CSD file from the repository, and adding the latest CSD file to the same location.

  • Upgrade Cloudera Base on premises to the 7.3.1 version. For more information see the Upgrading Cloudera Base on premises to a higher version documentation.
  • Review the Support Matrix page to ensure that you use the correct Operating System (OS), Java Development Kit (JDK) and database version that is compatible with the new Cloudera Streaming Analytics version.
  1. Ensure that the Flink and Cloudera SQL Stream Builder services are stopped on your cluster.
    1. Go to your cluster in Cloudera Manager.
    2. Select Cloudera SQL Stream Builder from the list of services.
    3. Click Action > Stop.
    4. Go back to the homepage of Cloudera Manager.
    5. Select Flink from the list of services.
    6. Click Action > Stop.
  2. Stop and remove any Load Balancer instances from the cluster.
    1. Go to your cluster in Cloudera Manager.
    2. Select Cloudera SQL Stream Builder from the list of services.
    3. Click Instances.
    4. If there's an instance with Load Balancer role, select it and click Actions for Selected > Delete.

    Cloudera Streaming Analytics 1.14.0 and higher uses the KNOX service for load balancing, without needing a load balancer instance. For more information see Enabling High Availability for Cloudera SQL Stream Builder.

  3. Download the new CSD files from the Download location.
    In case you are upgrading to the latest Cloudera Streaming Analytics version that includes Cloudera SQL Stream Builder, you also must download the Cloudera SQL Stream Builder CSD, and add it to the /opt/cloudera/csd folder with the new Flink CSD. For more information, see the Installing parcel and CSD documentation.
  4. Delete the old CSD version from /opt/cloudera/csd.
    1. Access the host where the CSD is stored. 
      ssh root@[***HOSTNAME***]
cd /opt/cloudera/csd
rm FLINK-1.19.1-csa1.13.1.0-57746039.jar
rm SQL_STREAM_BUILDER-1.19.1-csa1.13.1.0-57746039.jar
  5. Copy the new artifacts to the /opt/cloudera/csd folder. 
    scp [***DOWNLOAD LOCATION***]/FLINK-1.19.1-csa1.14.0.0-60467927.jar root@[***HOSTNAME***]/opt/cloudera/csd:
scp [***DOWNLOAD LOCATION***]/SQL_STREAM_BUILDER-1.19.1-csa1.14.0.0-60467927.jar root@[***HOSTNAME***]/opt/cloudera/csd:
  6. Ensure that you maintain the appropriate file ownership and access the attributes if needed. 
    chown cloudera-scm:cloudera-scm /opt/cloudera/csd/FLINK-1.19.1-csa1.14.0.0-60467927.jar
chown cloudera-scm:cloudera-scm /opt/cloudera/csd/SQL_STREAM_BUILDER-1.19.1-csa1.14.0.0-60467927.jar
  7. Restart the Cloudera Manager Server with the following command:
    • RHEL 8 Compatible, SLES 15, Ubuntu: 
      systemctl restart cloudera-scm-server
    • RHEL 7 Compatible, SLES 12, Ubuntu: 
      systemctl restart cloudera-scm-server
    • RHEL 6 Compatible: 
      service cloudera-scm-server restart
  8. Restart the Cloudera Management Services.
    When upgrading from versions lower than Cloudera Streaming Analytics 1.7.0:
    Due to the backend changes of Cloudera SQL Stream Builder, after adding the new CSD, the Cloudera SQL Stream Builder service will not work which is indicated in the list of services in the following way:
    The following error message is displayed when reviewing the configuration issue:
    This means that you need to manually remove the Streaming SQL Console role, and restart the Streaming SQL Engine role after activating the new parcel.
  9. Select Parcels on the Home > Hosts tab in the Cloudera Manager main navigation bar.
  10. Click on Parcel Repositories & Network Settings tab.
  11. Add the new Remote Parcel Repository URL for CSA. 
    https://[***USER:PASSWORD***]@archive.cloudera.com/p/csa/1.14.0.0/parcels/
  12. Click Save & Verify Configuration to commit the change.
  13. Click Close.
    You are redirected to the Parcels page.
  14. Deactivate the old version of the parcel on the Parcels page.
  15. Download, distribute, and activate the new version of the parcel.
  16. Select the Activate Only option when prompted in the wizard.
    For more information about the general process of Service Management, see the Cloudera Manager documentation.
  17. Navigate back to Clusters.
  18. Select Actions > Deploy Client Config.
    Deploying client configuration is needed as the Flink service becomes stale after activation.
  19. When upgrading from versions lower than Cloudera Streaming Analytics 1.7.0:
    Delete the Streaming SQL Console role from your cluster.
    1. Stop the Cloudera SQL Stream Builder service using Actions > Stop next to the Cloudera SQL Stream Builder service name.
    2. Select the Cloudera SQL Stream Builder service.
    3. Select the Streaming SQL Console role.
    4. Click Actions for Selected > Delete.
  20. Update the Admin Database for the Cloudera SQL Stream Builder service.
    1. Click Actions > Update Admin Database next to the Cloudera SQL Stream Builder service name.
  21. Start the Flink service.
    1. Click Actions > Start next to the Flink service name.
  22. Start the SQL Stream Builder service.
    1. Click Actions > Start next to the Cloudera SQL Stream Builder service name.
  23. Refresh your keytab in Streaming SQL Console.
    1. Select Cloudera SQL Stream Builder from the list of services.
    2. Click SQLStreamBuilder Console.
      The Streaming SQL Console opens in a new window.
    3. Select your username on the left main menu of Streaming SQL Console.
    4. Click Manage keytab.
    5. Provide your password again.
    6. Click Refresh Keytab.