CDH 5 to CDP Private Cloud BasePDF version

Step 7: Configure Streams Messaging Manager

Additional steps

My Environment

Fill in the following form to create a customized set of instructions for your environment.

Fill out the form above before you proceed.

To share this environment with others, click the icon next to My Environment to copy a link specific for this environment to the clipboard.

5.16 5.15 5.14 5.13 7.6.7 7.4.4 5.16 5.15 5.14 5.13 7.1.7.2000 7.1.7

If your cluster uses Streams Messaging Manager, you need to update database related configuration properties and configure the streamsmsgmgr user’s home directory. In addition, if you are using MySQL to store Streams Messaging Manager metadata, you also need to download the JDBC Driver for MySQL (Connector/J) to Streams Messaging Manager hosts.

  1. Stop the Streams Messaging Manager Service:
    1. In Cloudera Manager, select the Streams Messaging Manager service.
    2. Click Actions > Stop.
    3. Click Stop on the next screen to confirm.

      When you see a Finished status, the service has stopped.

    4. Click Close.
  2. Configure database related properties:
    1. In Cloudera Manager, select the Streams Messaging Manager service.
    2. Go to Configuration.
    3. Find and configure the following properties:
      • Streams Messaging Manager Database User Password
      • Streams Messaging Manager Database Type
      • Streams Messaging Manager Database Name
      • Streams Messaging Manager Database User
      • Streams Messaging Manager Database Host
      • Streams Messaging Manager Database Port
    4. Click Save Changes.
  3. Change the streamsmsgmgr user’s home directory:
    1. Log in to the Streams Messaging Manager host.
      ssh [MY_STREAMS_MESSAGING_MANAGER_HOST]
    2. Change the streamsmsgmgr user’s home directory to /var/lib/streams_messaging_manager.
      Rhel-compatible:
      usermod -d /var/lib/streams_messaging_manager -m streamsmsgmgr
  4. Download the JDBC Driver for MySQL (Connector/J) to the Streams Messaging Manager host and make it available in the required locations:
    1. Download the JDBC Driver for MySQL (Connector/J) from the MySQL Product Archives.
      Cloudera recommends that you use version 5.1.46. Examples in the following steps assume that you downloaded version 5.1.46. Make sure that you download or copy the JDBC Driver for MySQL (Connector/J) archive to the host that Streams Messaging Manager is deployed on.
      • If your cluster has internet access, download the archive directly to the host. 
        wget https://downloads.mysql.com/archives/get/p/3/file/mysql-connector-java-5.1.46.tar.gz
      • If internet access is not available, download it on a machine that has access and then copy it over to your host.
    2. Extract the archive.
      Use the tar command or any other archive manager to extract the archive.
      tar -xzvf [ARCHIVE_PATH]
      Replace [ARCHIVE_PATH] with the path to the archive you have downloaded. For example, /root/mysql-connector-java-5.1.46.tar.gz.
    3. Copy the mysql-connector-java-5.1.46-bin.jar JAR file from the extracted archive to the parcel directory.
      cp [MYSQL_CONNECTOR_JAR] /opt/cloudera/parcels/CDH-[VERSION_NUMBER]/jars

      Replace [MYSQL_CONNECTOR_JAR] with the path to the connector JAR file. You can find the JAR file within the directory you extracted in the previous step. For example, /root/mysql-connector-java-5.1.46/mysql-connector-java-5.1.46-bin.jar. Replace [VERSION_NUMBER] with the version number of the parcel you are upgrading to.

    4. Create symlinks to make the connector available in the required locations by running the following commands.
      cd /opt/cloudera/parcels/CDH-[VERSION_NUMBER]/lib/streams_messaging_manager/bootstrap/lib

      ln -s ../../../../jars/mysql-connector-java-5.1.46-bin.jar 

      cd /opt/cloudera/parcels/CDH-[VERSION_NUMBER]/lib/streams_messaging_manager/libs

      ln -s ../../../jars/mysql-connector-java-5.1.46-bin.jar

If your cluster uses Streams Messaging Manager, you need to update database related configuration properties and configure the streamsmsgmgr user’s home directory.

  1. Stop the Streams Messaging Manager Service:
    1. In Cloudera Manager, select the Streams Messaging Manager service.
    2. Click Actions > Stop.
    3. Click Stop on the next screen to confirm.

      When you see a Finished status, the service has stopped.

    4. Click Close.
  2. Configure database related properties:
    1. In Cloudera Manager, select the Streams Messaging Manager service.
    2. Go to Configuration.
    3. Find and configure the following properties:
      • Streams Messaging Manager Database User Password
      • Streams Messaging Manager Database Type
      • Streams Messaging Manager Database Name
      • Streams Messaging Manager Database User
      • Streams Messaging Manager Database Host
      • Streams Messaging Manager Database Port
    4. Click Save Changes.
  3. Change the streamsmsgmgr user’s home directory:
    1. Log in to the Streams Messaging Manager host.
      ssh [MY_STREAMS_MESSAGING_MANAGER_HOST]
    2. Change the streamsmsgmgr user’s home directory to /var/lib/streams_messaging_manager.
      Rhel-compatible:
      usermod -d /var/lib/streams_messaging_manager -m streamsmsgmgr