Chapter 7. Upgrading HDF Services
About This Task
If you are upgrading HDF Services in an Ambari-managed HDP cluster, some manual upgrade steps are required on each host where and HDF service is running.
Steps
Update the Base URL for HDF to the URL for HDF 3.0.2.
[root@host ~]# vi /etc/yum.repos.d/HDF.repo baseurl=<os-specific-base-url>
For the Base URL appropriate for your OS, see the HDF 3.0.2 Release Notes.
Confirm the HDF components and version you have installed.
For example:
[root@host registry]# yum list installed | grep HDF hdf-select.noarch 3.0.0.0-453.el6 @HDF-3.0 nifi_3_0_0_0_453.x86_64 1.2.0.3.0.0.0-453.el6 @HDF-3.0 0.7.0.3.0.0.0-453.el6 @HDF-3.0 registry_3_0_0_0_453.noarch 0.3.0.3.0.0.0-453.el6 @HDF-3.0 storm_3_0_0_0_453.x86_64 1.1.0.3.0.0.0-453.el6 @HDF-3.0 streamline_3_0_0_0_453.x86_64 0.5.0.3.0.0.0-453.el6 @HDF-3.0 zookeeper_3_0_0_0_453.noarch 3.4.6.3.0.0.0-453.el6 @HDF-3.0
Display the current version associated with each service.
For example:
[root@host registry]# hdf-select status | grep 3.0.0.0-453 nifi - 3.0.0.0-453 registry - 3.0.0.0-453 storm-client - 3.0.0.0-453 storm-nimbus - 3.0.0.0-453 storm-supervisor - 3.0.0.0-453 streamline - 3.0.0.0-453 zookeeper-client - 3.0.0.0-453 zookeeper-server - 3.0.0.0-453
Install the binaries for each HDF service.
Note On each Ambari Agent, do this only for the services you have already installed. For example, if only NiFi is installed, only perform the updated install for the NiFi service.
For example:
[root@host ~]# yum install -y nifi_3_0_2_0_76* [root@host ~]# yum install -y registry_3_0_2_0_76* [root@host ~]# yum install -y streamline_3_0_2_0_76*
Use
hdf-select
to ensure that you have the appropriate links to the newly installed version.Note Installing SAM creates Storm and ZooKeeper dependencies that you can address by falling the Warning notes during the installation.
For example:
[root@host ~]# hdf-select set nifi 3.0.2.0-76 [root@host ~]# hdf-select set registry 3.0.2.0-76 [root@host ~]# hdf-select set streamline 3.0.2.0-76 [root@host ~]# hdf-select set storm-nimbus 3.0.2.0-76 [root@host ~]# hdf-select set storm-supervisor 3.0.2.0-76 [root@host ~]# hdf-select set zookeeper-client 3.0.2.0-76 WARNING: Replacing link /usr/bin/zookeeper-client from /usr/hdp/current/zookeeper-client/bin/zookeeper-client [root@host ~]# hdf-select set zookeeper-server 3.0.2.0-76 WARNING: Replacing link /usr/bin/zookeeper-server from /usr/hdp/current/zookeeper-server/bin/zookeeper-server WARNING: Replacing link /usr/bin/zookeeper-server-cleanup from /usr/hdp/current/zookeeper-server/bin/zookeeper-server-cleanup
Confirm your HDF service upgrades.
For example:
[root@host ~]# hdf-select status | grep 3.0.2.0-76 nifi - 3.0.2.0-76 registry - 3.0.2.0-76 storm-nimbus - 3.0.2.0-76 storm-supervisor - 3.0.2.0-76 streamline - 3.0.2.0-76 zookeeper-client - 3.0.2.0-76 zookeeper-server - 3.0.2.0-76
Execute the following operation on one host where SAM is installed:
[root@host ~]# export JAVA_HOME=/usr/jdk64/jdk1.8.0_112 ; source /usr/hdf/current/streamline/conf/streamline-env.sh ; /usr/hdf/current/streamline/bootstrap/bootstrap-storage.sh create
Execute the following operation on one host where Schema Registry is installed:
[root@host ~]# export JAVA_HOME=/usr/jdk64/jdk1.8.0_112 ; source /usr/hdf/current/registry/conf/registry-env.sh ; /usr/hdf/current/registry/bootstrap/bootstrap-storage.sh create
Result
You can now log onto Ambari and start your upgraded NiFi, SAM, and Schema Registry services.