In this step you will upgrade and validate each Zookeeper process, node by node.
Switch to the zookeeper_admin user (default =
zookeeper
) and run the followingstat
command for each node in the Zookeeper quorum until you find the leader:su - zookeeper
echo stat | nc <servername> <port> | grep Mode
exit
For example, to check nodes
hdp1
andhdp2
, assuming they use default ZooKeeper server port 2181:[zookeeper@hdp1 ~] echo stat | nc hdp1 2181 | grep Mode Mode: follower [zookeeper@hdp1 ~] echo stat | nc hdp2 2181 | grep Mode Mode: leader [zookeeper@hdp1 ~] exit
Note This is an optimization step. If the leader changes later, it won’t impact the outcome of the upgrade process.
Upgrade Zookeeper on each node. Start with follower nodes. Upgrade the leader node last.
On each follower node, stop, switch, and start the daemon. Validate that the quorum has been reestablished before continuing with the next node:
Stop the Zookeeper server, switch to the new version, and start the server:
su - zookeeper -c "source /usr/hdp/current/zookeeper-server/conf/zookeeper-env.sh ; env ZOOCFGDIR=/usr/hdp/current/zookeeper-server/conf ZOOCFG=zoo.cfg /usr/hdp/current/zookeeper-server/bin/zkServer.sh stop"
hdp-select set zookeeper-server 2.2.8.0-3150
su - zookeeper -c "source /usr/hdp/current/zookeeper-server/conf/zookeeper-env.sh ; env ZOOCFGDIR=/usr/hdp/current/zookeeper-server/conf ZOOCFG=zoo.cfg /usr/hdp/current/zookeeper-server/bin/zkServer.sh start"
Validate the upgrade: check that the Zookeeper quorum has been reestablished before upgrading the next node. Create a new
znode
on the node just upgraded, and then list the createdznode
.For example, start a
zkCli
process (Zookeeper shell):/usr/hdp/current/zookeeper-server/bin/zkCli.sh
Create a znode called
znode-1
. Associate the string "my_data" with the node:[zk: localhost:2181(CONNECTED) 20] create /znode-1 my_data Created /znode-1
List the
node-1
test directory:[zk: localhost:2181(CONNECTED) 21] ls /znode-1 []
Remove the test node and exit zkcli:
[zk: localhost:2181(CONNECTED) 22] delete /znode-1 [zk: localhost:2181(CONNECTED) 21] quit Quitting... [hdp@hdp1 /]#
Repeat the validation step until successful, or until you have completed ten attempts. If the test does not succeed after ten tries, see if the Zookeeper process is running. If not, check Zookeeper logs for an indication of the problem.
After upgrading Zookeeper successfully on each follower node, perform the preceding upgrade steps for the leader node.
If the upgrade is unsuccessful or validations fail, follow the Zookeeper downgrade steps in Downgrading the Cluster.