Upgrade Procedure
Important | |
---|---|
Hortonworks strongly recommends that all users running HDP 2.3.4 upgrade to HDP 2.3.4.7. |
To upgrade your cluster from HDP 2.3.x to HDP 2.3.4:
Download the appropriate HDP 2.3.4 hdp.repo file for your OS:
Operating System
Repository Location
Debian 6
http://public-repo-1.hortonworks.com/HDP/debian6/2.x/updates/2.3.4.0/hdp.list
Debian 7
http://public-repo-1.hortonworks.com/HDP/debian7/2.x/updates/2.3.4.0/hdp.list
RHEL/CentOS/Oracle LINUX 6
http://public-repo-1.hortonworks.com/HDP/centos6/2.x/updates/2.3.4.0/hdp.repo
RHEL/CentOS/Oracle LINUX 7
http://public-repo-1.hortonworks.com/HDP/centos7/2.x/updates/2.3.4.0/hdp.repo
SLES 11 SP3/SP4
http://public-repo-1.hortonworks.com/HDP/suse11sp3/2.x/updates/2.3.4.0/hdp.repo
Ubuntu 12
http://public-repo-1.hortonworks.com/HDP/ubuntu12/2.x/updates/2.3.4.0/hdp.list
Ubuntu 14
http://public-repo-1.hortonworks.com/HDP/ubuntu14/2.x/updates/2.3.4.0/hdp.list
or
Download the HDP RPM single repository tarball. (For information on how to install the repositories, see the local repository instructions.)
Operating System
Tarball Location
Debian 6
http://public-repo-1.hortonworks.com/HDP/debian6/2.x/updates/2.3.4.0/HDP-2.3.4.0-debian6-deb.tar.gz
Debian 7
http://public-repo-1.hortonworks.com/HDP/debian7/2.x/updates/2.3.4.0/HDP-2.3.4.0-debian7-deb.tar.gz
RHEL/CentOS/Oracle LINUX 6
http://public-repo-1.hortonworks.com/HDP/centos6/2.x/updates/2.3.4.0/HDP-2.3.4.0-centos6-rpm.tar.gz
RHEL/CentOS/Oracle LINUX 7
http://public-repo-1.hortonworks.com/HDP/centos7/2.x/updates/2.3.4.0/HDP-2.3.4.0-centos7-rpm.tar.gz
SLES 11 SP3/SP4
Ubuntu 12
Ubuntu 14
Run an update:
apt-get update
Install the HDP 2.3.4 bits:
Operating System
Commands
RHEL/CentOS/Oracle LINUX
Install HDP 2.3.4 components on relevant nodes, according to the services that run on those hosts:
yum install "hadoop_2_3_4_3485*" "oozie_2_3_4_3485*" "pig_2_3_4_3485*" "sqoop_2_3_4_3485*" "zookeeper_2_3_4_3485*" "hbase_2_3_4_3485*" "hive_2_3_4_3485*" "tez_2_3_4_3485*" "storm_2_3_4_3485*" "falcon_2_3_4_3485*" "flume_2_3_4_3485*" "phoenix_2_3_4_3485*" "accumulo_2_3_4_3485*" "mahout_2_3_4_3485*"
SLES
Install HDP 2.3.4 components on relevant nodes, according to the services that run on those hosts:
zypper install "hadoop_2_3_4_3485*" "oozie_2_3_4_3485*" "pig_2_3_4_3485*" "sqoop_2_3_4_3485*" "zookeeper_2_3_4_3485*" "hbase_2_3_4_3485*" "hive_2_3_4_3485*" "tez_2_3_4_3485*" "storm_2_3_4_3485*" "falcon_2_3_4_3485*" "flume_2_3_4_3485*" "phoenix_2_3_4_3485*" "accumulo_2_3_4_3485*" "mahout_2_3_4_3485*"
Ubuntu/Debian
Install HDP 2.3.4 components on relevant nodes, according to the services that run on those hosts:
apt-get install "hadoop-2-3-4-3485*" "oozie-2-3-4-3485*" "pig-2-3-4-3485*" "sqoop-2-3-4-3485*" "zookeeper-2-3-4-3485*" "hbase-2-3-4-3485*" "hive-2-3-4-3485*" "tez-2-3-4-3485*" "storm-2-3-4-3485*" "falcon-2-3-4-3485*" "flume-2-3-4-3485*" "phoenix-2-3-4-3485*" "accumulo-2-3-4-3485*" "mahout-2-3-4-3485*"
Stop all HDP 2.3.x Services for your scenario:
For non-Ambari managed clusters:
Stop all HDP 2.3.x services using the Stopping HDP Services section of the HDP Reference Guide.
For Ambari 1.7.0-managed clusters:
Open Ambari Web.
Browse to Services.
Use Service Actions to stop each service.
For all services, switch the active version to HDP 2.3.4.
On each host in the cluster, use hdp-select to switch all services to the HDP 2.3.4 version:
hdp-select set all <hdp2.3.4 version>
Complete the Stack Upgrade for your scenario:
For non-Ambari managed clusters:
The following components experienced changes to the required workflow. Please take them into account when upgrading your environment:
Component Link Atlas Falcon HBase Hive Hue Kafka Oozie Ranger Tez For Ambari 1.7.0-managed clusters:
Update the repository Base URLs to use the HDP 2.3.4 repositories for HDP and HDP-UTILS:
Open Ambari Web.
Browse to Admin > Repositories.
Edit the Base URLs.
Start all HDP 2.3.4 services, in the following order:
ZooKeeper
su - zookeeper export ZOOCFGDIR=/usr/hdp/current/zookeeper-server/conf ; export ZOOCFG=zoo.cfg; source /usr/hdp/current/zookeeper-server/conf/zookeeper-env.sh ; /usr/hdp/current/zookeeper-server/bin/zkServer.sh start
(HA NameNode upgrade only) ZooKeeper Failover Controller Daemons
/usr/hdp/current/hadoop-hdfs-namenode/../hadoop/sbin/hadoop-daemon.sh start zkfc
(HA NameNode upgrade only) JournalNodes
su - hdfs /usr/hdp/current/hadoop-hdfs-journalnode/../hadoop/sbin/hadoop-daemon.sh start journalnode
HDFS NameNode(s)
Start the HDFS NameNode(s). Because there is no metadata schema update for this upgrade, start the NameNode(s) in normal mode:
su - hdfs /usr/hdp/current/hadoop-hdfs-namenode/../hadoop/sbin/hadoop-daemon.sh start namenode
Remaining Services
Start the rest of the HDP services. On each host in the cluster, start the services that are relevant to that cluster. To identify the start commands for all services, see "Controlling HDP Services Manually" in the HDP Reference Guide.
You now have an upgraded cluster. Ensure that your workloads run correctly on this upgraded cluster.