Upgrade HDP 1.3 Components
The upgrade process to HDP-2.3.6 involves the following steps. See the HDP-2.3.6 Release Notes for repo information.
RHEL/CentOS/Oracle 6
On all hosts, clean the yum repository.
yum clean all
Remove your old HDP 1.3 components. This command uninstalls the HDP 1.3 components. It leaves the user data, metadata and modified configurations in place and does not delete them:
yum erase "hadoop*" "webhcat*" "hcatalog*" "oozie*" "collectd*" "gccxml*" "pig*" "hdfs*" "sqoop*" "zookeeper*" "hbase*" "hive*" "flume*" "mahout*" "hue" "hue-common" "hue-shell" "hdp_mon_nagios_addons"
Remove your old hdp.repo file:
rm /etc/yum.repos.d/hdp.repo
Install the HDP 2.3.6 repo:
Download the hdp.repo file:
wget -nv http://public-repo-1.hortonworks.com/HDP/centos6/2.x/updates/2.3.6.0/hdp.repo -O /etc/yum.repos.d/hdp.repo
Confirm the HDP repository is configured.
yum repolist
You should see something like this. Verify that you have the HDP-2.3.6.0 directory:
Loaded plugins: fastestmirror, security Loading mirror speeds from cached hostfile * base: mirrors.cat.pdx.edu * extras: linux.mirrors.es.net * updates: mirrors.usc.edu repo id repo namestatus HDP-2.3.6.0 Hortonworks Data Platform Version - HDP-2.3.6.0
Install the HDP 2.3.6 versions of the components that you want to upgrade. For example, if you installed and want to upgrade all HDP 1.3 components:
yum install "hadoop" "hadooplzo" "webhcat" "oozie" "collectd" "gccxml" "pig" "sqoop" "zookeeper" "hbase" "hive" "flume" "mahout" "hue" "knox" "hdp_mon_nagios_addons"
Verify that the components were upgraded.
yum list installed | grep HDP-<old.stack.version.number>
No component file names should appear in the returned list.
RHEL/CentOS/Oracle 5 (Deprecated)
On all hosts, clean the yum repository.
yum clean all
Remove your old HDP 1.3 components. This command uninstalls the HDP 1.3 components. It leaves the user data and metadata but deletes your modified configurations:
yum erase "hadoop*" "webhcat*" "hcatalog*" "oozie*" "collectd*" "gccxml*" "pig*" "hdfs*" "sqoop*" "zookeeper*" "hbase*" "hive*" "flume*" "mahout*" "hue" "hue-common" "hue-shell" "hdp_mon_nagios_addons"
Remove your old hdp.repo file:
rm /etc/yum.repos.d/hdp.repo
Install the HDP 2.3.6 repo:
Download the hdp.repo file:
wget -nv http://public-repo-1.hortonworks.com/HDP/centos5/2.x/updates/2.3.6.0/hdp.repo -O /etc/yum.repos.d/hdp.repo
Confirm the HDP repository is configured.
yum repolist
You should see something like this. Verify that you have the HDP-2.3.6.0 directory:
Loaded plugins: fastestmirror, security Loading mirror speeds from cached hostfile * base: mirrors.cat.pdx.edu * extras: linux.mirrors.es.net * updates: mirrors.usc.edu repo id repo namestatus HDP-2.3.6.0 Hortonworks Data Platform Version - HDP-2.3.6.0
Install the HDP 2.3.6 versions of the components that you want to upgrade. For example, if you installed and want to upgrade all HDP 1.3 components:
yum install "hadoop" "hadooplzo" "webhcat" "oozie" "collectd" "gccxml" "pig" "sqoop" "zookeeper" "hbase" "hive" "flume" "mahout" "hue" "knox" "hdp_mon_nagios_addons"
Verify that the components were upgraded.
yum list installed | grep HDP-<old.stack.version.number>
No component file names should appear in the returned list.
SLES 11 SP 1
On all hosts, clean the yum repository.
zypper clean -all
Remove your old HDP 1.3 components. This command uninstalls the HDP 1.3 components. It leaves the user data and metadata but deletes your modified configurations:
zypper rm "hadoop*" "webhcat*" "hcatalog*" "oozie*" "collectd*" "gccxml*" "pig*" "hdfs*" "sqoop*" "zookeeper*" "hbase*" "hive*" "flume*" "mahout*" "hue" "hue-common" "hue-shell" "hdp_mon_nagios_addons"
Remove your old hdp.repo file:
rm /etc/zypp/repos.d/hdp.repo
Install the HDP 2.3.6 repo:
Download the hdp.repo file:
wget -nv http://public-repo-1.hortonworks.com/HDP/sles11sp1/2.x/updates/2.3.6.0/hdp.repo -O /etc/zypp/repos.d/hdp.repo
Install the HDP 2.3.6 versions of the components that you want to upgrade. For example, if you installed and want to upgrade all HDP 1.3 components:
zypper install "hadoop" "webhcat" "oozie" "collectd" "gccxml" "pig" "hdfs" "sqoop"
"zookeeper" "hbase" "hive" "flume" "mahout" "hue" "hdp_mon_nagios_addons"
zypper install webhcat-tar-hive webhcat-tar-pig
zypper up -r HDP-2.3.6.0
zypper install oozie-client
Verify that the components were upgraded. For example, to verify hdfs, hive, and hcatlog:
rpm -qa | grep hdfs, && rpm -qa | grep hive && rpm -qa | grep hcatalog
No component files names should appear in the returned list.