Cloudera Docs » 2.3.0 » Upgrading HDP Manually
Upgrading HDP Manually
Also available as:
PDF
loading table of contents...

​Upgrade HDP 2.2 Components

The upgrade process to HDP 2.3.0 involves the following steps. See the Release Notes for the HDP 2.3.0.0 repo information. Select your OS:

RHEL/CentOS/Oracle 6

  1. On all hosts, clean the yum repository.

    yum clean all

  2. Remove your old HDP 2.2 components. This command uninstalls the HDP 2.2 components. It leaves the user data, and metadata, but removes your configurations. Refer to the HDP Component Files for RHEL/CentOS/Oracle6 table for the names of the files that need to be removed for each component and use the following format:

    yum erase "accumulo_$VERSION_$BUILD*" "atlas_metadata_$VERSION_$BUILD*" "datafu_$VERSION_$BUILD*" "falcon_$VERSION_$BUILD*" "flume_$VERSION_$BUILD*" "hadoop_$VERSION_$BUILD*" "hadoop_$VERSION_$BUILD-client*" "hadoop_$VERSION_$BUILD-hdfs*" "hadooplzo_$VERSION_$BUILD*" ...

    Where:

    • $VERSION is the HDP version number in the following format: 2_3_0_0

    • $HUE-VERSION is the Hue version number in the following format : 2.6.1.2.3.0.0

    • $BUILD is the HDP build number in the following format : 3518

    So, the file name will look like: accumulo-2_3_0_0_3518*

    ​

    Table 1.4. HDP Component Files for RHEL/CentOS/Oracle6

    ComponentAssociated Files
    Accumuloaccumulo_$VERSION_$BUILD*
    Atlasatlas_metadata_$VERSION_$BUILD*
    Datafudatafu_$VERSION_$BUILD*
    Falconfalcon_$VERSION_$BUILD*
    Flumeflume_$VERSION_$BUILD*
    Hadoop (includes hadoop_client and hadoop_hdfs)

    hadoop_$VERSION_$BUILD*

    hadoop_$VERSION_$BUILD-client*

    hadoop_$VERSION_$BUILD-hdfs*

    hadooplzo_$VERSION_$BUILD*

    HBasehbase_$VERSION_$BUILD*
    Hive

    hive_$VERSION_$BUILD*

    hive_hbase_$VERSION_$BUILD*

    hive_hcatalog_$VERSION_$BUILD*

    hive_jdbc_$VERSION_$BUILD*

    hive_metastore_$VERSION_$BUILD*

    hive_server_$VERSION_$BUILD*

    hive_webhcathive_hbase_$VERSION_$BUILD*

    ranger_hive_$VERSION_$BUILD*

    Hue

    hue_$HUE_VERSION_$BUILD*

    hue_beeswax_$HUE_VERSION_$BUILD*

    hue_common_$HUE_VERSION_$BUILD*

    hue_hcatalog_$HUE_VERSION_$BUILD*

    hue_oozie_$HUE_VERSION_$BUILD*

    hue_pig_$HUE_VERSION_$BUILD*

    hue_server_$HUE_VERSION_$BUILD*

    Kafkakafka_$VERSION_$BUILD*
    Knoxknox_$VERSION_$BUILD*
    Mahoutmahout_$VERSION_$BUILD*
    MapReducehadoop_$VERSION_$BUILD-mapreduce*
    Oozieoozie_$VERSION_$BUILD*
    Phoenixphoenix_$VERSION_$BUILD
    Pigranger_$VERSION_$BUILD*
    Rangerranger_$VERSION_$BUILD*
    Sliderslider_$VERSION_$BUILD*
    Sparkspark_$VERSION_$BUILD*
    Sqoopsqoop_$VERSION_$BUILD*
    Stormstorm_$VERSION_$BUILD*
    Teztez_$VERSION_$BUILD*
    YARNhadoop_$VERSION_$BUILD-yarn*
    ZooKeeperzookeeper_$VERSION_$BUILD*

  3. Validate that all HDP 2.2 component binaries are uninstalled:

    yum list installed | grep @HDP2.2

  4. Remove your old hdp.repo file:

    rm /etc/yum.repos.d/hdp.repo

  5. Install the HDP 2.3.0 repo:

    • Download the hdp.repo file:

      wget -nv http://public-repo-1.hortonworks.com/HDP/centos6/2.x/updates/2.3.0.0/hdp.repo -O /etc/yum.repos.d/hdp.repo

    • Confirm the HDP repository is configured.

      yum repolist

      You should see something like this. Verify that you have the HDP-2.3.0 directory:

      Loaded plugins: fastestmirror, security 
Loading mirror speeds from cached hostfile
* base: mirrors.cat.pdx.edu
* extras: linux.mirrors.es.net
* updates: mirrors.usc.edu 
repo id repo namestatus
HDP-2.3.0 Hortonworks Data Platform Version - HDP-2.3.0

  6. Install the HDP 2.3.0 versions of the components that you want to upgrade. For example, if you installed and want to upgrade all HDP 2.2 components:

    yum install "hadoop" "hadoop-hdfs" "hadoop-libhdfs" "hadoop-yarn" "hadoop-mapreduce" "hadoop-client" "hadoop-lzo" "openssl" "hive-webhcat" "hive-hcatalog" "oozie" "collectd" "gccxml" "pig" "sqoop" "zookeeper" "hbase" "hue" "hive" "tez" "storm" "falcon" "flume" "phoenix" "accumulo" "mahout" "knox" "kafka" "spark" "ranger" "slider" "hdp_mon_nagios_addons"
    [Note]Note

    If you installed Apache Ranger, see Upgrade Ranger for more information on the upgrade path.

  7. Verify that the components were upgraded.

    yum list installed | grep HDP-<old.stack.version.number>

    No component file names should appear in the returned list.

SLES 11 SP 1

  1. On all hosts, clean the yum repository.

    zypper clean -all

  2. Remove your old HDP 2.2 components. This command uninstalls the HDP 2.2 components. It leaves the user data, and metadata, but removes your configurations. Refer to the HDP Component Files for SLES11 SP1 table for the names of the files that need to be removed for each component and use the following format:

    zypper rm "accumulo_$VERSION_$BUILD*" "datafu_$VERSION_$BUILD*" "falcon_$VERSION_$BUILD*" "flume_$VERSION_$BUILD*" "hadoop_$VERSION_$BUILD*" "hadooplzo_$VERSION_$BUILD*" ...

    The following table lists the files that need to be deleted for each of the HDP components. Variables are used to indicate:

    • $VERSION - HDP version number in the following format: 2_3_0_0

    • $HUE-VERSION - Hue version number in the following format : 2.6.1.2.3.0.0

    • $BUILD - the HDP build number in the following format : 3518

    So, the file name will look like: accumulo-2_3_0_0_3518*

    ​

    Table 1.5. HDP Component Files for SLES11 SP1

    ComponentAssociated Files
    Accumuloaccumulo_$VERSION_$BUILD*
    Atlasatlas_metadata_$VERSION_$BUILD*
    Datafudatafu_$VERSION_$BUILD*
    Falconfalcon_$VERSION_$BUILD*
    Flumeflume_$VERSION_$BUILD*
    Hadoop (includes hadoop_client and hadoop_hdfs)

    hadoop_$VERSION_$BUILD*

    hadoop_$VERSION_$BUILD-client*

    hadoop_$VERSION_$BUILD-hdfs*

    hadooplzo_$VERSION_$BUILD*

    HBasehbase_$VERSION_$BUILD*
    Hive

    hive_$VERSION_$BUILD*

    hive_hbase_$VERSION_$BUILD*

    hive_hcatalog_$VERSION_$BUILD*

    hive_jdbc_$VERSION_$BUILD*

    hive_metastore_$VERSION_$BUILD*

    hive_server_$VERSION_$BUILD*

    hive_webhcathive_hbase_$VERSION_$BUILD*

    ranger_hive_$VERSION_$BUILD*

    Hue

    hue_$HUE_VERSION_$BUILD*

    hue_beeswax_$HUE_VERSION_$BUILD*

    hue_common_$HUE_VERSION_$BUILD*

    hue_hcatalog_$HUE_VERSION_$BUILD*

    hue_oozie_$HUE_VERSION_$BUILD*

    hue_pig_$HUE_VERSION_$BUILD*

    hue_server_$HUE_VERSION_$BUILD*

    Kafkakafka_$VERSION_$BUILD*
    Knoxknox_$VERSION_$BUILD*
    Mahoutmahout_$VERSION_$BUILD*
    MapReducehadoop_$VERSION_$BUILD-mapreduce*
    Oozieoozie_$VERSION_$BUILD*
    Phoenixphoenix_$VERSION_$BUILD
    Pigranger_$VERSION_$BUILD*
    Rangerranger_$VERSION_$BUILD*
    Sliderslider_$VERSION_$BUILD*
    Sparkspark_$VERSION_$BUILD*
    Sqoopsqoop_$VERSION_$BUILD*
    Stormstorm_$VERSION_$BUILD*
    Teztez_$VERSION_$BUILD*
    YARNhadoop_$VERSION_$BUILD-yarn*
    ZooKeeperzookeeper_$VERSION_$BUILD*

  3. Validate that all HDP 2.2 component binaries are uninstalled:

    yum list installed | grep @HDP2.2

  4. Remove your old hdp.repo file:

    rm /etc/zypp/repos.d/hdp.repo

  5. Download the HDP 2.3.0 hdp.repo file:

    wget -nv http://public-repo-1.hortonworks.com/HDP/sles11sp1/2.x/updates/2.3.0.0/hdp.repo -O /etc/zypp/repos.d/hdp.repo

  6. Install the HDP 2.3.0 versions of the components that you want to upgrade. For example, if you installed and want to upgrade all HDP 2.2 components:

    zypper install "hadoop" "hadoop-hdfs" "hadoop-libhdfs" "hadoop-yarn" "hadoop-mapreduce" "hadoop-client" "openssl" "hive-webhcat" "hive-hcatalog" "oozie" "collectd" "gccxml" "pig" "sqoop" "zookeeper" "hbase" "hive" "hue" "tez" "storm" "falcon" "flume" "phoenix" "accumulo" "mahout" "knox" "kafka" "spark" "slider" "hdp_mon_nagios_addons"

    zypper install webhcat-tar-hive webhcat-tar-pig

    zypper up -r HDP-2.3

    zypper install oozie-client

    [Note]Note

    If you installed Apache Ranger, see Upgrade Ranger for more information on the upgrade path.

  7. Verify that the components were upgraded. For example, to verify hdfs, hive, and hcatalog:

    rpm -qa | grep hdfs && rpm -qa | grep hive && rpm -qa | grep hcatalog

    No component files names should appear in the returned list.

SLES 11 SP3/SP4

  1. On all hosts, clean the zypper repository.

    zypper clean -all

  2. Remove your old HDP 2.2 components. This command uninstalls the HDP 2.2 components. It leaves the user data, and metadata, but removes your configurations. Refer to the HDP Component Files for SLES11 SP3/SP4 table for the names of the files that need to be removed for each component and use the following format:

    zypper rm "accumulo-$VERSION-$BUILD*" "datafu-$VERSION-$BUILD*" "falcon-$VERSION-$BUILD*" "flume-$VERSION-$BUILD*" "hadoop-$VERSION-$BUILD*" "hadooplzo-$VERSION-$BUILD*" ...

    The following table lists the files that need to be deleted for each of the HDP components. Variables are used to indicate:

    • $VERSION - HDP version number in the following format: 2_3_0_0

    • $HUE-VERSION - Hue version number in the following format : 2.6.1.2.3.0.0

    • $BUILD - the HDP build number in the following format : 3518

    So, the file name will look like: accumulo-2_3_0_0_3518*

    ​

    Table 1.6. HDP Component Files for SLES11 SP3/SP4

    ComponentAssociated Files
    Accumuloaccumulo_$VERSION_$BUILD*
    Atlasatlas_metadata_$VERSION_$BUILD*
    Datafudatafu_$VERSION_$BUILD*
    Falconfalcon_$VERSION_$BUILD*
    Flumeflume_$VERSION_$BUILD*
    Hadoop (includes hadoop_client and hadoop_hdfs)

    hadoop_$VERSION_$BUILD*

    hadoop_$VERSION_$BUILD-client*

    hadoop_$VERSION_$BUILD-hdfs*

    hadooplzo_$VERSION_$BUILD*

    HBasehbase_$VERSION_$BUILD*
    Hive

    hive_$VERSION_$BUILD*

    hive_hbase_$VERSION_$BUILD*

    hive_hcatalog_$VERSION_$BUILD*

    hive_jdbc_$VERSION_$BUILD*

    hive_metastore_$VERSION_$BUILD*

    hive_server_$VERSION_$BUILD*

    hive_webhcathive_hbase_$VERSION_$BUILD*

    ranger_hive_$VERSION_$BUILD*

    Hue

    hue_$HUE_VERSION_$BUILD*

    hue_beeswax_$HUE_VERSION_$BUILD*

    hue_common_$HUE_VERSION_$BUILD*

    hue_hcatalog_$HUE_VERSION_$BUILD*

    hue_oozie_$HUE_VERSION_$BUILD*

    hue_pig_$HUE_VERSION_$BUILD*

    hue_server_$HUE_VERSION_$BUILD*

    Kafkakafka_$VERSION_$BUILD*
    Knoxknox_$VERSION_$BUILD*
    Mahoutmahout_$VERSION_$BUILD*
    MapReducehadoop_$VERSION_$BUILD-mapreduce*
    Oozieoozie_$VERSION_$BUILD*
    Phoenixphoenix_$VERSION_$BUILD
    Pigranger_$VERSION_$BUILD*
    Rangerranger_$VERSION_$BUILD*
    Sliderslider_$VERSION_$BUILD*
    Sparkspark_$VERSION_$BUILD*
    Sqoopsqoop_$VERSION_$BUILD*
    Stormstorm_$VERSION_$BUILD*
    Teztez_$VERSION_$BUILD*
    YARNhadoop_$VERSION_$BUILD-yarn*
    ZooKeeperzookeeper_$VERSION_$BUILD*

  3. Validate that all HDP 2.2 component binaries are uninstalled:

    zypper search --installed-only --repo HDP-2.2.6.0

  4. Remove your old hdp.repo file:

    rm /etc/zypp/repos.d/hdp.repo

  5. Download the HDP 2.3.0 hdp.repo file:

    http://public-repo-1.hortonworks.com/HDP/suse11sp3/2.x/updates/2.3.0.0/hdp.repo -O /etc/zypp/repos.d/hdp.repo

  6. Install the HDP 2.3.0 versions of the components that you want to upgrade. For example, if you installed and want to upgrade all HDP 2.2 components:

    zypper install "hadoop" "hadoop-hdfs" "hadoop-libhdfs" "hadoop-yarn" "hadoop-mapreduce" "hadoop-client" "openssl" "oozie" "collectd" "gccxml" "pig" "sqoop" "zookeeper" "hbase" "hue" "hive" "tez" "storm" "falcon" "flume" "phoenix" "accumulo" "mahout" "knox" "ranger" "kafka" "spark" "spark-python" "hdp_mon_nagios_addons" "slider" "hive-webcat" "hive-hcatalog""

    zypper up -r HDP-2.3

    zypper install oozie-clientt

    [Note]Note

    If you installed Apache Ranger, see Upgrade Ranger for more information on the upgrade path.

  7. Verify that the components were upgraded. For example, to verify hdfs, hive, and hcatalog:

    rpm -qa | grep hdfs, && rpm -qa | grep hive && rpm -qa | grep hcatalog

    No component files names should appear in the returned list.

© 2012–2021 by Cloudera, Inc.
Document licensed under the Creative Commons Attribution ShareAlike 4.0 License.
Cloudera.com | Documentation | Support | Community