To run the Hortonworks Data Platform, your system must meet minimum requirements.
Although there is no single hardware requirement for installing HDP, there are some basic guidelines. You can see sample setups here: Suggested Hardware for a Typical Hadoop Cluster.
The following operating systems are supported:
64-bit Red Hat Enterprise Linux (RHEL) 5 or 6
64-bit CentOS 5 or 6
By default, Hive use Derby database for its metastore. To use external database for Hive metastore, ensure that a MySQL database is deployed and available. Hive or HCatalog requires a MySQL database for its use.
You can choose to use a current instance of MySQL or install a new instance for its use. For more information, see Install MySQL (Optional).
Ensure that your database administrator creates the following databases and users.
For Hive, ensure that your database administrator creates
hive_dbname
,hive_dbuser
, andhive_dbpasswd
.
Note For instructions on creating users for MySQL, see here.
Your system must have the correct JDK installed on all the nodes of the cluster. HDP requires Oracle JDK 1.6 update 31.
Use the following instructions to manually install JDK 1.6 update 31:
Check the version. From a terminal window, type:
java -version
(Optional) Uninstall the Java package if the JDK version is less than v1.6 update 31.
rpm -qa | grep java yum remove {java-1.*}
(Optional) Verify that the default Java package is uninstalled.
which java
Download the Oracle 64-bit JDK (jdk-6u31-linux-x64.bin) from the Oracle download site. From your browser window, go to
http://www.oracle.com/technetwork/java/javasebusiness/downloads/java-archive-downloads-javase6-419409.html#jdk-6u31-oth-JPR
.Accept the license agreement and download
jdk-6u31-linux-x64.bin
.Download the JDK to a temporary directory (
$JDK_download_directory
).Change directory to
$JDK_download_directory
and run the install.mkdir /usr/jdk1.6.0_31 cd /usr/jdk1.6.0_31 chmod u+x $JDK_download_directory/jdk-6u31-linux-x64.bin ./$JDK_download_directory/jdk-6u31-linux-x64.bin
Create symbolic links (symlinks) to the JDK.
mkdir /usr/java ln -s /usr/jdk1.6.0_31/jdk1.6.0_31 /usr/java/default ln -s /usr/java/default/bin/java /usr/bin/java
Set up your environment to define
JAVA_HOME
to put the Java Virtual Machine and the Java compiler on your path.export JAVA_HOME=/usr/java/default export PATH=$JAVA_HOME/bin:$PATH
Verify if Java is installed in your environment. Execute the following from the command line console:
java -version
You should see the following output:
java version "1.6.0_31" Java(TM) SE Runtime Environment (build 1.6.0_31-b04) Java HotSpot(TM) 64-Bit Server VM (build 20.6-b01, mixed mode)
HDP is certified and supported when running on virtual or cloud platforms (for example, VMware vSphere or Amazon Web Services EC2) as long as the respective guest operating system (OS) is supported by HDP and any issues detected on these platforms are reproducible on the same supported OS installed on bare metal.
See Operating Systems Requirements for the list of supported operating systems for HDP.