Use the following instructions to deploy HDP on a single node Windows Server machine:
Install the necessary prerequisites using one of the following options:
Option I - Use CLI: Download all prerequisites to a single directory and use command line interface (CLI) to install these prerequisites on a machine.
Option II - Install manually: Download each prerequisite and follow the step by step GUI driven manual instructions provided after download.
Prepare the single node machine.
Collect Information.
Get the hostname of the server where you plan to install HDP. Open the command shell on that cluster host and execute the following command:
> hostname WIN-RT345SERVER
Use the output of this command to identify the cluster machine.
Configure firewall.
HDP uses multiple ports for communication with clients and between service components.
If your corporate policies require maintaining per server firewall, you must enable the ports listed here. Use the following command to open these ports:
netsh advfirewall firewall add rule name=AllowRPCCommunication dir=in action=allow protocol=TCP localport=$PORT_NUMBER
For example, the following command will open up port 80 in the active Windows Firewall:
netsh advfirewall firewall add rule name=AllowRPCCommunication dir=in action=allow protocol=TCP localport=135
For example, the following command will open ports all ports from
49152
to65535
. in the active Windows Firewall:netsh advfirewall firewall add rule name=AllowRPCCommunication dir=in action=allow protocol=TCP localport=49152-65535
If your networks security policies allow you open all the ports, use the following instructions to disable Windows Firewall: http://technet.microsoft.com/en-us/library/cc766337(v=ws.10).aspx
Specify the configuration for HDP on a single node machine.
Create a
clusterproperties.txt
file. (Theclusterproperties.txt
is a text file and contains parameter definitions (like the hostnames of the nodes in your cluster, the roles for each of them, etc.).)Start creating the
clusterproperties.txt
file by copying the example text provided at the bottom of this section and modify it according to the hostname of your machineThe following snapshot illustrates a sample
clusterproperties.txt
file:#Log directory HDP_LOG_DIR=c:\hadoop\logs #Data directory HDP_DATA_DIR=c:\hdp\data #Hosts (Roles for the host machines in your cluster) NAMENODE_HOST=${Hostname for your single node cluster} SECONDARY_NAMENODE_HOST=${Hostname for your single node cluster} JOBTRACKER_HOST=${Hostname for your single node cluster} HIVE_SERVER_HOST=${Hostname for your single node cluster} OOZIE_SERVER_HOST=${Hostname for your single node cluster} WEBHCAT_HOST=${Hostname for your single node cluster} FLUME_HOSTS=${Hostname for your single node cluster} HBASE_MASTER=${Hostname for your single node cluster} HBASE_REGIONSERVERS=${Hostname for your single node cluster} ZOOKEEPER_HOSTS=${Hostname for your single node cluster} SLAVE_HOSTS=${Hostname for your single node cluster} #Database host DB_FLAVOR=derby DB_HOSTNAME=${Hostname for your single node cluster} #Hive properties HIVE_DB_NAME=hive HIVE_DB_USERNAME=hive HIVE_DB_PASSWORD=hive #Oozie properties OOZIE_DB_NAME=oozie OOZIE_DB_USERNAME=oozie OOZIE_DB_PASSWORD=oozie
More details on the
clusterproperties.txt
configuration options are available here.Install and start HDP,
Download the HDP for Windows MSI from here.
Open a command prompt with Administrator priveliges and execute the MSI installer command:
msiexec /i "<$MSI_PATH>" /lv "<$PATH_to_Installer_Log_File>" HDP_LAYOUT="<$PATH_to_clusterproperties.txt_File>" HDP_DIR="<$PATH_to_HDP_Install_Dir>" DESTROY_DATA="<Yes_OR_No>"
The following example illustrates the command, with parameters, to launch the installer:
msiexec /i "hdp-win-1.1.msi" /lv "hdp.log" HDP_LAYOUT="C:\config\clusterproperties.txt" HDP_DIR="C:\hdp\hadoop" DESTROY_DATA="no"
As shown in the example above, the following command parameters should be modified to match your files and directotories:
HDP_LAYOUT: Absolute path to cluster properties file
HDP_DIR: Install directory for HDP
DESTROY_DATA: Whether to preserve or delete existing HDP data
Start all HDP services on the single machine.
In a command prompt, navigate to the HDP install directory. This is the 'HDP_DIR' setting from the msiexec command.
Then execute 'start_local_hdp_services.cmd'.
cd <$PATH_TO_HDP_DIR> start_local_hdp_services
Validate the install by running the full suite of smoke tests.
Run-SmokeTests