Hortonworks provides a PowerShell script called push_install_hdp.ps1
,
which is included in the resources directory of the installer zip. The script installs HDP one
system at a time on all hosts defined in the cluster properties file. Use this script to
deploy HDP to a small test cluster. The script does not require shared storage, it copies the
installation files to the target using the Windows Administrative Share.
Before running the script, ensure that the Admin Share is enabled on all cluster hosts, and that the Administrator account executing the script has the privileges to write to the cluster hosts.
To use the Push Install HDP script:
On the host nodes, complete all the prerequisites described in Before You Begin. Make sure you set an environment variable for
JAVA_HOME
. (Remember, Java cannot be installed in a location where the pathname includes spaces.)Be especially careful to identify:
Supported operating system
Dependent software and environment variable settings
Enable PowerShell remote scripting and set cluster nodes as trusted hosts
Resolvable host names and static IPv4 addresses
Open ports required for HDP operation
Additionally, on each host:
Enable the Administrative Share:
netsh firewall set service type remoteadmin enabled
Create the a target directory to which the installer can copy the files used for the installation:
mkdir D:\MSI_Install
Download the HDP Windows Installation package. The package includes a sample cluster properties file called
clusterproperties.txt
.Define your cluster properties and save them in a file; see Manually Creating a Cluster Properties File.
Important Nodes in the cluster communicate with each other using the host name or IP address defined in the cluster properties file. For multi-homed systems (systems that can be accessed internally and externally) and systems with more than one NIC, ensure that the preferred name or IP address is specified in the Cluster Properties file.
Copy the HDP MSI Installer, your custom cluster properties file, and
push_install_hdp.ps1
to the source directory on the master install node (the host from which you are running the push install).Determine the MSI command line parameters. For information about parameters, see About the HDP MSI Installer and HDP Public Properties. For examples of
msiexec
commands, see Installing HDP from the Command Line.On the master install node, open a command prompt with
run as Administrator
, and enter:cd source_pathpowershell -File push_install_hdp.ps1 source_path destination_path clusterproperties_file files_list skip msiexec_command -parallel
where:
source_path
is the absolute path to the installation files. This directory must contain the HDP MSI and the cluster properties file, as well as any other files the installer will push to the cluster nodes; for example,D:\MSI_Install
.destination_path
is the absolute path to an existing directory on the target cluster nodes. All nodes must have this directory. The installer copies files_list fromsource_path
todestination_path
. Specify destination path as a local path on the target host; for example,D:\MSI_Install
.clusterproperties_file
is the name of your custom cluster properties file; for example,clusterproperties.txt
. (Do NOT include the path to the file.)files_list
is a comma-delimited list of file names that the installer copies fromsource_path
to all cluster hosts.The list must contain both the cluster property and HDP Installer file names; for example,
hdp-2.4.0.0.winpkg.msi,cluster.properties
. The list cannot contain spaces. Ensure that all the listed files are in thesource_path
.Tip When deploying HDP with the LZO compression enabled, put the following three files (from the Windows Installation zip) into the directory that contains the HDP for Windows Installer, and the cluster.properties file, and include them in the file list:
hadoop-lzo-0.4.19.2.2.0.0-2060
gplcompression.dll
lzo2.dll
skip
forces the installation on all nodes of a cluster.msiexec_command
is the complete installation command that the script executes on the target nodes.-parallel
allows parallel installation on all hosts, rather than installing one at a time.Note Parallel results are not always correctly deployed, and you must manually validate any parallel installations.
The installer script returns error messages or successful results to the Install Master host. These messages are displayed when the script finishes. Examine these results to ensure that all nodes were successfully installed.
On each node, the HDP Installer unpacks the MSI contents to
SystemDrive\HadoopInstallFiles\HadoopSetupTools\hdp-2.4.0.0.winpkg.install
.
This folder is required to uninstall HDP; do not remove it.