DocsHortonworks Data Platform

 

 3. Option II - Central HDP Install Using the Push Install HDP Script

Hortonworks provides a powershell script (push_install_hdp.ps1 included in the resources directory of the installer zip) that installs HDP one system at a time on all hosts defined in the cluster properties file. Use this script to deploy HDP to a small test clusters. The script does not require shared storage, it copies the installation files to the target using the Windows Administrative Share. Ensure that the Admin Share is enabled on all cluster hosts, and that the Administrator account executing the script has the privileges to write to the cluster hosts.

To use the Push Install HDP script:

  1. On the host nodes, complete all the prerequisites. In Preparing the Environment see the following sections :

    [Note]Note

    Before installation you must set an environment variable for JAVA_HOME. Do not install Java in a location that has spaces in the path name.

  2. Additionally on each host node you must also do the following:

    • Enable the Administrative Share:

      netsh firewall set service type remoteadmin enabled

    • Create the a target directory to which the installer can copy the files used for the installation:

      mkdir D:\MSI_Install

  3. Download the HDP Windows Installation package from here, which includes a sample clusterproperties.txt file.

  4. Define your Cluster Properties and save to a file, see

    [Important]Important

    Nodes in the cluster communicate with each other using the host name or IP address defined in the cluster properties file. For multi-homed systems and systems with more than one NIC, ensure that the preferred name or IP address is specified in the Cluster Properties file.

  5. Copy the HDP MSI Installer, your custom clusterproperties.txt, and the push_install_hdp.ps1 files to the source directory on the master install node (the host from which you are running the push install).

  6. Determine the MSI command line parameters, see Understanding the HDP MSI Installer Properties

  7. On the master install node, open a command prompt with run as Administrator, and enter following:

    cd source_path
powershell -File push_install_hdp.ps1 source_path  destination_path  clusterproperties_file  files_list skip msiexec_command -parallel

    where:

    • source_path: Absolute path to the installation files. This directory must contain the HDP MSI and the clusterproperties.txt file, as well as any other files the installer will push to the cluster nodes. For example , D:\MSI_Install.

    • destination_path: Absolute path to an existing directory on the target cluster nodes. All nodes must have this directory. The installer copies the files_list from the source_path to the destination_path. This path is specified as a local path on the target host. For example, D:\MSI_Install.

    • clusterproperties_file: Name of the custom Cluster Properties file. For example, clusterproperties.txt. (Do NOT include the path to the file.)

    • files_list: Comma-delimited list of file names that the installer copies from the $source_path to all cluster hosts. The list must contain both the Cluster Property and HDP Installer file names. For example, hdp-2.1.1.0.winpkg.msi,cluster.properties. The list can not contain spaces. Ensure that all the listed files are in the $source_path.

      [Tip]Tip

      When deploying HDP with the LZO compression enabled, put the following three files in the same directory as the HDP for Windows Installer (and the cluster.properties file) and include them in the file list:

      • hadoop-lzo-0.4.19.2.1.1.0-1621.jar from the HDP for Windows Installation zip.

      • gplcompression.dll from the HDP for Windows Installation zip.

      • lzo2.dll LZO compression DLL downloaded from here.

    • msiexec_command: Complete installation command that the script executes on the target nodes, see Understanding the HDP MSI Installer Properties.

The installer script will return error messages or successful completion results to the Install Master host. These messages will be printed out at the end of the script execution. Examine these return results to ensure that all nodes were successfully installed.

[Note]Note

On each node, the HDP Installer unpacks the MSI contents to %SystemDrive%\HadoopInstallFiles. A detailed installation log is located at %SystemDrive%\HadoopInstallFiles\HadoopSetupTools\hdp-2.1.5.0.winpkg.install. This folder is required to uninstall HDP, do not remove it.

Legal notices
loading table of contents...