DocsHortonworks Data Platform

 

 3. Option 2: Central HDP Install Using the Push Install HDP Script

Hortonworks provides a PowerShell script called push_install_hdp.ps1, which is included in the resources directory of the installer zip. The script installs HDP one system at a time on all hosts defined in the cluster properties file. Use this script to deploy HDP to a small test cluster. The script does not require shared storage, it copies the installation files to the target using the Windows Administrative Share.

Before running the script, ensure that the Admin Share is enabled on all cluster hosts, and that the Administrator account executing the script has the privileges to write to the cluster hosts.

To use the Push Install HDP script:

  1. On the host nodes, complete all the prerequisites described in Before You Begin. Make sure you set an environment variable for JAVA_HOME. (Remember, Java cannot be installed in a location where the pathname includes spaces.)

    Be especially careful to identify:

    • Supported operating system

    • Dependent software and environment variable settings

    • Enable PowerShell remote scripting and set cluster nodes as trusted hosts

    • Resolvable host names and static IPv4 addresses

    • Open ports required for HDP operation

  2. Additionally, on each host:

    • Enable the Administrative Share:

      netsh firewall set service type remoteadmin enabled

    • Create the a target directory to which the installer can copy the files used for the installation:

      mkdir D:\MSI_Install

  3. Download the HDP Windows Installation package. The package includes a sample cluster properties file called clusterproperties.txt.

  4. Define your cluster properties and save them in a file; see Manually Creating a Cluster Properties File.

    [Important]Important

    Nodes in the cluster communicate with each other using the host name or IP address defined in the cluster properties file. For multi-homed systems (systems that can be accessed internally and externally) and systems with more than one NIC, ensure that the preferred name or IP address is specified in the Cluster Properties file.

  5. Copy the HDP MSI Installer, your custom cluster properties file, and push_install_hdp.ps1 to the source directory on the master install node (the host from which you are running the push install).

  6. Determine the MSI command line parameters. For information about parameters, see About the HDP MSI Installer and HDP Public Properties. For examples of msiexec commands, see Installing HDP from the Command Line.

  7. On the master install node, open a command prompt with run as Administrator, and enter: 

    cd source_pathpowershell 
-File push_install_hdp.ps1 
source_path 
destination_path 
clusterproperties_file 
files_list 
skip 
msiexec_command 
-parallel

    where:

    • source_path is the absolute path to the installation files. This directory must contain the HDP MSI and the cluster properties file, as well as any other files the installer will push to the cluster nodes; for example, D:\MSI_Install.

    • destination_path is the absolute path to an existing directory on the target cluster nodes. All nodes must have this directory. The installer copies files_list from source_path to destination_path. Specify destination path as a local path on the target host; for example, D:\MSI_Install.

    • clusterproperties_file is the name of your custom cluster properties file; for example, clusterproperties.txt. (Do NOT include the path to the file.)

    • files_list is a comma-delimited list of file names that the installer copies from source_path to all cluster hosts.

      The list must contain both the cluster property and HDP Installer file names; for example, hdp-2.2.0.0.winpkg.msi,cluster.properties. The list cannot contain spaces. Ensure that all the listed files are in the source_path.

      [Tip]Tip

      When deploying HDP with the LZO compression enabled, put the following three files (from the Windows Installation zip) into the directory that contains the HDP for Windows Installer, and the cluster.properties file, and include them in the file list:

      • hadoop-lzo-0.4.19.2.2.0.0-2060

      • gplcompression.dll

      • lzo2.dll

    • skip forces the installation on all nodes of a cluster.

    • msiexec_command is the complete installation command that the script executes on the target nodes.

    • -parallel allows parallel installation on all hosts, rather than installing one at a time.

      [Note]Note

      Parallel results are not always correctly deployed, and you must manually validate any parallel installations.

The installer script returns error messages or successful results to the Install Master host. These messages are displayed when the script finishes. Examine these results to ensure that all nodes were successfully installed.

On each node, the HDP Installer unpacks the MSI contents to SystemDrive\HadoopInstallFiles\HadoopSetupTools\hdp-2.2.0.0.winpkg.install. This folder is required to uninstall HDP; do not remove it.

Legal notices
loading table of contents...