1. About the HDP MSI Installer and HDP Public Properties

This section describes the HDP MSI installer command line options and explains which HDP public properties to use when installing a multi-node Hadoop Cluster. The installation process runs in the background.

HDP MSI Installer command format

The HDP MSI Installer command incudes the msiexec command, a set of standard installer options, and HDP public properties. For example:

msiexec /qn /lv log_file /i msi_file MSIUSEREALADMINDETECTION=1
HDP_DIR=install_dir 
HDP_LAYOUT=cluster_properties_file 
HDP_USER_PASSWORD=password 
DESTROY_DATA=YES_OR_NO 
HDP=YES_OR_NO 
FLUME=YES_or_NO 
HBASE=YES_or_NO 
KNOX=YES_or_NO 
KNOX_MASTER_SECRET=secret 
FALCON=YES_or_NO 
STORM=YES_or_NO 
RANGER=YES_or_NO

where:

msiexec /qn /lv log_file /i msi_file MSIUSEREALADMINDETECTION=1 is the set of standard installer options recommended by Hortonworks.

Everything following /i msi_file MSIUSEREALADMINDETECTION=1 is a public property.

Standard Installer Options

  • /qn (quiet, no UI) suppresses the HDP Setup Window. Use /qb (quiet basic) to suppress the HDP Setup and show a progress bar.

  • /lv log_file (log verbose) creates a verbose installation log with the name you specified. If only a file name is provided, the installation log file is created in the directory where msiexec was launched.

  • /i msi_file points to the HDP Installer file. We recommend specifying the absolute path.

  • MSIUSEREALADMINDETECTION=1 ensures that the user running the installer has true administrator permissions.

For more information about standard msiexec options, enter msiexec /? in a command prompt.

HDP Public Properties

You can set the following properties when you run msiexec:

 

Table 4.1. Property value information

Property

Mandatory?

Value

Associated Value(s) in Cluster Properties file

Description

DESTROY_DATA

Y

Yes or No

none

Specify No to keep existing data from previous installation. No does not format the NameNode. Specify Yes to remove all existing or previous HDP data and format the NameNode, creating an installation with a clean data slate.

HDP_USER_PASSWORD

Y

password

none

Password defined when creating the Hadoop user. Note that if the password does not meet your password policy standards, the installation will fail.

HDP_LAYOUT

Y

clusterproperites_ full_path

none

Absolute path to the Cluster Properties file. Note that relative paths are not supported and the path may not contain spaces. For example, c:\MSI_Install\clusterproperties.txt.

HDP_DIR

N

install_dir

none

Absolute path to the Hadoop root directory where HDP components are installed.

HDP

N

Yes or No

Setting this to Yes instructs the MSI to install optional HDP components such as Flume, HBase, Knox, Falcon and Storm. When enabled, you must specify the components on the command line; for example: HDP="YES" KNOX="YES" KNOX_SECRET="secret" FALCON="NO" HBASE="YES" FLUME="NO" STORM="NO". Excluding the optional components from the command line causes the installation to fail.

FLUME

N

Yes or No

FLUME_HOSTS

Includes the installation of Flume components on the hosts matching the name defined in the cluster properties file.

HBASE

N

Yes or No

HBASE_MASTER and HBASE_REGIONSERVERS

Includes the installation of HBase components on the hosts matching the name defined in the cluster properties file.

KNOX

N

Yes or No

KNOX_HOST

Includes the installation of Knox gateway on the host matching the name defined in the cluster properties file. When yes, the KNOX_SECRET must also be specified as a parameter.

KNOX_MASTER_SECRET

N

secret

none

Specified only when KNOX="YES". The master secret to protect Knox security components, such as SSL certificates.

FALCON

N

Yes or No

FALCON_HOSTS

Includes the installation of the Falcon components on the host matching the name defined in the cluster properties file.

STORM

N

Yes or No

STORM_NUMBER and STORM_SUPERVISORS

Includes the installation of the Storm components on the host matching the name defined in the cluster properties file.

RANGER

N

Yes or No

RANGER_HOST

Includes the installation of the Ranger Admin and User Sync components on the host matching the name defined in the cluster properties file.


For optional HDP Components such as Knox and Falcon, include HDP=yes and specify "yes" or "no" for the components you would like to install or not, respectively. For example: FLUME=no HBASE=yes KNOX=no FALCON=no STORM=no.

This command needs to run in the command-line interface of each node in your cluster. If you are not installing any optional components, specify HDP=no.

Components are only installed if the hostname matches a value in the cluster properties file. For examples of msiexec commands, see Option 3: Installing HDP from the Command Line.


loading table of contents...