If your Data Center does not have established procedures for doing centralized push-install, then you may either follow the below suggested procedure, or you may avoid the issue of centralized installation by manually installing HDP on each individual node in the cluster, documented in section Installing HDP manually, one node at a time.
You can choose to use the helper install script push_install_hdp.ps1
. The
push_install_hdp.ps1
script only installs one machine at a time, and does all
the machines in the cluster in sequence. This is sufficient for a small test cluster, and it
does not require any shared storage. It pushes the files to each node using that node's
"Administrative Shares", so make sure that the Admin Shares feature is turned on for all hosts
in the cluster, and the Administrator user id you will use to run the install script has
privileges to write to the Admin Shares on the other hosts.
Identify the hosts that will constitute the Hadoop cluster nodes and follow the instructions in section Prepare the Environment to configure them all for centralized push-install.
Extract the HDP-Win zip folder from here and identify the MSI and example
clusterproperties.txt
file.Note Downloaded MSI includes full source, binary-only MSI, and documentation for all components. Hortonworks recommends using the binary-only MSI for faster downloads.
Create your own custom
clusterproperties.txt
file using the instructions in section Define Cluster Configuration.Place the MSI and custom
clusterproperties.txt
file in a convenient local subdirectory on the host from which you are running the push install.Advanced: You may also place in this subdirectory other files that you want pushed to all the cluster hosts.
On the master install node, run a command prompt in Administrator mode (to use Administrator privileges), and execute the install scripts with the following parameters:
source_path
: Local or network share directory path where all the installable files reside, including the MSI, theclusterproperties.txt
file, and any other files you want pushed to the cluster nodes.target_path
: A single absolute directory path, the same for all target machines, for the install directory (
). The path should be specified as it would be locally on a target host. For example,$HADOOP_NODE
D:\hadoop\
.clusterpropfile
: Simple file name of the customclusterproperties.txt
file.The
clusterproperties.txt
resides in the
directory. So, ensure that you provide the filename (without any path) as the value for the$source_path
clusterpropfile
parameter.files_list
: A single string containing a comma-delimited list of all simple file names to be pushed to all nodes.Typically these will include the MSI file, the custom
clusterproperties.txt
file, etc.Ensure that all files are in the
directory. These files will be copied to$source_path
directory.$target_path
You may not input paths for these files, only simple names. Ensure that you include the custom
clusterproperties.txt
file.msiexec command line token sequence
: Completemsiexec
command must be provided just as though you were entering it on a PowerShell command line of one of the target servers, after the files have been pushed.Start with the word
msiexec
and provide the entire command line, each argument in its own string object.The
msiexec
command line must be constructed by referring to section Install from the MSI.Ensure that
<$MSI_PATH>
and<$PATH_to_clusterproperties.txt_File>
arguments are specified as simple filenames (assume that themsiexec
command will be run from the context of thetarget_path
).The
<$PATH_to_Installer_Log_File>
argument may be an absolute path or will be interpreted relative to thetarget_path
.The
HDP_DIR
argument is different from thetarget_path
:target_path
is the location on each host where the MSI andclusterproperties.txt
files will be copied to while preparing for the installation.HDP_DIR
is the location on each host where the HDP components will actually be installed bymsiexec
.
The syntax for
msiexec command line token sequence
parameter is given below:msiexec /i "<$MSI_PATH>" /lv "<$PATH_to_Installer_Log_File>" HDP_LAYOUT="<$PATH_to_clusterproperties.txt_File>" HDP_DIR="<$PATH_to_HDP_Install_Dir>" DESTROY_DATA="<Yes_OR_No>"
Note The
push_install_hdp.ps1
script, will deploy the MSI and other files to each host in the cluster by writing (pushing) them from the install master host to the administrative share corresponding to thetarget_path
argument on each host. (e.g., a target path ofD:\hadoop\
will cause the admin share\\hostname\D:\hadoop\
to be written to on each host.)The installer script will return error messages or successful completion results to the Install Master host. These messages will be printed out at the end of the script execution. Examine these return results to ensure that all nodes were successfully installed.
Smoke test your installation using the instructions provided in the Validate the Install section.