2. Manual Installation - Hortonworks Data Platform

2. Manual Installation

This section describes how to:

Manually install Ranger PolicyManager
Manually install Ranger UserSync
Manually install Ranger Plug-ins for HDFS, HBase, Hive, Knox or Storm
Verify the installation

Contents
Search

1. Getting Ready to Install
- 1. Meet Minimum System Requirements
- 2. Virtualization and Cloud Platforms
- 3. Configure the Remote Repositories
- 4. Decide on Deployment Type
- 5. Collect Information
- 6. Prepare the Environment
- 7. Download Companion Files
- 8. Define Environment Parameters
- 9. [Optional] Create System Users and Groups
- 10. Determine HDP Memory Configuration Settings
  - 10.1. Running the HDP Utility Script
  - 10.2. Manually Calculating YARN and MapReduce Memory Configuration Settings
- 11. Configuring NameNode Heap Size
- 12. Allocate Adequate Log Space for HDP
2. Installing HDFS and YARN
- 1. Set Default File and Directory Permissions
- 2. Install the Hadoop Packages
- 3. Install Compression Libraries
  - 3.1. Install Snappy
  - 3.2. Install LZO
- 4. Create Directories
3. Installing Apache ZooKeeper
- 1. Install the ZooKeeper Package
- 2. Securing ZooKeeper with Kerberos (optional)
- 3. Set Directories and Permissions
- 4. Set Up the Configuration Files
- 5. Start ZooKeeper
4. Setting Up the Hadoop Configuration
5. Validating the Core Hadoop Installation
- 1. Format and Start HDFS
- 2. Smoke Test HDFS
- 3. Configure YARN and MapReduce
- 4. Start YARN
- 5. Start MapReduce JobHistory Server
- 6. Smoke Test MapReduce
6. Installing Apache HBase
- 1. Install the HBase RPMs
- 2. Set Directories and Permissions
- 3. Set Up the Configuration Files
- 4. Validate the Installation
- 5. Starting the HBase Thrift and REST APIs
7. Installing Apache Phoenix
- 1. Configuring HBase for Phoenix
- 2. Configuring Phoenix to Run in a Secure Cluster
- 3. Smoke Testing Phoenix
- 4. Troubleshooting Phoenix
8. Installing and Configuring Apache Tez
- 1. Prerequisites
- 2. Install the Tez RPM
- 3. Configure Tez
- 4. Validate the Tez Installation
- 5. Troubleshooting
9. Installing Apache Hive and Apache HCatalog
- 1. Installing the Hive-HCatalog RPM
- 2. Setting Directories and Permissions
- 3. Setting Up the Hive/HCatalog Configuration Files
  - 3.1. HDP-Utility script
  - 3.2. Configure Hive and HiveServer2 for Tez
- 4. Setting up RDBMS for Use with the Hive Metastore
- 5. Creating Directories on HDFS
- 6. Validating the Installation
- 7. Enabling Tez for Hive Queries
- 8. Disabling Tez for Hive Queries
- 9. Configuring Tez with the Capacity Scheduler
- 10. Validating Hive-on-Tez Installation
10. Installing Apache Pig
- 1. Install the Pig RPMs
- 2. Set Up Configuration Files
- 3. Validate the Installation
11. Installing Apache WebHCat
- 1. Install the WebHCat RPMs
- 2. Upload the Pig, Hive and Sqoop tarballs to HDFS
- 3. Set Directories and Permissions
- 4. Modify WebHCat Configuration Files
- 5. Set Up HDFS User and Prepare WebHCat Directories
- 6. Validate the Installation
12. Installing Apache Oozie
- 1. Install the Oozie RPMs
- 2. Set Directories and Permissions
- 3. Set Up the Oozie Configuration Files
- 4. Configure Your Database for Oozie
- 5. Validate the Installation
13. Installing Apache Ranger
- 1. Installation Prerequisites
- 2. Manual Installation
- 3. Installing Policy Manager
- 4. Installing UserSync
- 5. Installing Ranger Plug-ins
- 6. Verifying the Installation
14. Installing Hue
- 1. Prerequisites
- 2. Configure HDP
- 3. Install Hue
- 4. Configure Hue
- 5. Start Hue
- 6. Configuring Hue for an External Database
- 7. Using Hue with Oracle
- 8. Using Hue with MySQL
- 9. Using Hue with PostgreSQL
15. Installing Apache Sqoop
- 1. Install the Sqoop RPMs
- 2. Set Up the Sqoop Configuration
- 3. Validate the Installation
16. Installing Apache Mahout
17. Installing and Configuring Apache Flume
- 1. Understanding Flume
- 2. Installing Flume
- 3. Configuring Flume
- 4. Starting Flume
- 5. HDP and Flume
- 6. A Simple Example
18. Installing and Configuring Apache Storm
- 1. Install the Storm RPMs
- 2. Configure Storm
- 3. Configure a Process Controller
- 4. (Optional) Configure Kerberos Authentication for Storm
- 5. (Optional) Configuring Authorization for Storm
- 6. Validate the Installation
19. Installing and Configuring Apache Spark
- 1. Spark Prerequisites
- 2. Installing Spark
- 3. Configuring Spark
- 4. Validating Spark
20. Installing and Configuring Apache Kafka
- 1. Install Kafka
- 2. Configure Kafka
- 3. Validate Kafka
21. Installing Apache Accumulo
- 1. Install the Accumulo RPM
- 2. Configure Accumulo
- 3. Validate Accumulo
22. Installing Apache Falcon
- 1. Install the Falcon RPM
- 2. Configuring Proxy Settings
- 3. Configuring Falcon Entities
- 4. Configuring Oozie for Falcon
- 5. Configuring Hive for Falcon
- 6. Configuring for Secure Clusters
- 7. Validate Falcon
23. Installing Apache Knox
- 1. Install the Knox RPMs on the Knox server
- 2. Set up and Validate the Knox Gateway Installation
24. Installing Ganglia (Deprecated)
- 1. Install the Ganglia RPMs
- 2. Install the Configuration Files
- 3. Extract the Ganglia Configuration Files
- 4. Copy the Configuration Files
- 5. Set Up Ganglia Hosts
- 6. Set Up Configurations
- 7. Set Up Hadoop Metrics
- 8. Validate the Installation
25. Installing Nagios (Deprecated)
- 1. Install the Nagios RPMs
- 2. Install the Configuration Files
- 3. Extract the Nagios Configuration Files
- 4. Create the Nagios Directories
- 5. Copy the Configuration Files
- 6. Set the Nagios Admin Password
- 7. Set the Nagios Admin Email Contact Address
- 8. Register the Hadoop Configuration Files
- 9. Set Hosts
- 10. Set Host Groups
- 11. Set Services
- 12. Set Status
- 13. Add Templeton Status and Check TCP Wrapper Commands
- 14. Validate the Installation
26. Installing Apache Slider
27. Setting Up Security for Manual Installs
- 1. Preparing Kerberos
- 2. Configuring HDP
- 3. Configuring Hue
- 4. Setting up One-Way Trust with Active Directory
  - 4.1. Configure Kerberos Hadoop Realm on the AD DC
  - 4.2. Configure the AD Domain on the KDC and Hadoop Cluster Hosts
28. Uninstalling HDP

Search Highlighter (On/Off)