Command Line Installation

Also available as:

PDF

Contents

loading table of contents...

Hortonworks DataFlow

Command Line Installation

Copyright © 2012-2017 Hortonworks, Inc.

Except where otherwise noted, this document is licensed under Creative Commons Attribution ShareAlike 4.0 License

http://creativecommons.org/licenses/by-sa/4.0/legalcode

1. Before You Begin

Supported Operating Systems
Supported Browsers
Supported JDKs
HDP and Component Information
Hardware Sizing Recommendations
Downloading HDF

2. Installing NiFi

Installing NiFi

Installing as a Service

Starting NiFi

Launching the UI

3. Installing Apache ZooKeeper

Install the ZooKeeper Package

Securing ZooKeeper with Kerberos (optional)

Securing ZooKeeper Access

ZooKeeper Configuration
YARN Configuration
HDFS Configuration

Set Directories and Permissions

Set Up the Configuration Files

Start ZooKeeper

4. Installing and Configuring Apache Kafka

Install Kafka
Configure Kafka
Validate Kafka

5. Installing and Configuring Apache Storm

Install the Storm Package
Configure Storm
Configure a Process Controller
(Optional) Configure Kerberos Authentication for Storm
(Optional) Configuring Authorization for Storm
Validate the Installation

6. Installing Apache Ranger

Installation Prerequisites

Installing Policy Manager

Install the Ranger Policy Manager
Install the Ranger Policy Administration Service
Start the Ranger Policy Administration Service
Configuring the Ranger Policy Administration Authentication Mode
Configuring Ranger Policy Administration High Availability

Installing UserSync

Using the LDAP Connection Check Tool
Install UserSync and Start the Service

Installing Ranger Plug-ins

Installing the Ranger HDFS Plug-in
Installing the Ranger YARN Plug-in
Installing the Ranger Kafka Plug-in
Installing the Ranger HBase Plug-in
Installing the Ranger Hive Plug-in
Installing the Ranger Knox Plug-in
Installing the Ranger Storm Plug-in

Installing Ranger in a Kerberized Environment

Creating Keytab and Principals
Installing Ranger Services
Manually Installing and Enabling the Ranger Plug-ins

Verifying the Installation

List of Tables

1.1. Supported HDP versions and components
1.2. Hardware sizing recommendations
4.1. Kafka Configuration Properties
5.1. Required jaas.conf Sections for Cluster Nodes
5.2. Supported Authorizers
5.3. storm.yaml Configuration File Properties
5.4. worker-launcher.cfg File Configuration Properties
5.5. multitenant-scheduler.yaml Configuration File Properties
6.1. install.properties Entries
6.2. Properties to Update in the install.properties File
6.3. Properties to Edit in the install.properties File
6.4. Properties to Edit in the install.properties File
6.5. Properties to Edit in the install.properties File
6.6. HBase Properties to Edit in the install.properties file
6.7. Hive-Related Properties to Edit in the install.properties File
6.8. Knox-Related Properties to Edit in the install.properties File
6.9. Storm-Related Properties to Edit in the install.properties file
6.10. install.properties Property Values
6.11. install.properties Property Values
6.12. install.properties Property Values
6.13. install.properties Property Values
6.14. install.properties Property Values
6.15. install.properties Property Values
6.16. install.properties Property Values
6.17. install.properties Property Values
6.18. install.properties Property Values
6.19. install.properties Property Values
6.20. install.properties Property Values