Hortonworks Data Platform 2.0

Installing HDP Manually

2013-03-18


Contents

1. Getting Ready to Install
1. Understand the Basics
2. Meet Minimum System Requirements
2.1. Hardware Recommendations
2.2. Operating Systems Requirements
2.3. Software Requirements
2.4. Database Requirements
2.5. JDK Requirements
2.6. Virtualization and Cloud Platforms
3. Decide on Deployment Type
4. Collect Information
5. Prepare the Environment
5.1. Enable NTP on the Cluster
5.2. Check DNS
5.3. Disable SELinux
5.4. Set Up Password-less SSH
6. Configure the Remote Repositories
7. Optional - Install MySQL
8. Download Companion Files
9. Create System Users and Groups
10. Define Environment Parameters
10.1. Define Users and Groups
10.2. Define Directories
2. Installing HDFS and YARN
1. Set Default File and Directory Permissions
2. Install the Hadoop RPMs
3. Install Compression Libraries
3.1. Install Snappy
3.2. Install LZO
4. Create Directories
4.1. Create the NameNode Directories
4.2. Create the SecondaryNameNode Directories
4.3. Create DataNode and YARN NodeManager Local Directories
4.4. Create the Log and PID Directories
3. Setting Up the Hadoop Configuration
4. Validating the Core Hadoop Installation
1. Format and Start HDFS
2. Smoke Test HDFS
3. Start YARN
4. Start MapReduce JobHistory Server
5. Smoke Test MapReduce
5. Installing Apache Pig
1. Install the Pig RPMs
2. Set Directories and Permissions
3. Set Up Configuration Files
4. Validate the Installation
6. Installing Apache Hive and Apache HCatalog
1. Install the Hive and HCatalog RPMs
2. Set Directories and Permissions
3. Set Up the Hive/HCatalog Configuration Files
4. Create Directories on HDFS
5. [Optional] - Download the Database Connector
6. Validate the Installation
7. Installing and Configuring Apache Tez
1. Install the Tez RPMs
1.1. Optional: Modify Default Directories
2. Enable Tez AM
3. Enable and Use Tez Service
3.1. Enable Tez Service
3.2. Start Tez Service
3.3. Submit Hive Queries to Tez Service
4. Optional: Disable Tez
5. Troubleshooting
5.1. Getting the Logs
5.2. Quick Checks
5.3. Specific Issues
8. Installing WebHCat
1. Install the WebHCat RPMs
2. Set Directories and Permissions
3. Modify WebHCat Configuration Files
4. Set Up HDFS User and Prepare WebHCat Directories On HDFS
5. Validate the Installation
9. Installing HBase and Zookeeper
1. Install the HBase and ZooKeeper RPMs
2. Set Directories and Permissions
3. Set Up the Configuration Files
4. Validate the Installation
10. Manual Install Appendix: Tarballs
1. RHEL 5 and CentOS 5
2. RHEL 6 and CentOS 6
11. Uninstalling HDP

loading table of contents...