Hortonworks Docs
»
»
Also available as:
HDP to CDP Private Cloud Base Upgrade
An Overview of the Upgrade Process
Getting Ready to Upgrade Ambari and HDP
Perform in-place upgrade
Ambari upgrade checklist
Upgrade prerequisites
Checklist for large clusters
Changes to Ambari services and views
HDP Core component version changes
Upgrading the cluster's underlying OS
In-Place and Restore
Move and Decommission
Behavioral changes
Upgrading Ambari
Before you upgrade
Upgrade to Ambari 7.1.0.0
Upgrade to Ambari 7.1.2.0
Upgrade to Ambari 7.1.3.0
Upgrading HDP to Cloudera Runtime 7.1.x
Upgrade process
Prerequisites
Before you upgrade
Checkpoint HDFS
Register software repositories
Install software on the hosts
Pre-upgrade steps
Migrating Atlas data
Preparing HBase for upgrade
Preparing Hive for upgrade
Take a Mandatory Snapshot of Hive Tables
Make Tables SparkSQL Compatible
Download the Pre-Upgrade Tool JAR for Compaction
Get a Kerberos Ticket
Run Compaction on Hive Tables
Save Hive Metastore by Dumping
Capture Information about Multiple HiveServers
Hive Pre-Upgrade Tool Command Help
Preparing Kafka for upgrade
Preparing Zeppelin for upgrade
Upgrading Ambari Metrics System and SmartSense
Upgrading Ambari Metrics
Upgrading SmartSense
Backing up Ambari infra data and migrating Atlas data
Back up and upgrade Ambari infra and Ambari Log Search
Generate migration configuration
Back up Ambari Infra Solr data
Remove Existing Collections and Upgrade Binaries
Migrate Atlas Data
Perform the HDP upgrade
Perform express upgrade
Post-HDP-upgrade tasks
Update Ranger passwords
Atlas Migration and HBase Hook settings
Ambari Metrics and LogSearch
Ambari infra-migrate and restore
Migrate Ambari Metrics data
Upload HDFS entity information
Custom Spark SQL Warehouse Directory
Hive post-HDP-upgrade tasks
Check Hive Table Locations
Prevent SparkSQL Incompatibility
Correct Hive File Locations
Verify Zeppelin settings in Ambari
Troubleshooting the HDP upgrade
Hive Metastore corrupt
Missing Hive tables
YARN Registry DNS instance fails to start
Ambari Metrics System (AMS) does not start
Transitioning to Cloudera Manager
Pre-transition steps
Databases
Kerberos
Kerberos principal for YARN
HDFS
Preparing HDFS
Backup the non-default Rack Awareness Topology script
Spark2/Livy
Spark
Ranger
Phoenix
Kerberos - Optional task
Cloudera Manager Installation and Setup
Auto-TLS - Optional task
Transitioning HDP to CDP Private Cloud Base
Transitioning the cluster
Post transition steps
ZooKeeper
HDFS
Ports
HDFS HA
Custom Topology
Add Balancer Role to HDFS
Other review configurations for HDFS
YARN
Start job history
Yarn Mapreduce framework jars
Tez
Hive Metastore
Schema Validity
Safety Valve Entries
Hive on Tez
Oozie
Validate Database URL
Installing the new Shared Libraries
Spark
Livy2
Kafka
Zookeeper-client deleteall
Starting all services
Enabling the Ranger and Knox services
YARN Queue Manager
Hive
Ranger
Ranger Policy Migration Tool
Example
Migrating Policy Activities
Solr
Hive Policy Additions
Activating Ranger for Services
Installing and Starting the KNOX Service
Enabling Knox for Various Services
Client Configurations
Securing ZooKeeper
Installing DAS using Ambari
Check cluster configuration for Hive and Tez
Add the DAS service
DAS post-installation tasks
Additional configuration tasks
Setting up the tmp directory
Configuring DAS for SSL/TLS
Set up trusted CA certificate
Set up self-signed certificates
Configure SSL/TLS in Ambari
Configuring user authentication in Ambari
Configuring user authentication using Knox SSO
Configuring user authentication using Knox proxy
Configuring user authentication using SPNEGO
Enabling logout option for secure clusters
Troubleshooting DAS installation
Problem area: Queries page
Your queries are not appearing on the Queries page
Query column is empty, yet you can see the DAG ID and Application ID
Query column is not empty, but you cannot see the DAG ID and Application ID
You cannot view queries from other users
Problem area: Compose page
You cannot see your databases or the query editor is missing
You cannot view new databases and tables, or cannot see changes to existing databases or tables
Replication failure in the DAS Event Processor
Problem area: Reports page
DAS service installation fails with the "python files missing" message
DAS does not log me out as expected, or I stay logged in longer than the time specified in the Ambari configuration
Getting a 401 - Unauthorized access error message while accessing DAS
Setting up quick links for the DAS UI
© 2012-2019, Hortonworks, Inc.
Document licensed under the
Creative Commons Attribution ShareAlike 4.0 License
.
Hortonworks.com
|
Documentation
|
Support
|
Community
