Hortonworks Docs
»
»
Also available as:
In-Place Upgrade HDP 3 to CDP Private Cloud Base
HDP to CDP Upgrade Overview
In-Place Upgrade Overview
CDP Upgrade Readiness
Cluster environment readiness
Disk space and mountpoint considerations
Downloading and Publishing the Package Repository
Downloading and Publishing the Parcel Repository
Sample data ingestion
Merge Independent Hive and Spark Catalogs
Ambari and HDP Upgrade Checklist
Ambari upgrade checklist
Download cluster blueprints without hosts
HDP upgrade checklist
Checklist for large clusters
Before upgrading any cluster
Changes to Ambari services and views
HDP Core component version changes
Upgrading the cluster's underlying OS
In-Place and Restore
Move and Decommission
Upgrading Ambari
Upgrading Ambari
Setting up a local repository
Updating Ambari repo files
Updating HDP repo files
Case study for setting up an HDP-GPL local repository
Setting up local repository with temporary internet access
Case study for setting up local repository
Update version repository base urls
Preparing Ambari Repository Configuration File to use Local Repository
Preparing to Upgrade Ambari
Upgrade to Ambari 7.1.6.0
Download cluster blueprints
Mandatory Post-Upgrade Tasks
Upgrading Ambari Infra
Upgrading Ambari Log Search
Upgrading Ambari Metrics
Upgrading HDP to Cloudera Runtime 7.1.x
HDP Prerequisites
Upgrade process
Before upgrading any cluster
Backup databases
Before you upgrade
Checkpoint HDFS
Pre-upgrade steps
Preparing Spark for upgrade
Backing up Ambari infra Solr data
Back up and upgrade Ambari infra Solr and Ambari Log Search
Generate migration configuration
Back up Ambari Infra Solr data
Remove Existing Collections and Upgrade Binaries
Preparing HBase for upgrade
Turn off YARN GPU
Preparing HDP Search for upgrade
Before you begin
Download Solr configuration from HDP Search ZooKeeper
Transition Solr configuration
Cloudera Manager versions 7.1.1 to 7.2.4
Cloudera Manager versions 7.3.1 or higher
Validate the configuration
Test the configuration
Preparing ZooKeeper for upgrade
Preparing Kafka for upgrade
Extract Kafka broker ID
Register software repositories
HDP Intermediate bits for 7.1.6.0 Repositories
Software download matrix for 3.1.5 to CDP 7.1.x
Install software on the hosts
Perform the HDP upgrade
Perform express upgrade
Post-HDP-upgrade tasks
Upload HDFS entity information
Ambari infra-migrate and restore
Ambari Metrics and LogSearch
Migrate Ambari Metrics data
Back up the Ranger configuration
Backup Solr collections
Troubleshooting the HDP upgrade
YARN Registry DNS instance fails to start
Transitioning to Cloudera Manager
Pre-transition steps
Databases
Kerberos
Kerberos principal
HDFS
Preparing HDFS
Backup the non-default Rack Awareness Topology script
Spark
Spark2/Livy
Ranger
Phoenix
Kerberos - Optional task
Solr
Cloudera Manager Installation and Setup
Installing JDBC Driver
Install MySQL JDBC Driver for MariaDB
Install MySQL JDBC Driver
Install Oracle JDBC Connector
Proxy Cloudera Manager through Apache Knox
Transitioning HDP to CDP Private Cloud Base
Transitioning the cluster from HDP 3.1.5 to CDP Private Cloud Base 7.1.6
Post transition steps
Enable Auto Start setting
ZooKeeper
Delete ZNodes
Ranger
Ranger KMS
Add Ranger policies for components on the CDP Cluster
HDFS
Ports
TLS/SSL
HDFS HA
Custom Topology
Add Balancer Role to HDFS
Other review configurations for HDFS
Solr
Restore Solr collections on CDP cluster
Kafka
Change Kafka port value
Impala
YARN
Start job history
Yarn Mapreduce framework jars
YARN NodeManager
YARN CGroups
Reset ZNode ACLs
Placement rules evaluation engine
Converting old mapping rule format to JSON-based placement rule format
YARN owner permission
Spark
Livy2
Enabling Spark on YARN for Atlas
Enabling SAC manually on Spark
Tez
Hive
Identifying and fixing invalid Hive schema versions
Setting up Hive metastore for Atlas
HMS health check
HBase
Ozone
Oozie
Validate Database URL
Installing the new Shared Libraries
Update Oozie properties
Access Oozie load balancer URL
Oozie Load Balancer configuration
Atlas advanced configuration snippet (Safety valve)
Phoenix
Map Phoenix schemas to HBase namespaces
Starting all services
YARN Queue Manager
Hive Policy Additions
Knox
Topology migration
Migrate Credential Aliases
Migrate signing key
Client Configurations
Securing ZooKeeper
Zeppelin Shiro configurations
Apache Hive Changes in CDP
Hive Configuration Property Changes
Customizing critical Hive configurations
Set Hive Configuration Overrides
Hive Configuration Requirements and Recommendations
Removing the LLAP Queue
Configure HiveServer for ETL using YARN queues
Configuring authorization to tables
Setting up access control lists
Configure encryption zone security
Renaming tables
Configure edge nodes as gateways
Configure HiveServer HTTP mode
Configuring HMS for high availability
Installing Hive on Tez and adding a HiveServer role
Handling table reference syntax
Add Backticks to Table References
Unsupported Interfaces and Features
Changes to HDP Hive tables
Configuring External Authentication for Cloudera Manager
Additional Services
Installing DAS using Ambari
Check cluster configuration for Hive and Tez
Add the DAS service
DAS post-installation tasks
Additional configuration tasks
Setting up the tmp directory
Configuring DAS for SSL/TLS
Set up trusted CA certificate
Set up self-signed certificates
Configure SSL/TLS in Ambari
Configuring user authentication in Ambari
Configuring user authentication using Knox SSO
Configuring user authentication using Knox proxy
Configuring user authentication using SPNEGO
Enabling logout option for secure clusters
Troubleshooting DAS installation
Problem area: Queries page
Your queries are not appearing on the Queries page
Query column is empty, yet you can see the DAG ID and Application ID
Query column is not empty, but you cannot see the DAG ID and Application ID
You cannot view queries from other users
Problem area: Compose page
You cannot see your databases or the query editor is missing
You cannot view new databases and tables, or cannot see changes to existing databases or tables
Replication failure in the DAS Event Processor
Problem area: Reports page
DAS service installation fails with the "python files missing" message
DAS does not log me out as expected, or I stay logged in longer than the time specified in the Ambari configuration
Getting a 401 - Unauthorized access error message while accessing DAS
Setting up quick links for the DAS UI
Installing DAS using Cloudera Manager
Adding Hue service with Cloudera Manager
Install and configure MySQL database
Add the Hue service using Cloudera Manager
Enable Kerberos for authentication
Integrate Hue with Knox
Grant Ranger permissions to new users or groups
Applications Upgrade
© 2012-2019, Hortonworks, Inc.
Document licensed under the
Creative Commons Attribution ShareAlike 4.0 License
.
Hortonworks.com
|
Documentation
|
Support
|
Community
