This section highlights several new features in HDP 2.3.
Table 1.1. Data Governance and Integration
Component | Feature |
---|
Atlas
|
General Availability release Hive integration (ATLAS-75) Business classification (ATLAS-76) REST API to create new connections to Atlas (ATLAS-77)
|
Falcon
|
|
Flume
|
Kafka Source and Kafka Sink support (FLUME-2242) Hive Sink based on the new Hive Streaming support (FLUME-1734) An alternative to providing clear text passwords in Flume config (FLUME-2442)
|
Kafka
|
|
Sqoop
|
Import sequential datasets from mainframe (SQOOP-1272) Netezza enhancements: skip control codes, write logs to HDFS (SQOOP-2164)
|
Table 1.2. Data Access
Component | Feature |
---|
HBase and Phoenix
|
|
Hive
|
|
Pig
|
|
Spark
|
|
Solr
|
|
Storm
|
|
Tez
|
Secure ATS integration (TEZ-1529) Enhanced performance and scale (TEZ-776) Support sort buffers larger than 2GB (TEZ-1803)
|
Table 1.3. Data Management
Component | Feature |
---|
HDFS
|
Improve distcp efficiency: reduced time and processing power needed to
mirror datasets across cluster (HDFS-7535, MAPREDUCE-6248) Support variable-length blocks (HDFS-3689) Provide storage quotas per heterogeneous storage types (HDFS-7584) Pluggable Authorization API (HDFS-6826) Track and display failed DataNode storage locations in NameNode JMX and UI
(HDFS-7604) Additional DataNode and NameNode operational load metrics available through
JMX (HDFS-7773) HDFS Data at Rest Encryption (HDFS-6134)
|
Slider
|
|
YARN
|
Non-exclusive Node Labels - where applications are given preference for the
Label they specify, but not exclusive access (YARN-3214) Fair sharing across apps for same user same queue, per queue scheduling
policies (YARN-3306) Pluggable authorization for YARN ACLs for integration with Apache Ranger
(YARN-3100)
|
Table 1.4. Security
Component | Feature |
---|
Knox
|
Modular architecture - introduce the concept of Knox "stacks", making it
easier for customers and partners to add in APIs they wish to protect via Knox
(KNOX-481, KNOX-483) Rolling upgrade Support for two-way SSL (KNOX-504) Support for LDAP authentication caching (KNOX-524) Enhance principal mapping across domains supplied with a header
|
Ranger
|
Modular architecture - introduce the concept of Ranger "stacks", making it
easier for customers and partners to add in authorization and secure audit
support their own component(s) via Ranger (RANGER-203) Extend support for Kafka, YARN, and Solr (RANGER-246, RANGER-248, RANGER-249) Ranger-based KMS support for HDFS encryption (RANGER-247) Use Solr for storing audit logs and querying (RANGER-266)
|
Table 1.5. Operations
Component | Feature |
---|
Ambari
|
|
Oozie
|
|
SmartSense
|
A next generation set of tools and services with diagnostics, cluster
analytics, and actionable data-driven recommendations. For more information, see
Support Tools. (Note: link requires Support Portal
access.)
|