HDP-2.3.0 Release Notes
Also available as:
PDF

New Features

This section highlights several new features in HDP 2.3.

Table 1.1. Data Governance and Integration

ComponentFeature

Atlas

  • General Availability release

  • Hive integration (ATLAS-75)

  • Business classification (ATLAS-76)

  • REST API to create new connections to Atlas (ATLAS-77)

Falcon

Flume

  • Kafka Source and Kafka Sink support (FLUME-2242)

  • Hive Sink based on the new Hive Streaming support​ (FLUME-1734)

  • An alternative to providing clear text passwords in Flume config (FLUME-2442)

Kafka

Sqoop

  • Import sequential datasets from mainframe (SQOOP-1272)

  • Netezza enhancements: skip control codes, write logs to HDFS (SQOOP-2164)


Table 1.2. Data Access

ComponentFeature

HBase and Phoenix

Hive

Pig

Spark

  • General availability of Spark 1.3.1

Solr

  • Authorization via Ranger (SOLR-7275)

  • Pluggable authentication framework that proves a Kerberos plugin implementation (SOLR-7468)

Storm

Tez

  • Secure ATS integration (TEZ-1529)

  • Enhanced performance and scale (TEZ-776)

  • Support sort buffers larger than 2GB (TEZ-1803)


Table 1.3. Data Management

ComponentFeature

HDFS

  • Improve distcp efficiency: reduced time and processing power needed to mirror datasets across cluster (HDFS-7535, MAPREDUCE-6248)

  • Support variable-length blocks (HDFS-3689)

  • Provide storage quotas per heterogeneous storage types (HDFS-7584)

  • Pluggable Authorization API (HDFS-6826)

  • Track and display failed DataNode storage locations in NameNode JMX and UI (HDFS-7604)

  • Additional DataNode and NameNode operational load metrics available through JMX (HDFS-7773)

  • HDFS Data at Rest Encryption (HDFS-6134)

Slider

  • Upgrade and reconfiguration without downtime for Slider-based applications (SLIDER-787)

  • No packaging required for certain Slider applications (SLIDER-668)

YARN

  • Non-exclusive Node Labels - where applications are given preference for the Label they specify, but not exclusive access (YARN-3214)

  • Fair sharing across apps for same user same queue, per queue scheduling policies (YARN-3306)

  • Pluggable authorization for YARN ACLs for integration with Apache Ranger (YARN-3100)


Table 1.4. Security

ComponentFeature

Knox

  • Modular architecture - introduce the concept of Knox "stacks", making it easier for customers and partners to add in APIs they wish to protect via Knox (KNOX-481, KNOX-483)

  • Rolling upgrade

  • Support for two-way SSL (KNOX-504)

  • Support for LDAP authentication caching (KNOX-524)

  • Enhance principal mapping across domains supplied with a header

Ranger

  • Modular architecture - introduce the concept of Ranger "stacks", making it easier for customers and partners to add in authorization and secure audit support their own component(s) via Ranger (RANGER-203)

  • Extend support for Kafka, YARN, and Solr (RANGER-246, RANGER-248, RANGER-249)

  • Ranger-based KMS support for HDFS encryption (RANGER-247)

  • Use Solr for storing audit logs and querying (RANGER-266)


Table 1.5. Operations

ComponentFeature

Ambari

Oozie

SmartSense

  • A next generation set of tools and services with diagnostics, cluster analytics, and actionable data-driven recommendations. For more information, see Support Tools. (Note: link requires Support Portal access.)