Cloudera Runtime Release NotesPDF version

What's New in Apache Kudu

Learn about the new features of Kudu in Cloudera Runtime 7.2.14.

Kudu can integrate its own catalog with the Hive Metastore (HMS). The HMS is the de-facto standard catalog and metadata provider in the Hadoop ecosystem. When the HMS integration is enabled, Kudu tables can be discovered and used by external HMS-aware tools, even if they are not otherwise aware of, or integrated with Kudu. Kudu supports table comments directly on Kudu tables which are automatically synchronized when the Hive Metastore integration is enabled. These comments can be added at table creation time and changed via table alteration. For more information, see Using Hive Metastore with Apache Kudu.

A server startup progress page that shows the progress of the startup is implemented. The startup progress is broken down into the following steps:
  1. Initializing
  2. Reading Filesystem
    1. Reading instance metadata files
    2. Opening container files
  3. Bootstrapping and opening the tables
  4. Starting RPC server
The following metrics are exposed using milliseconds as the unit of time:

  • log_block_manager_total_containers_startup : total containers present

  • log_block_manager_processed_containers_startup : count of containers opened/processed until the requested instant of time

  • log_block_manager_containers_processing_time_startup : time elapsed for opening the containers. If the containers are not yet opened, the time elapsed so far is provided.

  • tablets_num_total_startup : total tablets present

  • tablets_num_opened_startup : count of tablets opened/processed until the requested instant of time

tablets_opening_time_startup : time elapsed for opening the tablets. If the tablets are not yet opened, the time elapsed so far is provided.

  • New metrics for amount of available space: Two new metrics wal_dir_space_available_bytes and data_dirs_space_available_bytes are introduced, indicating the amount of free space available in the WAL directory and collectively across data directories, respectively.

  • New -list_statistics flag for 'kudu table list': The -list_statistics flag helps to list table's statistics such as tablet number, replica number, and record number.

  • Support to dump and edit pbc in JSON pretty format: The kudu pbc edit and pbc dump tools are enhanced to dump PBC content in JSON pretty format by adding --json_pretty flag.

  • Kudu version information can be checked when installing or upgrading using `curl http://x.x.x.x:8050/version`. It directly returns json information including the version.

  • KUDU-3311: SysCatalogTable:Load allows cluster startup if the one master has two additional entries in --master_addresses.

We want your opinion

How can we improve this page?

What kind of feedback do you have?