Apache Kudu Fixed Issues

• The Java Kudu client now automatically requests new authentication tokens after expiration. As a result, long-lived Java clients are now supported. See KUDU-2013 for more details.

• Multiple Kerberos compatibility bugs have been fixed, including support for environments with disabled reverse DNS, FreeIPA compatibility, principal names including uppercase characters, and hosts without a FQDN.

• A bug in the binary prefix decoder which could cause a tablet server 'check' assertion crash has been fixed. The crash could only be triggered in very specific scenarios; see KUDU-2085 for additional details.

• This is a complete list of upstream issues fixed in Kudu 1.5.0 / CDH 5.13.0. For the full list of fixed issues for all CDH components in CDH 5.13, see Upstream Issues Fixed in CDH 5.13.
  • KUDU-871 - Allow tombstoned tablets to vote
  • KUDU-1125 - (part 1) catalog_manager: try to avoid unnecessarily rewriting tablet info
  • KUDU-1407 - reassign failed tablets
  • KUDU-1442 - log number of open log block containers
  • KUDU-1544 - Race in Java client's AsyncKuduSession.apply()
  • KUDU-1726 - Avoid fsync-per-block in tablet copy
  • KUDU-1755 - Part 1: Improve tablet on disk size metric
  • KUDU-1811 - C++ client: use larger batches when fetching scan tokens
  • KUDU-1863 - improve overall safety of graceful server shutdown
  • KUDU-1865 - Avoid heap allocation for payload slices
  • KUDU-1894 - fixed deadlock in client.Connection
  • KUDU-1911 - improve missing required arg message
  • KUDU-1929 - [rpc] Allow using encrypted private keys for TLS
  • KUDU-1942 - Kerberos fails to log in on hostnames with capital letters
  • KUDU-1943 - Add BlockTransaction to Block Manager
  • KUDU-1952 - Remove round-robin for block placement
  • KUDU-1955 - refuse to use world-readable keytabs
  • KUDU-2004 - Undefined behavior in TlsSocket::Writev()
  • KUDU-2013 - Support for long lived auth tokens in Java client
  • KUDU-2032 - Kerberos authentication fails with rdns disabled in krb5.conf
  • KUDU-2039 - Fix the table count in the /tables page of master webUI
  • KUDU-2041 - Fix negotiation deadlock
  • KUDU-2049 - Fix too-strict CHECK in RleIntBlockDecoder::SeekToPositionInBlock
  • KUDU-2053 - Fix race in Java RequestTracker
  • KUDU-2058 - Fix LocatedTablet string comparisons
  • KUDU-2060 - Show primary keys in the master's table web UI page
  • KUDU-2066 - Add experimental Gradle build support
  • KUDU-2067 - Enable cfile checksumming by default
  • KUDU-2072 - upgrade to cmake 3.9.0 breaks sles12sp0 cmake patch
  • KUDU-2078 - Sink failure if batch size > session's flush buffer size
  • KUDU-2083 - Decrement running maintenance ops on failed prepare
  • KUDU-2085 - Fix crash when seeking past end of prefix-encoded blocks
  • KUDU-2087 - Fix failure to map Kerberos principal to username with FreeIPA
  • KUDU-2088 - Synchronizer may not go out of scope with outstanding references
  • KUDU-2091 - Certificates with intermediate CA's do not work with Kudu
  • KUDU-2101 - Include a table summary at the bottom
  • KUDU-2102 - fix PosixRWFile::Sync to guarantee durability when used concurrently
  • KUDU-2103 - [java]Canonicalize hostnames in client
  • KUDU-2104 - Upgrade to Spark 2.2.0
  • KUDU-2114 - Don't re-delete tombstoned replicas
  • KUDU-2118 - Fully shut down TabletReplica on delete
  • KUDU-2123 - Auto-vivify cmeta on tombstoned replicas if doesn't exist at startup
  • KUDU-2131 - switch to LIFO log container retrieval
  • KUDU-2138 - delete failed replicas in tablet report
  • KUDU-2141 - master: Remove DCHECK when tablet report has no opid_index

Apache Kudu 1.4.0 / CDH 5.12.2 is a bug-fix release which includes the following fixes:

• KUDU-2209 - Fixed Kudu's handling of the STA_NANO flag, which caused spurious crashes due to one Kudu node thinking another node had a timestamp from the future.
• KUDU-1788 - Increased the Raft RPC timeout to 30 seconds to avoid unsuccessful retries.
• KUDU-2170 - Disallowed specifying the same address multiple times in Kudu's master list.
• KUDU-2083 - Fixed an issue where, in rare circumstances, Kudu reduced the amount of maintenance ops it could run concurrently. The issue could cause the Kudu process to run out of memory and crash.
• KUDU-1942 - Now Kerberos can successfully log in on hostnames with capital letters.
• KUDU-2173 - Fixed an issue where scans with a predicate on a prefix of a range partition key could fail to return matching values.
• KUDU-2167 - Fixed an issue where the C++ client would crash when the server filtered out all data in a scan RPC.
• KUDU-2032 - Kerberos authentication no longer fails when rdns = false is configured in krb5.conf.
• Fixed a segmentation fault that could occur when running the ksck command against a master soon after the master was started.

Apache Kudu 1.4.0 / CDH 5.12.1 is a bug-fix release which includes the following fixes:

• KUDU-2085 - Fixed a bug that caused crashes when seeking past the end of prefix-encoded blocks.
• KUDU-2087 - Fixed an issue where Kudu would fail to start when Kerberos was enabled in FreeIPA-configured deployments.
• KUDU-2053 - Fixed a race condition in the Java RequestTracker.
• KUDU-2049 - Fixed an issue where scans on RLE-encoded integer columns would sometimes cause CHECK failures due to the CHECK condition being too strict.
• KUDU-2052 - Kudu now uses XFS_IOC_UNRESVSP64 ioctl to punch holes on xfs filesystems. This fixes an issue with slow startup times on xfs when hole punching was done via fallocate().
• KUDU-1956 - Kudu will no longer crash if faced with a race condition when selecting rowsets for compaction.

Apache Kudu 1.3.0 / CDH 5.11.2 is a bug-fix release which includes the following fixes:

• KUDU-2053 - Fixed a race condition in the Java RequestTracker.
• KUDU-2049 - Fixed an issue where scans on RLE-encoded integer columns would sometimes cause CHECK failures due to the CHECK condition being too strict.
• KUDU-1963 - Fixed an issue where the Java client misdiagnoses an error and logs a NullPointerException when a connection is closed by client while a negotiation is in progress.
• KUDU-1853 - Fixed an issue where data blocks could be orphaned after a failed tablet copy.

Apache Kudu 1.3.0 / CDH 5.11.1 is a bug-fix release which includes the following fixes:

Apache Kudu 1.2.x / CDH 5.10.2 includes the following fixed issues.

• KUDU-1933 - Fixed an issue that truncated the 64-bit log index in the OpId to 32 bits, causing overflow of the log index.
• KUDU-1607 - Fixed an issue where Kudu could not delete failed tablets using the DROP TABLE command.
• KUDU-1905 - Allow reinserts on tables when all columns are part of the primary key.
• KUDU-1893 - Made a fix to avoid incorrect NULL results and ensure evaluation of predicates for columns added after table creation.

Apache Kudu 1.2.x / CDH 5.10.1 includes the following fixed issues.

• KUDU-1904 - Fixed a bug where RLE columns with only NULL values would crash on scan.
• KUDU-1899 - Fixed an issue where tablet servers would crash after inserting an empty string primary key ("").
• KUDU-1851 - Fixed an issue with the Python client which would crash whenever a TableAlterer is instantiated directly.
• KUDU-1852 - KuduTableAlterer will no longer crash when given nullptr range bound arguments.
• KUDU-1821 - Improved warnings when the catalog manager starts.

See Issues resolved for Kudu 1.2.0 and Git changes between 1.1.x and 1.2.x.

• KUDU-1508 - Fixed a long-standing issue in which running Kudu on ext4 file systems could cause file system corruption. While this issue has been known to still manifest in certain rare cases, the corruption is harmless and can be repaired as part of a regular fsck. Switching from ext4 to xfs will also solve the problem.
• KUDU-1399 - Implemented an LRU cache for open files, which prevents running out of file descriptors on long-lived Kudu clusters. By default, Kudu will limit its file descriptor usage to half of its configured ulimit.
• Gerrit #5192 - Fixed an issue which caused data corruption and crashes in the case that a table had a non-composite (single-column) primary key, and that column was specified to use DICT_ENCODING or BITSHUFFLE encodings. If a table with an affected schema was written in previous versions of Kudu, the corruption will not be automatically repaired; users are encouraged to re-insert such tables after upgrading to Kudu 1.2 or later.
• Gerrit #5541 - Fixed a bug in the Spark KuduRDD implementation which could cause rows in the result set to be silently skipped in some cases.
• KUDU-1551 - Fixed an issue in which the tablet server would crash on restart in the case that it had previously crashed during the process of allocating a new WAL segment.
• KUDU-1764 - Fixed an issue where Kudu servers would leak approximately 16-32MB of disk space for every 10GB of data written to disk. After upgrading to Kudu 1.2 or later, any disk space leaked in previous versions will be automatically recovered on startup.
• KUDU-1750 - Fixed an issue where the API to drop a range partition would drop any partition with a matching lower _or_ upper bound, rather than any partition with matching lower _and_ upper bound.
• KUDU-1766 - Fixed an issue in the Java client where equality predicates which compared an integer column to its maximum possible value (e.g. Integer.MAX_VALUE) would return incorrect results.
• KUDU-1780 - Fixed the kudu-client Java artifact to properly shade classes in the com.google.thirdparty namespace. The lack of proper shading in prior releases could cause conflicts with certain versions of Google Guava.
• Gerrit #5327 - Fixed shading issues in the kudu-flume-sink Java artifact. The sink now expects that Hadoop dependencies are provided by Flume, and properly shades the Kudu client's dependencies.
• Fixed a few issues using the Python client library from Python 3.