Release Notes
Also available as:
PDF

Flume

HDP 2.5.6 provides Flume 1.5.2 and no additional Apache patches.

HDP 2.5.5 provides Flume 1.5.2 and the following Apache patches:

  • FLUME-2632: High CPU on KafkaSink.

  • FLUME-2812: Fix semaphore leak causing java.lang.Error: Maximum permit count exceeded in MemoryChannel.

  • FLUME-2991: ExecSource command execution starts before starting the sourceCounter.

  • FLUME-3031: Sequence source should reset its counter for event body on channel exception.

HDP 2.5.3 provided Flume 1.5.2 and no additional Apache patches.

HDP 2.5.0 provided Flume 1.5.2 and the following Apache patch:

  • FLUME-2498: Implement Taildir Source.

  • FLUME-2500: Add a channel that uses Kafka.

  • FLUME-2523: Document Kafka channel.

  • FLUME-2560: Add Kafka Channel to dist tarballs.

  • FLUME-2562: Add metrics for Kafka Source, Kafka Sink and Kafka Channel.

  • FLUME-2729: Allow pollableSource backoff times to be configurable.

  • FLUME-2734: Kafka Channel timeout property is overridden by default value.

  • FLUME-2781: Kafka Channel with parseAsFLUMEEvent=true should write data as is, not as FLUME events.

  • FLUME-2801: Performance improvement on TailDir source.

  • FLUME-2823: FLUME-Kafka-Channel with new APIs.

  • FLUME-2901: Document Kerberos setup for Kafka channel.

  • FLUME-2947: Upgrade Hive and thrift dependencies.