Storm
This release provides Storm 1.1.1 and the following Apache patches:
STORM-2652: Exception thrown in JmsSpout open method.
STORM-2841: testNoAcksIfFlushFails UT fails with NullPointerException.
STORM-2854: Expose IEventLogger to make event logging pluggable.
STORM-2870: FileBasedEventLogger leaks non-daemon ExecutorService which prevents process to be finished.
STORM-2960: Better to stress importance of setting up proper OS account for Storm processes.
HDP 2.6.4 provided Storm 1.1.1 and the following Apache patches:
STORM-2666: Fix storm-kafka-client spout sometimes emitting messages that were already committed.
HDP 2.6.3 provided Storm 1.1.1 and the following Apache patches:
STORM-2481: Upgrade Aether version to resolve Aether bug BUG-451566.
STORM-2489: Overlap and data loss on WindowedBolt based on Duration.
STORM-2516: WindowedBoltExecutorTest.testExecuteWithLateTupleStream is flaky.
STORM-2562: Use stronger key size for blow fish key generator and get rid of stack trace.
STORM-2563: Remove the workaround to handle missing UGI.loginUserFromSubject.
STORM-2598: Add proxy server option for dependency resolver.
STORM-2724: Shutdown ExecutorService in WaterMarkEventGenerator in shutdown phase.
STORM-2779: NPE on shutting down WindowedBoltExecutor.
STORM-2779: NPE on shutting down WindowedBoltExecutor.
HDP 2.6.2 provided Storm 1.1.1 and the following Apache patches:
STORM-1114: Handle race condition in Storm/Trident transactional state when ZK nodes have already been created/deleted.
STORM-2194: ReportErrorAndDie doesn't always die.
STORM-2343: Fix new Kafka spout stopping processing if more than maxUncommittedOffsets tuples fail at once.
STORM-2413: Make new Kafka spout respect tuple retry limit .
STORM-2429: non-string values in supervisor.scheduler.meta cause crash.
STORM-2431: the default blobstore.dir is storm.local.dir/blobs which is different from distcache-blobstore.md.
STORM-2432: Storm-Kafka-Client Trident Spout Seeks Incorrect Offset With UNCOMMITTED_LATEST Strategy.
STORM-2440: Kill process if executor catches `java.net.SocketTimeoutException`.
STORM-2450: Write resources into correct local directory.
STORM-2451: windows storm.cmd does not set log4j2 config file correctly by default.
STORM-2482: Refactor the Storm auto credential plugins to be more usable.
STORM-2482: Refactor the Storm auto credential plugins to be more usable.
STORM-2496: Dependency artifacts should be uploaded to blobstore with READ permission for all.
STORM-2498: Fix Download Full File link in 1.x branch.
STORM-2501: Auto populate Hive credentials using Hive MetaStore delegation tokens.
STORM-2505: Spout to support topic compaction .
STORM-2506: Print mapping between Task ID and Kafka Partitions.
STORM-2511: Submitting a topology with name containing unicode getting failed..
STORM-2512: Make constructor public and add one more builder constructor.
STORM-2518: NPE during uploading dependency artifacts with secured cluster.
STORM-2520: AutoHDFS should prefer cluster-wise hdfs kerberos principal to global hdfs kerberos principal.
STORM-2528: Bump log4j version to 2.8.2.
STORM-2541: Fix storm-kafka-client manual subscription not being able to start consuming.
STORM-2544: Fixing issue in acking of tuples that hit retry limit under manual commit mode.
STORM-2548: Simplify KafkaSpoutConfig to avoid duplicating KafkaConsumer configuration parameters.
STORM-2552: KafkaSpoutMessageId should be serializable.
STORM-2568: Fix getTopicsString .
STORM-2618: Add TridentKafkaStateUpdater for storm-kafka-client.
STORM-2639: Kafka Spout incorrectly computes numCommittedOffsets due to voids in the topic (topic compaction).
STORM-2640: Deprecate KafkaConsumer.subscribe API option, make KafkaConsumer.assign the default.
STORM-2642: Storm-kafka-client spout cannot be serialized when using manual partition assignment.
HDP 2.6.1 provided Storm 1.1.0 and the following Apache patches:
STORM-1114: Handle race condition in Storm/Trident transactional state when ZK nodes have already been created/deleted.
STORM-2194: ReportErrorAndDie doesn't always die.
STORM-2429: non-string values in supervisor.scheduler.meta cause crash.
STORM-2431: the default blobstore.dir is storm.local.dir/blobs which is different from distcache-blobstore.md.
STORM-2432: Storm-Kafka-Client Trident Spout Seeks Incorrect Offset With UNCOMMITTED_LATEST Strategy.
STORM-2440: Kill process if executor catches `java.net.SocketTimeoutException`.
STORM-2450: Write resources into correct local directory.
STORM-2451: windows storm.cmd does not set log4j2 config file correctly by default.
STORM-2482: Refactor the Storm auto credential plugins to be more usable.
STORM-2482: Refactor the Storm auto credential plugins to be more usable.
STORM-2496: Dependency artifacts should be uploaded to blobstore with READ permission for all.
STORM-2498: Fix Download Full File link in 1.x branch.
STORM-2501: Auto populate Hive credentials using Hive MetaStore delegation tokens.
STORM-2511: Submitting a topology with name containing unicode getting failed..
STORM-2518: NPE during uploading dependency artifacts with secured cluster.
STORM-2520: AutoHDFS should prefer cluster-wise hdfs kerberos principal to global hdfs kerberos principal.
STORM-2528: Bump log4j version to 2.8.2.
HDP 2.6.0 provided Storm 1.1.0 with no additional Apache patches.