HDP-2.3.6 Release Notes
Also available as:
PDF

Storm

In addition to any Apache patches ported over from the 2.4.x core, HDP 2.3.6 provides Storm 0.10.0-beta and the following Apache patches:

  • STORM-1689: Set request headersize for logviewer.

  • STORM-969: HDFS Bolt can end up in an unrecoverable state.

HDP 2.3.6 provides Storm 0.10.0-beta and ports the following Apache patches from the 2.4.x core:

  • STORM-1001: Undefined STORM_EXT_CLASSPATH adds '::' to classpath of workers.

  • STORM-1005: Supervisor do not get running workers after restart.

  • STORM-1024: log4j changes leaving ${sys:storm.log.dir} under STORM_HOME dir.

  • STORM-1027: Use overflow buffer for emitting metrics.

  • STORM-1037: Do not remove STORM-code in supervisor until kill job.

  • STORM-1044: Setting dop to zero does not raise an error.

  • STORM-1096: Fix some issues with impersonation on the UI.

  • STORM-1108: Fix NPE in simulated time.

  • STORM-1121: Deprecate test only configuration nimbus.reassign.

  • STORM-139: hashCode does not work for byte[].

  • STORM-1476: Filter -c options from args and add them as part of storm.options.

  • STORM-1481: Avoid Math.abs(Integer) get a negative value.

  • STORM-1482: Add missing 'break' for RedisStoreBolt.

  • STORM-1521: When using Kerberos login from keytab with multiple bolts/executors ticket is not renewed.

  • STORM-422: Allow more arguments to be passed to Storm jar.

  • STORM-584: Fix logging for LoggingMetricsConsumer metrics.log file.

  • STORM-745: Fix storm.cmd to evaluate 'shift' correctly with 'Storm jar'.

  • STORM-793: Made change to logviewer.clj in order to remove the invalid http 500 response.

  • STORM-810: PartitionManager in STORM-kafka should commit latest offset before close.

  • STORM-837: HdfsState ignores commits.

  • STORM-866: Use storm.log.dir instead of storm.home in log4j2 config.

  • STORM-966: ConfigValidation.DoubleValidator doesn't really validate whether the type of the object is a double.

  • STORM-977: Incorrect signal (-9) when as-user is true.

  • STORM-992: A bug in the timer.clj might cause unexpected delay to schedule new event.

HDP 2.3.4.7 provided Storm 0.10.0-beta with no additional Apache patches.

HDP 2.3.4 provided Storm 0.10.0-beta and the following Apache patches:

  • STORM-1017: If ignoreZkOffsets set true,KafkaSpout will reset zk offset when recover from failure.

  • STORM-1030: Hive Connector Fixes.

  • STORM-1102: Add a default flush interval for HiveBolt.

  • STORM-1147: STORM JDBCBolt should add validation to ensure either insertQuery or table name is specified and not both.

  • STORM-1203: Worker metadata file creation doesn't useSTORM.log.dir config.

  • STORM-139: hashCode does not work for byte[].

  • STORM-412: Allow users to modify logging levels of running topologies.

  • STORM-742: Let ShellBolt treat all messages to update heartbeat.

  • STORM-992: A bug in the timer.clj might cause unexpected delay to schedule new event.

  • STORM-996: netty-unit-tests/test-batch demonstrates out-of-order delivery.

HDP 2.3.2 provided Storm 0.10.0-beta, with no additional Apache patches.

HDP 2.3.0 provided Storm 0.10.0-beta and the following Apache patches:

  • STORM-166 Highly Available Nimbus

  • STORM-583 Add Microsoft Azure Event Hub spout implementations

  • STORM-691 Add basic lookup / persist bolts

  • STORM-703 With hash key option for RedisMapState, only get values for keys in batch

  • STORM-708 CORS support for STORM UI.

  • STORM-711 All connectors should use collector.reportError and tuple anchoring.

  • STORM-713 Include topic information with Kafka metrics.

  • STORM-714 Make CSS more consistent with self, prev release

  • STORM-724 Document RedisStoreBolt and RedisLookupBolt which is missed.

  • STORM-727 Storm tests should succeed even if a Storm process is running locally.

  • STORM-741 Allow users to pass a config value to perform impersonation.