Impala changelog for CDW Public Cloud

Review the changes introduced in Impala for Cloudera Data Warehouse Public Cloud.

2024.0.18.2-4 (October 4, 2024)

No new features or fixes.

2024.0.18.1-1 (August 15, 2024)

  • IMPALA-13270: Addressing IllegalStateException in Complex Views post upgrade
  • IMPALA-13272: Stability Improvement for analytic functions on collections

2024.0.18.0-206 (July 26, 2024)

  • IMPALA-13137: Add additional client fetch metrics columns to the queries page
  • IMPALA-12800: Implement hashCode everywhere
  • IMPALA-13159: Fix query cancellation caused by statestore failover
  • IMPALA-13152: Avoid NaN, infinite, and negative ProcessingCost
  • IMPALA-13138: Never smallify existing StringValue objects, only new ones during DeepCopy
  • IMPALA-13131: Azure OpenAI API expects 'api-key' instead of 'Authorization' in the request header
  • IMPALA-12800: Add cache for isTrueWithNullSlots() evaluation
  • IMPALA-12800: Use HashMap for ExprSubstitutionMap lookups
  • IMPALA-13119: Fix cost_ initialization at CostingSegment.java
  • IMPALA-12616: Fix test_restart_services.py::TestRestart tests for S3
  • IMPALA-13129: Move runtime filter skipping at registerRuntimeFilter
  • IMPALA-8042: Assign BETWEEN selectivity for discrete-unique column
  • IMPALA-12800: Skip O(n^2) ExprSubstitutionMap::verify() for release builds
  • IMPALA-13040: Inject larger delay for sanitized build
  • IMPALA-13134: DDL hang with SYNC_DDL enabled when Catalogd is changed to standby status
  • IMPALA-11499: Refactor UrlEncode function to handle special characters
  • IMPALA-13040: Add waiting mechanism in UpdateFilterFromRemote
  • IMPALA-13018: Block push down of conjuncts with implicit casting on base columns for jdbc tables
  • IMPALA-13058: Init first_arrival_time_ and completion_time_ with -1
  • IMPALA-13054: Avoid revisiting children in QueryStateExpanded
  • IMPALA-13061: Create query live as external table
  • IMPALA-12910: Support running TPCH/TPCDS queries for JDBC tables
  • IMPALA-13049: Add dependency management for log4j2 to use 2.18.0
  • IMPALA-13045: Wait for impala_query_live to exist
  • IMPALA-12997: Use graceful shutdown for query log tests
  • IMPALA-13012: Lower default query_log_max_queued
  • IMPALA-13005: Create Query Live table in HMS
  • IMPALA-13024: Ignore slots if using default pool and empty group
  • IMPALA-12657: Improve ProcessingCost of ScanNode and NonGroupingAggregator
  • IMPALA-12988: Calculate an unbounded version of CpuAsk
  • IMPALA-12980: Translate CpuAsk into admission control slots
  • IMPALA-12965: Add debug query option RUNTIME_FILTER_IDS_TO_SKIP
  • IMPALA-13004: Fix heap-use-after-free error in ExprTest AiFunctionsTest
  • IMPALA-12874: Identify active and standby catalog and statestore in the web debug endpoint
  • IMPALA-12564: Prevent Hive loading libfesupport.so in the minicluster during TSAN runs
  • IMPALA-12998: Add SHOW_METADATA_TABLES to ignored DDL
  • IMPALA-12963: Return parent PID when children spawned
  • IMPALA-12920: Support ai_generate_text built-in function for OpenAI's chat completion API
  • IMPALA-12969: Release JNI array if DeserializeThriftMsg failed
  • IMPALA-12881: Use getFkPkJoinCardinality to reduce scan cardinality
  • IMPALA-11430: Support custom hash schema for Kudu range tables
  • IMPALA-12960: Fix Incorrect RowsPassedThrough Metric in Streaming Aggregation
  • IMPALA-12925: Fix decimal data type for external JDBC table
  • IMPALA-12899: Temporary workaround for BINARY in complex types
  • IMPALA-12602: Unregister queries on idle timeout
  • IMPALA-12782: Show info of the event processing in /events webUI
  • IMPALA-12852: Make Kudu service start and stop independent
  • IMPALA-12426: Switches the duration fields to be stored in decimal seconds.
  • IMPALA-12944: Fixes Workload Management Test Flakiness
  • IMPALA-12426: Skip Inserting HS2 Operation Queries into the Completed Queries Table
  • IMPALA-12626: Add Tables Queried to profile/history
  • IMPALA-12264: Add limit on number of HS2 sessions per user.
  • IMPALA-12540: Add EventSequence arg to load
  • IMPALA-12540: Query Live Table
  • IMPALA-12824: Removes the prettyprint_duration Built-in Function
  • IMPALA-12942: deflake test_virtual_column_file_position_generic
  • IMPALA-12487: Skip reloading file metadata for ALTER_TABLE events with trivial changes in StorageDescriptor
  • IMPALA-12928: Mask JDBC table property dbcp.password for DESC FORMATTED and SHOW CREATE TABLE
  • IMPALA-12913: Refactor Workload Management Custom Cluster Tests
  • IMPALA-12699: Set timeout for catalog RPCs
  • IMPALA-12807: Add support for mold linker
  • IMPALA-12915: Use libgtest.so when built with shared libs
  • IMPALA-12903: Querying virtual column FILE__POSITION for TEXT and JSON tables crashes Impala
  • IMPALA-12896: JDBC table must be created as external table
  • IMPALA-4545: Simplify test dimension in test_decimal_casting.py
  • IMPALA-12898: Tidy up test dimensions of test_scanner.py
  • IMPALA-12929: Skip loading HDFS permissions in local-catalog mode
  • IMPALA-12930: Fix TestExtDataSources.test_jdbc_data_source failure
  • IMPALA-12923: Fix header alignment during horizontal scrolling in query timeline
  • IMPALA-12926: Refactor BINARY type handling in the backend
  • IMPALA-12819: Sync add-opens targets
  • IMPALA-12443: Add catalog timeline for all DDL profiles
  • IMPALA-11938: Raised error if NUM_NODES is set to invalid value.
  • IMPALA-12802: Support ALTER TABLE for JDBC tables
  • IMPALA-12924: Upgrade xmlsec to 2.2.6
  • IMPALA-12426: Query History Table
  • IMPALA-12883: Support updating the charge on an entry in the cache
  • IMPALA-12904: test_type_conversions_hive3 silently passes because of wrongly defined test dimensions
  • IMPALA-12914: TestBannedLogMessages no longer requires running cluster
  • IMPALA-12818: Intermediate Result Caching plan node framework
  • IMPALA-12835: Fix event processing without hms_event_incremental_refresh_transactional_table
  • IMPALA-12917: Skip TestEventProcessingError tests requiring tez execution on hive
  • IMPALA-12916: Fix test_event_processor_error_global_invalidate test random failure
  • IMPALA-12896: Avoid JDBC table to be set as transactional table
  • IMPALA-12831: Fix HdfsTable.toMinimalTCatalogObject() failed by concurrent modification
  • IMPALA-12832: Implicit invalidate metadata on event failures
  • IMPALA-12798: Tolerate floationg point precision for regr_intercept() TIMESTAMP test
  • IMPALA-12730: Don't use -Weverything for clang-tidy
  • IMPALA-12849: Standby catalogd should reject requests from coordinators
  • IMPALA-12855: Fix NPE in firing RELOAD events when the partition doesn't exist
  • IMPALA-12678: Deflake test_skipping_batching_events
  • IMPALA-12878: Report invalid query if finalized
  • IMPALA-12860: Invoke validateDataFilesExist for RowDelta operations
  • IMPALA-12864: Deflake test_query_log_size_in_bytes.
  • IMPALA-12851: Fix AllocWriteIdEvent process issue to add txnId-tableWriteIds mapping
  • IMPALA-12815: Support timestamp for scan predicates for external data source table.
  • IMPALA-12833: Enabled 'catalogd_ha_reset_metadata_on_failover' by default
  • IMPALA-12821: Fix test_create_table_profile_events depend on event-processor
  • IMPALA-12825: Install thrift into the impala-python virtualenv
  • IMPALA-12834: Add number of concurrent queries to profile
  • IMPALA-12859: Ensure query log estimated memory is initialized
  • IMPALA-12838: Adds exec_options parameter to single_node_perf_run.py
  • IMPALA-12717: Fix error message for missing table descriptor
  • IMPALA-12426: QueryStateRecord Refactor
  • IMPALA-12827: Fix failures in processing AbortTxnEvent due to aborted write id is cleaned up
  • IMPALA-12426: Workload Management Supporting Changes
  • IMPALA-12840: Exclude THdfsFileDesc in getJsonCatalogObject
  • IMPALA-12793: Create JDBC table without data source
  • IMPALA-12823: Fix repeated query not found messages in impalad.INFO logs
  • IMPALA-12801: Increase query_log_ default size and bound its memory.
  • IMPALA-12426: Remove Usage of Unnecessary this->
  • IMPALA-12433: Share buffers among channels in KrpcDataStreamSender
  • IMPALA-12824: Adds built-in functions prettyprint_duration and prettyprint_bytes.
  • IMPALA-12842: Make node.js installation aware of CPU architecture
  • IMPALA-12830: test_webserver_hide_logs_link() could fail in the exhaustive build
  • IMPALA-12847: Expose computeScanRangeLocations and computeStats
  • IMPALA-11123: Reimplement ORC optimized count star
  • IMPALA-9086: Show Hive configurations in /hadoop-varz page
  • IMPALA-12796: Add is_footer_only in TFileSplitGeneratorSpec
  • IMPALA-12631: Improve count star performance for parquet scans
  • IMPALA-12811: Exception during re-analyze can be lost
  • IMPALA-12814: Allow use of row_regex for VERIFY_IS_NOT_IN
  • IMPALA-11568: Fix SamplingTimeSeriesCounter not correctly cleared
  • IMPALA-12816: Remove exclusion of Netty to allow SSL connections to HBase
  • IMPALA-12790: Fix overestimation in ScanNode.getInputCardinality
  • IMPALA-12803: Fix missing exchange lines in query timeline
  • IMPALA-12795: Deflake test_catalog_operation_fields
  • IMPALA-12688: Support JSON profile imports in webUI
  • IMPALA-12744: Support for regr_count() aggregate/analytic function
  • IMPALA-12788: Fix HBaseTable still get loaded even if HBase is down
  • IMPALA-12378: Add commons-dbcp2.version replacement
  • IMPALA-12578: Pass owner user of database and table to Ranger in GRANT/REVOKE
  • IMPALA-12378: Auto Ship JDBC Data Source
  • IMPALA-12780: Only show non-default options in the catalog operations page
  • IMPALA-12784: Fix bug in ScanNode.getFilteredInputCardinality
  • IMPALA-12503: Support date data type for predicates for external data source table
  • IMPALA-12783: Nested struct with varlen data crashes
  • IMPALA-12726: Simulate large-scale query in TpcdsCpuCostPlannerTest
  • IMPALA-12655: Stabilize compute-table-stats.sh
  • IMPALA-12770: Fix infinite loop for nested Case expressions
  • IMPALA-12781: ARRAY<STRUCT<s: STRING> crashes in top-n
  • IMPALA-12718: Provides UTF-8 support for the trim functions
  • IMPALA-12778: Fix time strings in catalog operations page
  • IMPALA-12642: Fixed unit-test to verify query options for JDBC external table
  • IMPALA-12695: Crash with UNION with complex types
  • IMPALA-12448: Avoid getting stuck when refreshing a non-existent partition
  • IMPALA-12471: skip mysql ext jdbc tests if setup environment fails.
  • IMPALA-12763: Union with string struct crashes in ASAN
  • IMPALA-12762: Fix cmake error in package building
  • IMPALA-12767: Upgrade Guava to 32.0.1 due to CVE-2023-2976
  • IMPALA-12463: Batch non-consecutive table events in the event processor
  • IMPALA-12745: Skip parallel symbol dumping with RPM/DEB packages
  • IMPALA-12125: Support for dumping symbols from RPMs without separate symbols
  • IMPALA-12746: Bump jackson.databind to 2.15.3
  • IMPALA-12727: Reduce IO threads for non-TARGET_FILESYSTEM filesystems
  • IMPALA-12740: Fix TestHdfsJsonScanNodeErrors fails in exhaustive mode
  • IMPALA-12711: Fix DDL errors are not shown in impalad logs
  • IMPALA-12590: Fix dmesg call during precommit for Ubuntu 20.04
  • IMPALA-12584: Enable strict data file access by default
  • IMPALA-12038: Switch report_benchmark_results.py to python 3
  • IMPALA-12716: Fix timeout thresholds in test_catalog_operations_with_rpc_retry
  • IMPALA-12431: Support reading compressed JSON file
  • IMPALA-12690: Add TpcdsCpuCostPlannerTest
  • IMPALA-12642: Support query options for Impala external JDBC table
  • IMPALA-12054: Lazily check Kudu flags in tests
  • IMPALA-12582: Fix crash when enabling MIN_MAX RuntimeFilter in Nested Loop Join
  • IMPALA-12665: Adjust complete_micro_batch_ length to new scratch_batch_->capacity after ScratchTupleBatch::Reset
  • IMPALA-12687: Fix key conflicts in tracking in-flight catalog operations
  • IMPALA-12356: Fix first ALTER_PARTITION event from Hive could be treated as self event
  • IMPALA-12747: Atomic update of execution state
  • IMPALA-12719: Reload filemetadata for AlterTable event of type truncate
  • IMPALA-12566: Fix RpcMgrKerberizedTest on RedHat 8
  • IMPALA-12743: Fix incremental stats are filtered out by HMS due to HIVE-27114