Impala changelog for CDW Public Cloud

IMPALA-13137: Add additional client fetch metrics columns to the queries page

IMPALA-12800: Implement hashCode everywhere

IMPALA-13159: Fix query cancellation caused by statestore failover

IMPALA-13152: Avoid NaN, infinite, and negative ProcessingCost

IMPALA-13138: Never smallify existing StringValue objects, only new ones during DeepCopy

IMPALA-13131: Azure OpenAI API expects 'api-key' instead of 'Authorization' in the request header

IMPALA-12800: Add cache for isTrueWithNullSlots() evaluation

IMPALA-12800: Use HashMap for ExprSubstitutionMap lookups

IMPALA-13119: Fix cost_ initialization at CostingSegment.java

IMPALA-12616: Fix test_restart_services.py::TestRestart tests for S3

IMPALA-13129: Move runtime filter skipping at registerRuntimeFilter

IMPALA-8042: Assign BETWEEN selectivity for discrete-unique column

IMPALA-12800: Skip O(n^2) ExprSubstitutionMap::verify() for release builds

IMPALA-13040: Inject larger delay for sanitized build

IMPALA-13134: DDL hang with SYNC_DDL enabled when Catalogd is changed to standby status

IMPALA-11499: Refactor UrlEncode function to handle special characters

IMPALA-13040: Add waiting mechanism in UpdateFilterFromRemote

IMPALA-13018: Block push down of conjuncts with implicit casting on base columns for jdbc tables

IMPALA-13058: Init first_arrival_time_ and completion_time_ with -1

IMPALA-13054: Avoid revisiting children in QueryStateExpanded

IMPALA-13061: Create query live as external table

IMPALA-12910: Support running TPCH/TPCDS queries for JDBC tables

IMPALA-13049: Add dependency management for log4j2 to use 2.18.0

IMPALA-13045: Wait for impala_query_live to exist

IMPALA-12997: Use graceful shutdown for query log tests

IMPALA-13012: Lower default query_log_max_queued

IMPALA-13005: Create Query Live table in HMS

IMPALA-13024: Ignore slots if using default pool and empty group

IMPALA-12657: Improve ProcessingCost of ScanNode and NonGroupingAggregator

IMPALA-12988: Calculate an unbounded version of CpuAsk

IMPALA-12980: Translate CpuAsk into admission control slots

IMPALA-12965: Add debug query option RUNTIME_FILTER_IDS_TO_SKIP

IMPALA-13004: Fix heap-use-after-free error in ExprTest AiFunctionsTest

IMPALA-12874: Identify active and standby catalog and statestore in the web debug endpoint

IMPALA-12564: Prevent Hive loading libfesupport.so in the minicluster during TSAN runs

IMPALA-12998: Add SHOW_METADATA_TABLES to ignored DDL

IMPALA-12963: Return parent PID when children spawned

IMPALA-12920: Support ai_generate_text built-in function for OpenAI's chat completion API

IMPALA-12969: Release JNI array if DeserializeThriftMsg failed

IMPALA-12881: Use getFkPkJoinCardinality to reduce scan cardinality

IMPALA-11430: Support custom hash schema for Kudu range tables

IMPALA-12960: Fix Incorrect RowsPassedThrough Metric in Streaming Aggregation

IMPALA-12925: Fix decimal data type for external JDBC table

IMPALA-12899: Temporary workaround for BINARY in complex types

IMPALA-12602: Unregister queries on idle timeout

IMPALA-12782: Show info of the event processing in /events webUI

IMPALA-12852: Make Kudu service start and stop independent

IMPALA-12426: Switches the duration fields to be stored in decimal seconds.

IMPALA-12944: Fixes Workload Management Test Flakiness

IMPALA-12426: Skip Inserting HS2 Operation Queries into the Completed Queries Table

IMPALA-12626: Add Tables Queried to profile/history

IMPALA-12264: Add limit on number of HS2 sessions per user.

IMPALA-12540: Add EventSequence arg to load

IMPALA-12540: Query Live Table

IMPALA-12824: Removes the prettyprint_duration Built-in Function

IMPALA-12942: deflake test_virtual_column_file_position_generic

IMPALA-12487: Skip reloading file metadata for ALTER_TABLE events with trivial changes in StorageDescriptor

IMPALA-12928: Mask JDBC table property dbcp.password for DESC FORMATTED and SHOW CREATE TABLE

IMPALA-12913: Refactor Workload Management Custom Cluster Tests

IMPALA-12699: Set timeout for catalog RPCs

IMPALA-12807: Add support for mold linker

IMPALA-12915: Use libgtest.so when built with shared libs

IMPALA-12903: Querying virtual column FILE__POSITION for TEXT and JSON tables crashes Impala

IMPALA-12896: JDBC table must be created as external table

IMPALA-4545: Simplify test dimension in test_decimal_casting.py

IMPALA-12898: Tidy up test dimensions of test_scanner.py

IMPALA-12929: Skip loading HDFS permissions in local-catalog mode

IMPALA-12930: Fix TestExtDataSources.test_jdbc_data_source failure

IMPALA-12923: Fix header alignment during horizontal scrolling in query timeline

IMPALA-12926: Refactor BINARY type handling in the backend

IMPALA-12819: Sync add-opens targets

IMPALA-12443: Add catalog timeline for all DDL profiles

IMPALA-11938: Raised error if NUM_NODES is set to invalid value.

IMPALA-12802: Support ALTER TABLE for JDBC tables

IMPALA-12924: Upgrade xmlsec to 2.2.6

IMPALA-12426: Query History Table

IMPALA-12883: Support updating the charge on an entry in the cache

IMPALA-12904: test_type_conversions_hive3 silently passes because of wrongly defined test dimensions

IMPALA-12914: TestBannedLogMessages no longer requires running cluster

IMPALA-12818: Intermediate Result Caching plan node framework

IMPALA-12835: Fix event processing without hms_event_incremental_refresh_transactional_table

IMPALA-12917: Skip TestEventProcessingError tests requiring tez execution on hive

IMPALA-12916: Fix test_event_processor_error_global_invalidate test random failure

IMPALA-12896: Avoid JDBC table to be set as transactional table

IMPALA-12831: Fix HdfsTable.toMinimalTCatalogObject() failed by concurrent modification

IMPALA-12832: Implicit invalidate metadata on event failures

IMPALA-12798: Tolerate floationg point precision for regr_intercept() TIMESTAMP test

IMPALA-12730: Don't use -Weverything for clang-tidy

IMPALA-12849: Standby catalogd should reject requests from coordinators

IMPALA-12855: Fix NPE in firing RELOAD events when the partition doesn't exist

IMPALA-12678: Deflake test_skipping_batching_events

IMPALA-12878: Report invalid query if finalized

IMPALA-12860: Invoke validateDataFilesExist for RowDelta operations

IMPALA-12864: Deflake test_query_log_size_in_bytes.

IMPALA-12851: Fix AllocWriteIdEvent process issue to add txnId-tableWriteIds mapping

IMPALA-12815: Support timestamp for scan predicates for external data source table.

IMPALA-12833: Enabled 'catalogd_ha_reset_metadata_on_failover' by default

IMPALA-12821: Fix test_create_table_profile_events depend on event-processor

IMPALA-12825: Install thrift into the impala-python virtualenv

IMPALA-12834: Add number of concurrent queries to profile

IMPALA-12859: Ensure query log estimated memory is initialized

IMPALA-12838: Adds exec_options parameter to single_node_perf_run.py

IMPALA-12717: Fix error message for missing table descriptor

IMPALA-12426: QueryStateRecord Refactor

IMPALA-12827: Fix failures in processing AbortTxnEvent due to aborted write id is cleaned up

IMPALA-12426: Workload Management Supporting Changes

IMPALA-12840: Exclude THdfsFileDesc in getJsonCatalogObject

IMPALA-12793: Create JDBC table without data source

IMPALA-12823: Fix repeated query not found messages in impalad.INFO logs

IMPALA-12801: Increase query_log_ default size and bound its memory.

IMPALA-12426: Remove Usage of Unnecessary this->

IMPALA-12433: Share buffers among channels in KrpcDataStreamSender

IMPALA-12824: Adds built-in functions prettyprint_duration and prettyprint_bytes.

IMPALA-12842: Make node.js installation aware of CPU architecture

IMPALA-12830: test_webserver_hide_logs_link() could fail in the exhaustive build

IMPALA-12847: Expose computeScanRangeLocations and computeStats

IMPALA-11123: Reimplement ORC optimized count star

IMPALA-9086: Show Hive configurations in /hadoop-varz page

IMPALA-12796: Add is_footer_only in TFileSplitGeneratorSpec

IMPALA-12631: Improve count star performance for parquet scans

IMPALA-12811: Exception during re-analyze can be lost

IMPALA-12814: Allow use of row_regex for VERIFY_IS_NOT_IN

IMPALA-11568: Fix SamplingTimeSeriesCounter not correctly cleared

IMPALA-12816: Remove exclusion of Netty to allow SSL connections to HBase

IMPALA-12790: Fix overestimation in ScanNode.getInputCardinality

IMPALA-12803: Fix missing exchange lines in query timeline

IMPALA-12795: Deflake test_catalog_operation_fields

IMPALA-12688: Support JSON profile imports in webUI

IMPALA-12744: Support for regr_count() aggregate/analytic function

IMPALA-12788: Fix HBaseTable still get loaded even if HBase is down

IMPALA-12378: Add commons-dbcp2.version replacement

IMPALA-12578: Pass owner user of database and table to Ranger in GRANT/REVOKE

IMPALA-12378: Auto Ship JDBC Data Source

IMPALA-12780: Only show non-default options in the catalog operations page

IMPALA-12784: Fix bug in ScanNode.getFilteredInputCardinality

IMPALA-12503: Support date data type for predicates for external data source table

IMPALA-12783: Nested struct with varlen data crashes

IMPALA-12726: Simulate large-scale query in TpcdsCpuCostPlannerTest

IMPALA-12655: Stabilize compute-table-stats.sh

IMPALA-12770: Fix infinite loop for nested Case expressions

IMPALA-12781: ARRAY<STRUCT<s: STRING> crashes in top-n

IMPALA-12718: Provides UTF-8 support for the trim functions

IMPALA-12778: Fix time strings in catalog operations page

IMPALA-12642: Fixed unit-test to verify query options for JDBC external table

IMPALA-12695: Crash with UNION with complex types

IMPALA-12448: Avoid getting stuck when refreshing a non-existent partition

IMPALA-12471: skip mysql ext jdbc tests if setup environment fails.

IMPALA-12763: Union with string struct crashes in ASAN

IMPALA-12762: Fix cmake error in package building

IMPALA-12767: Upgrade Guava to 32.0.1 due to CVE-2023-2976

IMPALA-12463: Batch non-consecutive table events in the event processor

IMPALA-12745: Skip parallel symbol dumping with RPM/DEB packages

IMPALA-12125: Support for dumping symbols from RPMs without separate symbols

IMPALA-12746: Bump jackson.databind to 2.15.3

IMPALA-12727: Reduce IO threads for non-TARGET_FILESYSTEM filesystems

IMPALA-12740: Fix TestHdfsJsonScanNodeErrors fails in exhaustive mode

IMPALA-12711: Fix DDL errors are not shown in impalad logs

IMPALA-12590: Fix dmesg call during precommit for Ubuntu 20.04

IMPALA-12584: Enable strict data file access by default

IMPALA-12038: Switch report_benchmark_results.py to python 3

IMPALA-12716: Fix timeout thresholds in test_catalog_operations_with_rpc_retry

IMPALA-12431: Support reading compressed JSON file

IMPALA-12690: Add TpcdsCpuCostPlannerTest

IMPALA-12642: Support query options for Impala external JDBC table

IMPALA-12054: Lazily check Kudu flags in tests

IMPALA-12582: Fix crash when enabling MIN_MAX RuntimeFilter in Nested Loop Join

IMPALA-12665: Adjust complete_micro_batch_ length to new scratch_batch_->capacity after ScratchTupleBatch::Reset

IMPALA-12687: Fix key conflicts in tracking in-flight catalog operations

IMPALA-12356: Fix first ALTER_PARTITION event from Hive could be treated as self event

IMPALA-12747: Atomic update of execution state

IMPALA-12719: Reload filemetadata for AlterTable event of type truncate

IMPALA-12566: Fix RpcMgrKerberizedTest on RedHat 8

IMPALA-12743: Fix incremental stats are filtered out by HMS due to HIVE-27114

Impala changelog for CDW Public Cloud

2024.0.18.1-1 (August 15, 2024)

2024.0.18.0-206 (July 26, 2024)