Load data inpath feature

From Impala, you can load Parquet data from a file in a directory on your file system or object store into an Iceberg table. You might need to set the mem_limit or pool configuration (max-query-mem-limit, min-query-mem-limit) to accommodate the load.

Impala syntax

LOAD DATA INPATH ‘<path to file>’ INTO table t;

Impala example

In this example, you create a table using the LIKE clause to point to a table stored as Parquet. This is required for Iceberg to infer the schema.

create table test_iceberg like my_parquet_table stored as iceberg;
set mem_limit=1MB;
load data inpath 's3a://testbucket/files/my_data.parq' into table test_iceberg;