Describe the bug
When an Iceberg table references data files that omit identity partition columns, Auron can return NULL instead of the partition values recorded in Iceberg metadata. This can occur after importing Spark/Hive-style partitioned files with add_files.
To Reproduce
- Import Hive-style partitioned Parquet files into an Iceberg table using
add_files. The files omit the partition column p.
- Query
select id, p from table_name with Auron enabled.
For a row in partition p='a', Auron returns (1, NULL) instead of (1, 'a').
Expected behavior
Return (1, 'a'), matching Iceberg's reader, which supplies the missing identity column from partition metadata.
Screenshots
Additional context
Describe the bug
When an Iceberg table references data files that omit identity partition columns, Auron can return NULL instead of the partition values recorded in Iceberg metadata. This can occur after importing Spark/Hive-style partitioned files with
add_files.To Reproduce
add_files. The files omit the partition column p.select id, p from table_namewith Auron enabled.For a row in partition p='a', Auron returns (1, NULL) instead of (1, 'a').
Expected behavior
Return
(1, 'a'), matching Iceberg's reader, which supplies the missing identity column from partition metadata.Screenshots
Additional context