Releases · apache/iceberg

What's Changed

Nessie: Remove compile-time Hadoop dependency by @nastra in #7054
Core: Fix deprecation message by @nastra in #7104
Build: Update ORC to 1.8.3 by @williamhyun in #7124
AWS: Use Apache HTTP client as default AWS HTTP client by @singhpk234 in #7119
AWS: Enable virtual-host-style requests for MinioContainer by @nastra in #7125
Flink: Bump to Flink 1.15.3 by @Fokko in #7059
Flink: Bump to Flink 1.16.1 by @Fokko in #7057
Core: Use unknown report type for forward-compatibility by @nastra in #7145
Aliyun: Remove AssertHelpers by @liuxiaocs7 in #7116
dell: remove usage of AssertHelpers by @liuxiaocs7 in #7143
Core: Minor refactoring of PartitionsTable by @ajantha-bhat in #6975
Build: Let RevAPI compare against 1.2.0 by @nastra in #7155
MR: Remove deprecate AssertHelpers by @liuxiaocs7 in #7159
Core: Remove deprecated validation APIs in MergingSnapshotProducer by @amogh-jahagirdar in #7150
data: Remove AssertHelpers Usage by @liuxiaocs7 in #7134
Flink:fix flink streaming query problem [ Cannot get a client from a closed pool] by @xuzhiwen1255 in #6614
Spark 3.3: Remove use of deprecated SparkFilesScan by @szehon-ho in #7106
Docs: Add rest to the catalog configuration by @Fokko in #7126
Contributing Docs: Add section for testing code by @nastra in #7131
Core, API: View Version implementation by @amogh-jahagirdar in #6861
Update defaults of max-concurrent-file-group-rewrites to 5 by @karuppayya in #6907
Flink: fixed Cloneable not implemented on CatalogLoader by @xuzhiwen1255 in #7168
Core: Refactor actions results by @ajantha-bhat in #7089
Docs: update doc to read easier by @joonsun-baek in #7167
API: Fix retainAll and removeAll in CharSequenceSet by @zhongyujiang in #7133
Spark 3.3: Support metadata column in the changelog table by @flyrain in #7152
Spark 3.2: Support metadata column in the changelog table by @flyrain in #7178
Flink: Backport #6614 to Flink 1.15 by @xuzhiwen1255 in #7165
Core: Remove deprecated code from 1.2.0 by @nastra in #7156
S3 Credentials provider support in DefaultAwsClientFactory #7063 by @dpaani in #7066
Core: Move InMemoryCatalog from test to core by @nastra in #7185
Doc: Retypeset the Flink document by @hililiwei in #7099
Core: Store split offset for delete files by @singhpk234 in #7011
Flink: Backport #6614 to Flink 1.14 by @xuzhiwen1255 in #7166
Core, Hive: Support pluggable ClientPool by @lirui-apache in #6698
AWS: Remove deprecated AssertHelpers by @liuxiaocs7 in #7195
Spark: Support loading function as FunctionCatalog in SparkSessionCatalog by @bowenliang123 in #7153
Flink: Implement data statistics operator to collect traffic distribution for guiding smart shuffling by @yegangy0718 in #6382
Build: Move RevApi breakage to correct version by @nastra in #7223
Ability to add multiple metrics reporters to scan by @karuppayya in #6919
Spark 3.3: Use ProcedureInput in AncestorsOfProcedure by @aokolnychyi in #7177
Core: Parse snapshot-id as long in remove-statistics update by @nastra in #7235
Bump Nessie to 0.54.0 by @snazy in #7146
Optimized spark vectorized read parquet decimal by @ConeyLiu in #3249
Core: Optimize S3 layout of Datafiles by expanding first character set of the hash by @singhpk234 in #7128
AWS: Prevent token refresh scheduling on every sign request by @nastra in #7270
Disable local credentials if remote signing is enabled by @danielcweeks in #7230
Spark: Revert "Spark: Add "Iceberg" prefix to SparkTable name string for SparkUI (#5629) by @amogh-jahagirdar in #7273
Spark: broadcast table instead of file IO in rewrite manifests by @bryanck in #7263
AWS: abort S3 input stream on close if not EOS by @bryanck in #7262
Spark 3.2: Use ProcedureInput in AncestorsOfProcedure and AddFilesProcedure by @aokolnychyi in #7260
Spark 3.3: Dataset writes for position deletes by @szehon-ho in #7029
REST: fix previous locations for refs-only load by @bryanck in #7284
Core: Fix flakiness in HadoopFileIOTest by @nastra in #7253
Flink: Data statistics operator sends local data statistics to coordinator and receive aggregated data statistics from coordinator for smart shuffling by @yegangy0718 in #7269
AWS: Make AuthSession cache static by @nastra in #7289
Core: Require namespace when creating table using InMemoryCatalog by @nastra in #7252
Refactor PartitionsTable planning by @dramaticlly in #7190
Flink: Introduce Flink 1.17 by @hililiwei in #7254
AWS: Check commit status after failed commit if AWS client performed retries by @ChristinaTech in #7198
Core: Fix errorprone warning by @ajantha-bhat in #7286
Bump Nessie to 0.56.0 by @snazy in #7283
Build: Bump actions/stale from 7.0.0 to 8.0.0 by @dependabot in #7200
Build: Bump org.apache.hadoop:hadoop-client from 3.3.4 to 3.3.5 by @dependabot in #7201
Spark: apply rewrite manifest action fix to 3.1,3.2 by @bryanck in #7296
Build: Spark version of iceberg-delta-lake to 3.3.2 by @doki23 in #7199
Nessie: Use latest hash for catalog APIs by @ajantha-bhat in #6789
Support vectorized reading int96 timestamps in imported data by @yabola in #6962
Flink: Expose write-parallelism in SQL Hints by @hililiwei in #7039
Nessie: Fix testcase failures by @ajantha-bhat in #7320
Flink: move the classes from flink.sink.shuffle.statistics pkg to one level up as flink.sink.shuffle pkg by @stevenzwu in #7322
Spark 3.3: Add doc for the changelog view procedure. by @flyrain in #7147
Bump Nessie from 0.56.0 to 0.57.0 by @snazy in #7323
Flink 1.15 1.17: Port Expose write-parallelism in SQL Hints to 1.15 & 1.17 by @hililiwei in #7327
Update issue template for 1.2.1 release by @danielcweeks in #7331
Core: Fix SnapshotProducer#targetBranch's exception message by @zhongyujiang in #7315
Bump Gradle from 8.0.2 to 8.1 by @snazy in #7333
Build: Fix flaky checkstyle issue by @ajantha-bhat in #7321
[Infra] Update vote mail sample in source-release.sh by @gaborkaszab in #7330
Core: Add missing metrics reporters when creating BaseTable by @nastra in #7341
Core, Spark 3.3: Add FileRewriter API by @aokolnychyi in #7175
Spark - Accept an output-spec-id that allows writing to a desired partition spec by @gustavoatt in #7120
[ORC][Spark] - Support selected vector with ORC reader on the row and batch reader by @pavibhai in #7197
Flink: use correct scan mode when in TABLE_SCAN_THEN_INCREMENTAL mode by @chenjunjiedada in #7338
Throw NoSuchIcebergTableException instead of ValidationException in G… by @ericlgoodman in #7277
Build: Bump Airlift from 0.21 to 0.24 by @Fokko in #7347
Docs: clarify Hive on Tez con...