Apache Iceberg 1.5.0
·
610 commits
to main
since this release
Apache Iceberg 1.5.0 was released on March 11, 2024.
The 1.5.0 release adds a variety of new features and bug fixes.
- API
- Core
- Add view support for REST catalog (#7913)
- Add view support for JDBC catalog (#9487)
- Add catalog type for glue,jdbc,nessie (#9647)
- Support Avro file encryption with AES GCM streams (#9436)
- Add ApplyNameMapping for Avro (#9347)
- Add StandardEncryptionManager (#9277)
- Add REST catalog table session cache (#8920)
- Support view metadata compression (#8552)
- Track partition statistics in TableMetadata (#8502)
- Enable column statistics filtering after planning (#8803)
- Spark
- Remove support for Spark 3.2 (#9295)
- Support views via SQL for Spark 3.4 and 3.5 (#9423, #9421, #9343, #9513, #9582)
- Support executor cache locality (#9563)
- Added support for delete manifest rewrites (#9020)
- Support encrypted output files (#9435)
- Add Spark UI metrics from Iceberg scan metrics (#8717)
- Parallelize reading files in add_files procedure (#9274)
- Support file and partition delete granularity (#9384)
- Flink
- Parquet
- Kafka-Connect
- Spec
- Vendor Integrations
- AWS: Support setting description for Glue table (#9530)
- AWS: Update S3FileIO test to run when CLIENT_FACTORY is not set (#9541)
- AWS: Add S3 Access Grants Integration (#9385)
- AWS: Glue catalog strip trailing slash on DB URI (#8870)
- Azure: Add FileIO that supports ADLSv2 storage (#8303)
- Azure: Make ADLSFileIO implement DelegateFileIO (#8563)
- Nessie: Support views for NessieCatalog (#8909)
- Nessie: Strip trailing slash for warehouse location (#9415)
- Nessie: Infer default API version from URI (#9459)
- Dependencies
- Bump Nessie to 0.77.1
- Bump ORC to 1.9.2
- Bump Arrow to 15.0.0
- Bump AWS Java SDK to 2.24.5
- Bump Azure Java SDK to 1.2.20
- Bump Google cloud libraries to 26.28.0
Note:
- To enable view support for JDBC catalog, configure
jdbc.schema-versiontoV1in catalog properties.
New Contributors
- @reswqa made their first contribution in #7745
- @maxdebayser made their first contribution in #7796
- @mderoy made their first contribution in #7801
- @cxzl25 made their first contribution in #7825
- @tilman151 made their first contribution in #7781
- @TaoZex made their first contribution in #7761
- @Rondiz made their first contribution in #7829
- @grobgl made their first contribution in #7645
- @guiyanakuang made their first contribution in #7839
- @littlecatjianjiao made their first contribution in #7908
- @DaVincii made their first contribution in #7874
- @mumuhhh made their first contribution in #7866
- @Ewan-Keith made their first contribution in #7917
- @nikam14 made their first contribution in #7093
- @hsiang-c made their first contribution in #7920
- @ktk1012 made their first contribution in #8026
- @joan38 made their first contribution in #8002
- @coded9 made their first contribution in #8058
- @rustyconover made their first contribution in #8074
- @mr-brobot made their first contribution in #8061
- @Neuw84 made their first contribution in #7988
- @lintingbin made their first contribution in #8111
- @mrcnc made their first contribution in #8193
- @s-akhtar-baig made their first contribution in #8205
- @MaxNevermind made their first contribution in #7694
- @bmaisonn made their first contribution in #8209
- @HonahX made their first contribution in #8215
- @onerishabh made their first contribution in #8214
- @kengtin made their first contribution in #7161
- @aless10 made their first contribution in #8286
- @advancedxy made their first contribution in #8320
- @dacort made their first contribution in #8341
- @gegef2009 made their first contribution in #8154
- @TjuAachen made their first contribution in #8401
- @baiyangtx made their first contribution in #8416
- @hiteshbedre made their first contribution in #8491
- @harshm-dev made their first contribution in #8385
- @wForget made their first contribution in #8445
- @andreacfm made their first contribution in #8528
- @Paddy0523 made their first contribution in #8547
- @rushilshah1 made their first contribution in #8589
- @lanemoseley made their first contribution in #8618
- @tlm365 made their first contribution in #8447
- @jbonofre made their first contribution in #8612
- @jayceslesar made their first contribution in #8558
- @MehulBatra made their first contribution in #8408
- @clettieri made their first contribution in #8192
- @nk1506 made their first contribution in #8640
- @johanhenriksson made their first contribution in #8751
- @ashutosh-roy made their first contribution in #8707
- @Priyansh121096 made their first contribution in #8748
- @PickBas made their first contribution in #8819
- @jongwooo made their first contribution in #8666
- @rice668 made their first contribution in #8873
- @geruh made their first contribution in #8914
- @bknbkn made their first contribution in #8868
- @wangtaohz made their first contribution in #8494
- @hussein-awala made their first contribution in #8892
- @jacobmarble made their first contribution in #8683
- @leewjae made their first contribution in #8996
- @zinking made their first contribution in #8872
- @przemekd made their first contribution in #9029
- @PrabhuJoseph made their first contribution in #9046
- @cgpoh made their first contribution in #9120
- @ndrluis made their first contribution in #9090
- @lisirrx made their first contribution in #9122
- @yyy1000 made their first contribution in #9213
- @rodmeneses made their first contribution in #9211
- @mas-chen made their first contribution in #9173
- @lschetanrao made their first contribution in #9241
- @mt-ronkorving made their first contribution in #9272
- @jasonf20 made their first contribution in #9230
- @gabrywu made their first contribution in #9150
- @GianlucaPrincipini made their first contribution in #9161
- @agrawalreetika made their first contribution in #9283
- @chinmay-bhat made their first contribution in #9341
- @panbingkun made their first contribution in #9357
- @irshadcc made their first contribution in #9147
- @vinitpatni made their first contribution in #9364
- @adnanhemani made their first contribution in #9385
- @oneonestar made their first contribution in #9491
- @N-o-Z made their first contribution in #9498
- @huyuanfeng2018 made their first contribution in #9353
- @Aireed made their first contribution in #9543
- @alok123t made their first contribution in #9541
- @lkokhreidze made their first contribution in #9530
- @gjacoby126 made their first contribution in #9452
- @wgtmac made their first contribution in #9630
- @scottteal made their first contribution in #9669
- @munabedan made their first contribution in #9686
- @hantangwangd made their first contribution in #9816
- @rahil-c made their first contribution in #9660
Full Changelog: apache-iceberg-1.4.3...apache-iceberg-1.5.0
Contributors
dacort, andreacfm, and 90 other contributors