Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support configuring compression levels for ZSTD writes #25142

Open
akki opened this issue Feb 25, 2025 · 1 comment
Open

Support configuring compression levels for ZSTD writes #25142

akki opened this issue Feb 25, 2025 · 1 comment

Comments

@akki
Copy link

akki commented Feb 25, 2025

Various Trino connectors support writing data with ZSTD compression (for e.g. using hive.compression-codec for Hive connector).
ZSTD also supports compression level (currently from 1 to 22). It would be good to support this functionality in Trino too, so that we can benefit from higher compression levels (reducing storage costs).

This is similar to what Spark allows with spark.sql.parquet.compression.coded.zstd.level.

@ebyhr
Copy link
Member

ebyhr commented Feb 25, 2025

cc: @raunaqmorarka

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Development

No branches or pull requests

2 participants