-
Notifications
You must be signed in to change notification settings - Fork 144
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Add downloads page for 0.2.0-incubating
- Loading branch information
1 parent
ced9223
commit f3e1146
Showing
6 changed files
with
92 additions
and
1 deletion.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,13 @@ | ||
--- | ||
title: Downloads | ||
sidebar_position: 1 | ||
--- | ||
|
||
Apache XTable™ (incubating) releases are available under the Apache License, Version 2.0. See the NOTICE file contained in each release artifact for applicable copyright attribution notices. | ||
|
||
To ensure that you have downloaded the true release, you should [verify](https://www.apache.org/info/verification.html) the integrity of the files using the signatures and checksums available in this page. All releases are signed using the [Apache XTable KEYS file](https://downloads.apache.org/incubator/xtable/KEYS). | ||
|
||
### Release 0.2.0-incubating | ||
* Source Release: [Apache XTable 0.2.0-incubating Source Release](https://dlcdn.apache.org/incubator/xtable/0.2.0-incubating/apache-xtable-0.2.0-incubating.src.tgz) ([asc](https://downloads.apache.org/incubator/xtable/0.2.0-incubating/apache-xtable-0.2.0-incubating.src.tgz.asc), [sha512](https://downloads.apache.org/incubator/xtable/0.2.0-incubating/apache-xtable-0.2.0-incubating.src.tgz.sha512)) | ||
* Release Notes: [Release Notes 0.2.0-incubating](release-0.2.0-incubating.mdx) | ||
* Maven Search: [Apache XTable 0.2.0-incubating](https://central.sonatype.com/search?q=g:org.apache.xtable%20v:0.2.0-incubating&smo=true) |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,35 @@ | ||
--- | ||
title: "Release 0.2.0-incubating" | ||
sidebar_position: 1 | ||
--- | ||
|
||
## [Release 0.2.0-incubating](https://github.com/apache/incubator-xtable/releases/tag/0.2.0-incubating) ([docs](https://xtable.apache.org/docs/how-to)) | ||
This is the second official Apache release for Apache XTable (Incubating), an incubating project under the Apache Software Foundation. | ||
Apache XTable™ (Incubating) facilitates omni-directional interoperability across data processing systems and query engines by allowing users to convert between open table formats without the need to rewrite any data files. | ||
Currently, Apache XTable™ (Incubating) supports the open-source table formats for Apache Hudi, Apache Iceberg, and Delta Lake. | ||
|
||
## Features | ||
Apache XTable™ (Incubating) provides users with the ability to translate metadata from one table format to another. | ||
|
||
Apache XTable™ (Incubating) provides two sync modes, "incremental" and "full." The incremental mode is more lightweight and has better performance, especially on large tables. If there is anything that prevents the incremental mode from working properly, the tool will fall back to the full sync mode. | ||
|
||
This sync provides users with the following: | ||
|
||
1. Syncing of data files along with their column level statistics and partition metadata | ||
2. Schema updates in the source are reflected in the target table metadata | ||
3. Metadata maintenance for the target table formats. | ||
* For Hudi, unreferenced files will be marked as [cleaned](https://hudi.apache.org/docs/hoodie_cleaner/) to control the size of the metadata table. | ||
* For Iceberg, snapshots will be [expired](https://iceberg.apache.org/docs/latest/maintenance/#expire-snapshots) after a configured amount of time. | ||
* For Delta, the transaction log will be [retained](https://docs.databricks.com/en/sql/language-manual/delta-vacuum.html) for a configured amount of time. | ||
|
||
|
||
## Improvements | ||
1. Added apache release guide and infra components to be compliant with ASF release process. | ||
2. Updated LICENSE and NOTICE file contents based on guidance given by [LEGAL-684](https://issues.apache.org/jira/browse/LEGAL-684) | ||
3. Fix bugs related to dependency conflicts, few edge cases related to column stats, non numeric values of double type in delta stats etc. | ||
4. Improved README, docker demo and website docs based on feedback provided by users. | ||
5. Refactored the codebase to follow apache naming practices. | ||
|
||
## GH Release Notes | ||
https://github.com/apache/incubator-xtable/releases/tag/0.2.0-incubating | ||
|
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters