WIP: feat/glide destination #2

activescott · 2024-06-27T15:08:03Z

Manage this work in the following PR that merges back to airbyte: airbytehq#45915

…iled with status 400: {"message":"More than 500 mutations"}" in mutation api

…ape + tests

The readme contains instructions for how to use this with Airbyte and how to push new versions. There were also some fixes to our airbyte config to make the API path and host optional and they default to prod. This is probably getting close to closing glideapps/glide#27833 once it is reviewed

…e as latest

… to modify the values

…state

…o Airbyte's repo for suing it in Airbyte Cloud (#13)

…y type (#14) fixes glideapps/glide#29913

activescott requested a review from simonfl3tcher June 27, 2024 15:08

activescott assigned activescott and simonfl3tcher Jun 27, 2024

activescott force-pushed the feat/glide-destination branch from 53f24a7 to 7697748 Compare June 27, 2024 15:15

activescott had a problem deploying to community-ci June 27, 2024 15:16 — with GitHub Actions Failure

activescott had a problem deploying to community-ci-auto June 27, 2024 15:16 — with GitHub Actions Failure

activescott had a problem deploying to community-ci June 27, 2024 15:16 — with GitHub Actions Failure

activescott requested review from chkn and removed request for simonfl3tcher July 25, 2024 23:49

activescott assigned chkn and unassigned simonfl3tcher Jul 25, 2024

activescott added 18 commits February 17, 2025 12:48

wip: feat: initial logging destination for glide

Unverified

This commit is not signed, but one or more authors requires that any commit attributed to them is signed.

Learn about vigilant mode

9500be5

wip: glide api client

Unverified

This commit is not signed, but one or more authors requires that any commit attributed to them is signed.

Learn about vigilant mode

7f1649f

wip: gbt strategy progress

Unverified

This commit is not signed, but one or more authors requires that any commit attributed to them is signed.

Learn about vigilant mode

73f4a86

chore: minor cleanup, move delete_all decision into the strategy

Unverified

This commit is not signed, but one or more authors requires that any commit attributed to them is signed.

Learn about vigilant mode

dc74465

chore: cleanup logging

Unverified

This commit is not signed, but one or more authors requires that any commit attributed to them is signed.

Learn about vigilant mode

47fdd74

fix: AttributeError: 'Column' object has no attribute 'name'

Unverified

This commit is not signed, but one or more authors requires that any commit attributed to them is signed.

Learn about vigilant mode

4983062

fix: was adding duplicate rows to gbt

Unverified

This commit is not signed, but one or more authors requires that any commit attributed to them is signed.

Learn about vigilant mode

388df6e

feat: choose a strategy based on config; unify tests

Unverified

This commit is not signed, but one or more authors requires that any commit attributed to them is signed.

Learn about vigilant mode

71cf51e

fix: glide_api_version configuration was not honored

Unverified

This commit is not signed, but one or more authors requires that any commit attributed to them is signed.

Learn about vigilant mode

94ca0bc

fix: batch row adds in rest api

Unverified

This commit is not signed, but one or more authors requires that any commit attributed to them is signed.

Learn about vigilant mode

2fdcd4f

fix: update api host config to include protocol

Unverified

This commit is not signed, but one or more authors requires that any commit attributed to them is signed.

Learn about vigilant mode

24468cc

fix: serialize columns for prepare tables with kind

Unverified

This commit is not signed, but one or more authors requires that any commit attributed to them is signed.

Learn about vigilant mode

e24d8a6

fix: add option to ignore columns

Unverified

This commit is not signed, but one or more authors requires that any commit attributed to them is signed.

Learn about vigilant mode

7138915

chore: remove unused rows code

Unverified

This commit is not signed, but one or more authors requires that any commit attributed to them is signed.

Learn about vigilant mode

b044d2b

feat: snuggle rows in a batch

Unverified

This commit is not signed, but one or more authors requires that any commit attributed to them is signed.

Learn about vigilant mode

8de46e9

chore: cleanup logging

Unverified

This commit is not signed, but one or more authors requires that any commit attributed to them is signed.

Learn about vigilant mode

8a33201

feat: support multiple streams from source

Unverified

This commit is not signed, but one or more authors requires that any commit attributed to them is signed.

Learn about vigilant mode

17239a7

activescott and others added 16 commits February 17, 2025 12:48

docs: Readme update to help others dev-test locally

Unverified

This commit is not signed, but one or more authors requires that any commit attributed to them is signed.

Learn about vigilant mode

77bc93a

fix: updates the 'add rows' API request to support the new payload sh…

Unverified

This commit is not signed, but one or more authors requires that any commit attributed to them is signed.

Learn about vigilant mode

7c2e2ce

…ape + tests

fix: update to new api domain, remove API 'version' config

Unverified

This commit is not signed, but one or more authors requires that any commit attributed to them is signed.

Learn about vigilant mode

fff1f05

fix: updated the docker push script to optionally tag the pushed imag…

Unverified

This commit is not signed, but one or more authors requires that any commit attributed to them is signed.

Learn about vigilant mode

2edeb2a

…e as latest

chore: temporary script that is pushing to airbyte cloud. You'll need…

Unverified

This commit is not signed, but one or more authors requires that any commit attributed to them is signed.

Learn about vigilant mode

1441dca

… to modify the values

Update README to clarify setup steps

dc76b14

Fix doc comment

a46808d

Tidy a bit; no need to call create stash endpoint anymore

19551c2

Ignore columns that aren't in the schema

00a7e95

Simplify: encapsulate buffering into Glide client, don't bother with …

5a89e51

…state

Fix up tests

7c21f2c

push-docker-image: ignore "latest" tag

2e506c7

fix: this builds the AMD64 architecture image explicitly and pushes t…

Unverified

This commit is not signed, but one or more authors requires that any commit attributed to them is signed.

Learn about vigilant mode

40a730c

…o Airbyte's repo for suing it in Airbyte Cloud (#13)

fix: destination would fail when a source reported columns without an…

Unverified

This commit is not signed, but one or more authors requires that any commit attributed to them is signed.

Learn about vigilant mode

a965978

…y type (#14) fixes glideapps/glide#29913

Test for current 413 behavior

Loading
Loading status checks…

48251d9

schani force-pushed the feat/glide-destination branch from 2443d8c to 48251d9 Compare February 17, 2025 17:48

schani added 5 commits February 17, 2025 13:34

Split when 413 happens

Loading
Loading status checks…

a355d87

Test that the correct rows are posted

7914fe8

Test with different payload size thresholds

d6c7672

Use PUT for the stashes, not POST

77e2c17

Push to our docker registry

Loading
Loading status checks…

7ee5e69

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

WIP: feat/glide destination #2

WIP: feat/glide destination #2

activescott commented Jun 27, 2024 •

edited

Loading

WIP: feat/glide destination #2

Are you sure you want to change the base?

WIP: feat/glide destination #2

Conversation

activescott commented Jun 27, 2024 • edited Loading

activescott commented Jun 27, 2024 •

edited

Loading