Publishing to Meltano Hub

[amotl]

Hi there.

I think the project would be ready for publishing to Meltano Hub, and its sister project meltano-tap-cratedb as well. Of course, we would like to make our adapters check all the compliance boxes where possible. 🍀

The documentation looks good and straight-forward, we will work through it:

• https://hub.meltano.com/add-a-tap/
• https://hub.meltano.com/tap-target-maintenance/

@edgarrmondragon: Do you think we should jump straight to the Add Plugin step in meltano/hub/issues/new, or can you spot any obvious flaws that should be addressed first?

With kind regards,
Andreas.

[amotl]

We just went ahead and created the contribution requests. Of course, we will also be happy to submit patches to bring them in, and to save you typing work, but we will need to learn about it first.

• Add Plugin: meltano-target-cratedb meltano/hub#2232
• Add Plugin: meltano-tap-cratedb meltano/hub#2233

[amotl]

[...] need to learn about it first.

@edgarrmondragon: Is that a good and complete blueprint example how to do it properly?

• Added the rclone utility plugin meltano/hub#1855

[edgarrmondragon]

[...] need to learn about it first.

@edgarrmondragon: Is that a good and complete blueprint example how to do it properly?

* [Added the rclone utility plugin meltano/hub#1855](https://github.com/meltano/hub/pull/1855)

It's not documented I think, but you can clone the Hub repo and run:

uv run hub-utils add --repo-url https://github.com/crate/meltano-tap-cratedb

and it will get you 90% of the way there. The other 90% would be adding a logo and visually inspecting for typos, etc.

[amotl]

It's not documented I think, but you can clone the Hub repo and run [...] and it will get you 90% of the way there. The other 90% would be [...]

I see, thank you. It looks like you went the extra mile and staged a corresponding patch already.

• feat: Added tap-cratedb and target-cratedb meltano/hub#2235

Thanks a stack for providing a blueprint if the documentation is currently too thin. It saves us a ton of typing and possibly quite a share of guesswork, so it is much appreciated. 💯

We already did a quick review on the patch by adding some comments and will come back to this soon again, after verifying a "known good" state by possibly submitting a delta patch to yours right away: We will likely need to remove some options suitable for PostgreSQL which are not applicable to work with CrateDB due to driver and other differences.

[amotl]

Hi again. I didn't forget about making progress on the PR you had staged, but you know, c'est la vie: So much other stuff can come up any time. The most recent occurrance is a hiccup that indeed condensated on CrateDB's Meltano target adapter.

• SQL DDL for ARRAY inner type is wrong, trips import from tap-countries #93
• SQLParseException[The types of the columns within VALUES lists must match. Found text_array and object_array at position: 8] cratedb-examples#1541

I will certainly come back to wrap up the PR soon. Until then, please apologize any delays. 🙏

[edgarrmondragon]

I will certainly come back to wrap up the PR soon. Until then, please apologize any delays. 🙏

No worries, happy to help when you're ready