Skip to content

Conversation

Smelton01
Copy link
Contributor

Issue #, if available: #575

Description of changes: Add support for otfMetadata in Kinesis firehose response metadata for Iceberg routing

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

There are a couple of other PRs open regarding this but there has been not activity for a while.
This is a relatively simple change that is preventing us from properly using the Iceberg integration with the firehose transformation and from my testing, the transformation still works as expected with/without the OTF metadata provided.

@Smelton01 Smelton01 force-pushed the support-otf-metadata branch from 2177d5c to 5ec6ac4 Compare September 2, 2025 11:03

// Constants used for otf operation for the record
const (
KinesisFirehoseOTFOperationInsert = "insert"
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Expected type KinesisFirehoseOTFOperation string, like is done elsewhere for similar enum-likes in other events

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@bmoffatt
Thank you for the feedback Updated

@Smelton01 Smelton01 requested a review from bmoffatt October 6, 2025 05:10
Copy link
Collaborator

@bmoffatt bmoffatt left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants