-
Notifications
You must be signed in to change notification settings - Fork 118
[bifrost] Get a CommitToken back from notify_committed()
#3968
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
238e9a8 to
4d03d85
Compare
bcf7715 to
eacea80
Compare
7ed1a07 to
45a2b31
Compare
AhmedSoliman
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I like this one better. Thanks for making the API more uniform.
tillrohrmann
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM :-)
| /// Not cancellation safe. Every call will attempt to acquire capacity on the channel and send | ||
| /// a new message to the appender. | ||
| pub async fn notify_committed(&self) -> Result<(), EnqueueError<()>> { | ||
| pub async fn notify_committed(&self) -> Result<CommitToken, EnqueueError<()>> { |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Maybe update the docs to reflect the new contract.
03cf056 to
eeb457f
Compare
9780007 to
19f4b7a
Compare
- `ingestion-client` implements the runtime layer that receives WAL envelopes, fans it out to the correct partition, and tracks completion. It exposes: - `IngestionClient`, enforces inflight budgets, and resolves partition IDs before sending work downstream. - The session subsystem that batches `IngestRecords`, retries connections, and reports commit status to callers. - `ingestion-client` only ingests records and notify the caller once the record is "committed" to bifrost by the PP. This makes it useful to implement kafka ingress and other external ingestion
[bifrost] Get a
CommitTokenback from notify_committed()Stack created with Sapling. Best reviewed with ReviewStack.
Shuffler#4024IngestionClientfor invocation and state mgmt #3980ingestion-client#3975IngestRequestmessage #3974CommitTokenback from notify_committed() #3968ingestion-clientcrate #3976