Skip to content

Rate Limiting #821

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Draft
riturajFi wants to merge 36 commits into
base: main
Choose a base branch
from
Draft

Rate Limiting #821

riturajFi wants to merge 36 commits into from

Conversation

@riturajFi
Copy link

@riturajFi riturajFi commented Nov 28, 2025 •
edited
Loading

Solves #655

@changeset-bot
Copy link

changeset-bot bot commented Nov 28, 2025 •
edited
Loading

⚠️ No Changeset found

Latest commit: 50329da

Merging this PR will not cause a version bump for any packages. If these changes should not result in a new version, you're good to go. If these changes should result in a version bump, you need to add a changeset.

This PR includes no changesets

When changesets are added to this PR, you'll see the packages that this PR includes changesets for and the associated semver types

Click here to learn what changesets are, and how to add one.

Click here if you're a maintainer who wants to add a changeset to this PR

@riturajFi riturajFi marked this pull request as draft November 28, 2025 13:13
@riturajFi riturajFi changed the title chore: initial commit Rate Limiting Nov 28, 2025
@riturajFi riturajFi force-pushed the feat/rate_limit_backoff_strategy_for_ai_agents branch from 352683b to 54adb83 Compare November 29, 2025 08:20
@riturajFi riturajFi force-pushed the feat/rate_limit_backoff_strategy_for_ai_agents branch 2 times, most recently from fcc9afb to 947a32a Compare December 14, 2025 09:14
@riturajFi riturajFi force-pushed the feat/rate_limit_backoff_strategy_for_ai_agents branch from 9cce46e to 440b577 Compare December 22, 2025 20:26
@riturajFi
feat: rate limit v1
96e17a2
@riturajFi
feat: introduced RPM
cf6846e
@riturajFi
feat: normalize rate limits
1624c01
@riturajFi
feat: circuit breaker v1 + simple fallback
17fe442
@riturajFi
feat: priority queue
229e48f
@riturajFi
feat: tenant id
72fc58a
@riturajFi
feat: minor fix
3e51775
@riturajFi
feat: final v0
1ee6657
@riturajFi
feat: final v0
aa53fd5
@riturajFi
feat: refactotr
e978053
@riturajFi
feat: refactotr
ecf14a0
@riturajFi
feat: retry after header
32276d7
@riturajFi
feat: added timeout to ckt breaker
006f1a0
@riturajFi
feat: tenant based ckt breaker
bee794e
@riturajFi
feat: token bucket rate limit strategy
3b0f14d
@riturajFi
fix: make sure the system updates rate limits and failures for the co…
97c3c0d 
…rrect model/tenant/provider
@riturajFi
fix: hadnle stream failure
df8833b
@riturajFi
feat: search headers
9f4e169
@riturajFi
feat: tokens + requests per minute enforcement
70458f6
@riturajFi
fix: rate limit mapping config
9db0481
@riturajFi
fix: error policy
f4cbdcb
@riturajFi
fix: circuit‑breaker probe, task‑aware fallback policy selection, and…
f8249f9 
… cross‑provider fallback target
@riturajFi
fix: strict queue wait limits
2175517
@riturajFi riturajFi force-pushed the feat/rate_limit_backoff_strategy_for_ai_agents branch from bc670ea to 726487a Compare December 25, 2025 15:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@riturajFi