Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Basic Streaming and In-Memory Guard Support #30

Closed
wants to merge 48 commits into from
Closed

Basic Streaming and In-Memory Guard Support #30

wants to merge 48 commits into from

Conversation

CalebCourier
Copy link
Contributor

@CalebCourier CalebCourier commented May 6, 2024 •
edited
Loading

  • + Adds basic streaming support for guards
  • + Adds an In-Memory store for guards
  • + Adds config support for In-Memory guards
  • + Makes OTEL optional
  • + Makes Postgres optional
  • - Breaks /validation endpoints's custom telemetry (because of streaming)

CalebCourier and others added 26 commits April 15, 2024 16:16
@CalebCourier
start lite build
c25810c
@CalebCourier
litellm support
24867fa
@CalebCourier
streaming support
17fe0d7
@CalebCourier
update lock file
f58b0ca
@CalebCourier
add valid length validator
71f533e
@CalebCourier
register hub validators on startup
afbd0d7
@CalebCourier
send back new field for validated stream errors
5d20925
@CalebCourier
add some simple validators
0aff6b8
@CalebCourier
disable otel on streaming
fb4934c
@CalebCourier
custom installs for validators
c80914a
@CalebCourier
point competitor_check to frontend_demo branch
4c02184
@CalebCourier
turn off oss metrics
9798ac5
@CalebCourier
dont send tracer to guard
194b67e
@CalebCourier
no max request
792a7dd
@CalebCourier
remove all telemetry from validate
212f35d
@CalebCourier
try printing response status
af24df3
@CalebCourier
add many_shot_jailbreak to custom install
c06bde0
@zsimjee
add api-spec download to build scripts
60257bd
@CalebCourier
update jailbreak repo to clean
bada0a0
@CalebCourier
more limit removals
e1c46e7
@CalebCourier
log for every error
8b0c363
@CalebCourier
fix error handling
39525fe
@zsimjee
lite image changes
7203a60
@CalebCourier
lite build updates, default embed func
c275813
@zsimjee
Update how to run
bc12034
@CalebCourier
update guardrails branch
eb71536
@CalebCourier CalebCourier changed the base branch from lambda-to-fargate to main May 28, 2024 18:23
@CalebCourier
Copy link
Contributor Author

Only part of checks we're failing is test coverage. @zsimjee we should have @nichwch cover the GuardClient and MemoryGuardClient next week and punt the rest until the core schema impl (bc everything else is gonna change).

@CalebCourier CalebCourier requested review from nichwch and zsimjee May 31, 2024 18:28
zsimjee
zsimjee reviewed Jun 3, 2024
View reviewed changes
zsimjee
zsimjee reviewed Jun 3, 2024
View reviewed changes
@CalebCourier CalebCourier marked this pull request as ready for review June 5, 2024 13:26
@CalebCourier CalebCourier requested a review from zsimjee June 5, 2024 14:54
@CalebCourier CalebCourier mentioned this pull request Jun 6, 2024
Merged
1 task
@CalebCourier CalebCourier deleted the demo-lite-image branch June 7, 2024 14:17
@CalebCourier CalebCourier mentioned this pull request Jun 7, 2024
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@nichwch nichwch Awaiting requested review from nichwch

@zsimjee zsimjee Awaiting requested review from zsimjee

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@CalebCourier @zsimjee @nichwch