Packaged Inference Server endpoint, with Huggingface Encoders, NLPs, etc!
This repository does not function, and is largely outdated. However, it is currently serving as a demo of error tracking.
For fast multi-cluster deployments.
MIT
-
Notifications
You must be signed in to change notification settings - Fork 0
Bundled inference server (drop in replacement) for huggingface, optimized for monitoring and now serving as an example for error tracking.
License
West-Computing-Club/Inference-Server-ET
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
Bundled inference server (drop in replacement) for huggingface, optimized for monitoring and now serving as an example for error tracking.