🎯
Focusing
AI Infra & agent systems. Contributor to LMCache, GPTQModel, Flide. Researching next-generation agents and AI infrastructure.
Pinned Loading
-
LMCache
LMCache PublicForked from LMCache/LMCache
LMCache: Supercharge Your LLM with the Fastest KV Cache Layer
Python
-
GPTQModel
GPTQModel PublicForked from ModelCloud/GPTQModel
LLM model quantization (compression) toolkit with HW acceleration support for Nvidia, AMD, Intel GPU and Intel/AMD/Apple CPU via HF, vLLM, and SGLang.
Python
-
Flide
Flide PublicForked from OmniJev/Flide
🔥🔥 The extremely fast inference engine for decision model
Python
-
kvcached
kvcached PublicForked from ovg-project/kvcached
Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond
Python
Something went wrong, please refresh the page to try again.
If the problem persists, check the GitHub status page or contact support.
If the problem persists, check the GitHub status page or contact support.


