Pinned Loading

1. gpustack/gpustack gpustack/gpustack Public

   Simple, scalable AI model deployment on GPU clusters

   Python 3.7k 371

2. ggml-org/llama.cpp ggml-org/llama.cpp Public

   LLM inference in C/C++

   C++ 86.2k 13k

3. llama-box llama-box Public

   Forked from gpustack/llama-box

   LLM inference server implementation based on llama.cpp.

   C++

4. vllm-project/vllm-ascend vllm-project/vllm-ascend Public

   Community maintained hardware plugin for vLLM on Ascend

   Python 1.1k 414