Popular repositories Loading

1. llama-balancer llama-balancer Public

   simple implements llama.cpp/llama-server load balancer

   Python 1

2. ggml ggml Public

   Forked from ggml-org/ggml

   Tensor library for machine learning

   C++

3. llama-swap llama-swap Public

   Forked from mostlygeek/llama-swap

   Model swapping for llama.cpp (or any local OpenAI API compatible server)

   Go

4. potable-cmd potable-cmd Public

   potable-cmd.bat is a batch file that automatically downloads and sets up various development tools (Git, CMake, Python, CUDA, Vulkan, etc.) in a portable manner for Windows environments.

   Batchfile

5. llama.cpp llama.cpp Public

   Forked from ggml-org/llama.cpp

   LLM inference in C/C++

   C++