Popular repositories Loading

1. llm-d llm-d Public

   Forked from llm-d/llm-d

   Achieve state of the art inference performance with modern accelerators on Kubernetes

   Shell

2. gpu-pruner gpu-pruner Public

   Forked from neuralmagic/gpu-pruner

   Non-destructive GPU based idle-culler for RHOAI/Kubeflow workloads

   Rust

3. inference-simulator-rs inference-simulator-rs Public

   Forked from neuralmagic/vllm-vcr

   Rust

4. llm-d-latency-predictor llm-d-latency-predictor Public

   Forked from llm-d/llm-d-latency-predictor

   Latency prediction service for ML-model based scoring with llm-d-inference-scheduler

   Python