Cap coordinator prefill/encode legs to a single token per schema#2202

revit13 wants to merge 5 commits into

llm-d:mainllm-d/llm-d-router:mainfrom

revit13:tokens1revit13/llm-d-inference-scheduler:tokens1Copy head branch name to clipboard