Repository navigation

[Transformers backend] Support EAGLE3 aux hidden states with pipeline parallelism and layer 0 - #66546

Merged

hmellor merged 13 commits into

vllm-project:mainfrom

hmellor:transformers-backend-aux-pp

Nov 9, 2026

Merged

[Transformers backend] Support EAGLE3 aux hidden states with pipeline parallelism and layer 0#66546
hmellor merged 13 commits into
vllm-project:mainfrom
hmellor:transformers-backend-aux-pp

Commits on Nov 8, 2026
- [Transformers backend] Support EAGLE3 aux hidden states with pipeline parallelism
  
  hmellor
  and
  claude
  committed
  aeced95
Commits on Nov 9, 2026
- Support aux hidden state layer 0 (moved from #66413)
  
  hmellor
  and
  claude
  committed
  8623288
- Use more prompts in the Eagle3 PP acceptance test
  
  hmellor
  and
  claude
  committed
  daf5f80
- Check aux layer 0 directly instead of caching it
  
  hmellor
  and
  claude
  committed
  67651da
- Use walrus for the combined aux hidden states
  
  hmellor
  and
  claude
  committed
  1055620
- Record aux layer 0 inside the compiled graph
  
  hmellor
  and
  claude
  committed
  2ec9dd4
- Only look up the input embedding for aux layer 0
  
  hmellor
  and
  claude
  committed
  e46d1be
- Clarify why the extraction draft resets model_impl
  
  hmellor
  and
  claude
  committed
  e0b777d
- Halve the Eagle3 PP test prompts
  
  hmellor
  and
  claude
  committed
  4b4321d
- Merge remote-tracking branch 'upstream/main' into transformers-backend-aux-pp
  hmellor
  committed
  45bde67
- Merge branch 'main' into transformers-backend-aux-pp
  vllm-agent
  authored
  df5b5f6
- Set end_layer for the centralized aux hidden state relay
  
  hmellor
  and
  claude
  committed
  ee9d7b2
- Merge remote-tracking branch 'origin/transformers-backend-aux-pp' into transformers-backend-aux-pp
  hmellor
  committed
  21d399c