Search results

[Feature]: Enable support for Sliding Window Attention

vllm-spyre-nextRelated to enabling the next-generation of the Spyre stack built on top of torch-spyreRelated to enabling the next-generation of the Spyre stack built on top of torch-spyre

Status: Open.

#193 In torch-spyre/spyre-inference;

· bohnstingl opened on May 12, 2026

[Epic]: Implement support for Mixture-of-Expert models

EPICParent issuesParent issues

vllm-spyre-nextRelated to enabling the next-generation of the Spyre stack built on top of torch-spyreRelated to enabling the next-generation of the Spyre stack built on top of torch-spyre

Status: Open.

EPIC

#192 In torch-spyre/spyre-inference;

· bohnstingl opened on May 12, 2026

[CI] Add type checks

vllm-spyre-nextRelated to enabling the next-generation of the Spyre stack built on top of torch-spyreRelated to enabling the next-generation of the Spyre stack built on top of torch-spyre

Status: Open.

#191 In torch-spyre/spyre-inference;

· joerunde opened on May 12, 2026

[FEATURE] Rework ParallelLMHead layer as a PluggableLayer

vllm-spyre-nextRelated to enabling the next-generation of the Spyre stack built on top of torch-spyreRelated to enabling the next-generation of the Spyre stack built on top of torch-spyre

Status: Open.

#182 In torch-spyre/spyre-inference;

· bohnstingl opened on May 8, 2026

Implement Spyre "graph recorder"

May2026

vllm-spyre-attention-backend

vllm-spyre-nextRelated to enabling the next-generation of the Spyre stack built on top of torch-spyreRelated to enabling the next-generation of the Spyre stack built on top of torch-spyre

Status: Open.

#174 In torch-spyre/spyre-inference;

· bringlein opened on May 6, 2026

[DOCU] Revisit debug prints in CustomOps

vllm-spyre-nextRelated to enabling the next-generation of the Spyre stack built on top of torch-spyreRelated to enabling the next-generation of the Spyre stack built on top of torch-spyre

Status: Open.

#172 In torch-spyre/spyre-inference;

· bohnstingl opened on May 6, 2026

[FEATURE] Rework RoPE layer to compute sin/cos caches on spyre

vllm-spyre-nextRelated to enabling the next-generation of the Spyre stack built on top of torch-spyreRelated to enabling the next-generation of the Spyre stack built on top of torch-spyre

Status: Open.

#167 In torch-spyre/spyre-inference;

· bohnstingl opened on May 6, 2026

[FEATURE] Cleanup SiluAndMul operation

vllm-spyre-nextRelated to enabling the next-generation of the Spyre stack built on top of torch-spyreRelated to enabling the next-generation of the Spyre stack built on top of torch-spyre

Status: Open.

#166 In torch-spyre/spyre-inference;

· bohnstingl opened on May 6, 2026

[FEATURE] Version bump to vllm 0.20.1

vllm-spyre-nextRelated to enabling the next-generation of the Spyre stack built on top of torch-spyreRelated to enabling the next-generation of the Spyre stack built on top of torch-spyre

Status: Open.

#165 In torch-spyre/spyre-inference;

· bohnstingl opened on May 6, 2026

verify online softmax is supported now

vllm-spyre-attention-backend

vllm-spyre-nextRelated to enabling the next-generation of the Spyre stack built on top of torch-spyreRelated to enabling the next-generation of the Spyre stack built on top of torch-spyre

Status: Open.

#152 In torch-spyre/spyre-inference;

· bringlein opened on Apr 30, 2026

Update custom ops for TP>1 compatibility

EPICParent issuesParent issues

vllm-spyre-attention-backend

vllm-spyre-nextRelated to enabling the next-generation of the Spyre stack built on top of torch-spyreRelated to enabling the next-generation of the Spyre stack built on top of torch-spyre

Status: Open.

Task

#138 In torch-spyre/spyre-inference;

· dilipgb opened on Apr 27, 2026

Implement distributed process groups in worker to support tp>1

vllm-spyre-attention-backend

vllm-spyre-nextRelated to enabling the next-generation of the Spyre stack built on top of torch-spyreRelated to enabling the next-generation of the Spyre stack built on top of torch-spyre

Status: Open.

Task

#137 In torch-spyre/spyre-inference;

· dilipgb opened on Apr 27, 2026