All issues

Search results

server: uncaught exception in extract_cache kills the generation thread while the HTTP listener keeps accepting — all subsequent requests hang forever with no error

Status: Open.

#1909 In ml-explore/mlx-lm;

· lumatic2 opened on Sep 21, 2026

[BUG] GraniteMoeHybrid drops cache lengths when calling ssm_update.

Status: Open.

#1908 In ml-explore/mlx-lm;

· kvcache670 opened on Sep 21, 2026

qwen3_coder tool parser returns raw string for parameters whose schema has no top-level "type" (oneOf/anyOf)

Status: Open.

#1907 In ml-explore/mlx-lm;

· petriematt opened on Sep 21, 2026

[BUG] MiniCPM3 batch generation ignores the left-padding mask

Status: Open.

#1906 In ml-explore/mlx-lm;

· kvcache670 opened on Sep 21, 2026

Missing general Knowledge Distillation paradigm

Status: Open.

#1900 In ml-explore/mlx-lm;

· diogomsmiranda opened on Sep 17, 2026

Can we add support for deepseek v4.1?

Status: Open.

#1894 In ml-explore/mlx-lm;

· Teejer opened on Sep 16, 2026

mlx_lm.server: option to restrict which models a request may load (allow-list)

Status: Open.

#1892 In ml-explore/mlx-lm;

· mrcushen-arch opened on Sep 15, 2026

RuntimeError: There is no Stream(gpu, 3) in current thread at KVCache __del__ teardown

Status: Open.

#1888 In ml-explore/mlx-lm;

· dahai80 opened on Sep 14, 2026

MiniCPM5-1B-MLX tool calling not supported by mlx_lm.server

Status: Open.

#1885 In ml-explore/mlx-lm;

· sameerjvn opened on Sep 13, 2026

phimoe.py subscripts rope_scaling unconditionally, so Phi-mini-MoE-instruct dies with a bare TypeError

Status: Open.

#1884 In ml-explore/mlx-lm;

· hijohnnylin opened on Sep 13, 2026

Lfm2MoeSparseMoeBlock routing diverges from HF: softmax instead of sigmoid, expert_bias in the weights, and routed_scaling_factor dropped

Status: Open.

#1883 In ml-explore/mlx-lm;

· hijohnnylin opened on Sep 13, 2026

Support for k2_horizon Request.

Status: Open.

#1876 In ml-explore/mlx-lm;

· Geramy opened on Sep 10, 2026