Skip to content

Releases: shell-nlp/gpt_server

gpt_server v0.7.2

28 Feb 13:28

Choose a tag to compare

gpt_server v0.7.2

What's Changed

  1. 升级 vllm==0.16.0 sglang==0.5.9
  2. 重构架构

gpt_server v0.7.0

01 Feb 15:33

Choose a tag to compare

gpt_server v0.7.0

What's Changed

  1. 升级 vllm==0.15.0 lmdeploy==0.11.1 sglang==0.5.8
  2. 修改了 vllm 后端的架构

gpt_server v0.6.10

10 Jan 12:16

Choose a tag to compare

gpt_server v0.6.10

What's Changed

  1. 升级 vllm==0.13.0 lmdeploy==0.11.1 sglang==0.5.7

gpt_server v0.6.9

19 Dec 01:31

Choose a tag to compare

gpt_server v0.6.9

What's Changed

  1. 升级 vllm==0.13.0 lmdeploy==0.11.0 sglang==0.5.6.post2

gpt_server v0.6.8.1

30 Nov 15:18

Choose a tag to compare

gpt_server v0.6.8.1

What's Changed

  1. 支持 jinaai/jina-reranker-v3 模型
  2. 支持 z-image 文生图模型

gpt_server v0.6.7

07 Nov 10:04

Choose a tag to compare

gpt_server v0.6.7

What's Changed

1.修复tool_prarser index 为None
2.升级 sglang==0.5.5
3.支持 lmcache,后端默认开启 进一步提高长上下文推理的吞吐量

gpt_server v0.6.6

29 Oct 05:00

Choose a tag to compare

gpt_server v0.6.6

What's Changed

  1. 支持qwen-image #44
  2. 升级 lmdeploy==0.10.2 sglang==0.5.4
  3. 支持 qwen3-ranker vllm 后端
  4. 支持 Response API

gpt_server v0.6.5

13 Oct 05:36

Choose a tag to compare

gpt_server v0.6.5

What's Changed

  • 更新 vllm==0.11.0 sglang==0.5.3.post1

gpt_server v0.6.4

23 Sep 13:45

Choose a tag to compare

gpt_server v0.6.4

What's Changed

  • 更新lmdeoploy == 0.10.0 vllm==0.10.2 sglang==0.5.2

gpt_server v0.6.3

19 Sep 02:08

Choose a tag to compare

gpt_server v0.6.3

What's Changed

  1. vllm 多模态 支持 enable_thinking
  2. 优化lmdepoly 后端 logger prompt
  3. 更新lmdeoploy == 0.10.0
  4. 优化项目架构
  5. 添加 autoawq
  6. 优化项目冗余代码
  7. 删除遗留代码