Skip to content

gpt_server v0.3.4

Compare
Choose a tag to compare
@shell-nlp shell-nlp released this 18 Nov 15:01
· 43 commits to main since this release

gpt_server v0.3.4

What's Changed

  1. 实现了guided_decoding response_format #17
  2. 修复了glm4模型推理异常 #21
  3. 升级vllm==0.6.4.post1