Skip to content

0.3.2 Timeout support

Latest
Latest
Compare
Choose a tag to compare
@viktor-ferenczi viktor-ferenczi released this 28 Feb 01:41
0.3.2
eb0e58e
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.
  • SamplingParams to match vLLM 0.3.2
  • Timeout support in Python API
  • Custom HttpClient (with timeout) support in C# API
  • The tests to use the VLLM_BASE_URL environment variable
  • More Python tests
Assets 4
Loading