Code

[do-not-merge] Ibm dev rebuild#254

Code

Open

fialhocoelho wants to merge 42 commits intomainopendatahub-io/vllm:mainfrom ibm-dev-rebuildopendatahub-io/vllm:ibm-dev-rebuildCopy head branch name to clipboard

+8,413-3,794

Commits

Commits on Nov 15, 2024

• [Docs] Add Nebius as sponsors (vllm-project#10371)

  Show description for c76ac49
  simon-mo

  authored
  c76ac49

• [Frontend] Add --version flag to CLI (vllm-project#10369)

  Show description for a067f85
  russellb

  authored
  a067f85

• [Doc] Move PR template content to docs (vllm-project#10159)

  Show description for 3e8d14d
  russellb

  authored
  3e8d14d

• [Docs] Misc updates to TPU installation instructions (vllm-project#10165)

  mikegre-google

  authored
  4f168f6

Commits on Nov 16, 2024

• [Frontend] Automatic detection of chat content format from AST (vllm-project#9919)

  Show description for 32e46e0
  DarkLight1337

  authored
  32e46e0

• [doc] add doc for the plugin system (vllm-project#10372)

  Show description for 755b853
  youkaichao

  authored
  755b853

• [misc][plugin] improve log messages (vllm-project#10386)

  Show description for 2f427c2
  youkaichao

  authored
  2f427c2

• [BugFix] [Kernel] Fix GPU SEGV occuring in fused_moe kernel (vllm-project#10385)

  Show description for 1d75472
  rasmith

  authored
  1d75472

• [Misc] Update benchmark to support image_url file or http (vllm-project#10287)

  Show description for 8b6725b
  kakao-steve-ai

  authored
  8b6725b

• [Misc] Medusa supports custom bias (vllm-project#10361)

  skylee-01

  authored
  b98d89e

• [Bugfix] Fix M-RoPE position calculation when chunked prefill is enabled (vllm-project#10388)

  Show description for 361c29e
  imkero

  authored
  361c29e

• [V1] Add code owners for V1 (vllm-project#10397)

  Show description for 661a34f
  WoosukKwon

  authored
  661a34f

Commits on Nov 17, 2024

• [2/N][torch.compile] make compilation cfg part of vllm cfg (vllm-project#10383)

  Show description for 4fd9375
  youkaichao

  authored
  4fd9375

• [V1] Refactor model executable interface for all text-only language models (vllm-project#10374)

  Show description for 643ecf7
  ywang96

  authored
  643ecf7

• [CI/Build] Fix IDC hpu [Device not found] issue (vllm-project#10384)

  Show description for 905d0f0
  xuechendi

  authored
  905d0f0

• [Bugfix][CPU] Fix CPU embedding runner with tensor parallel (vllm-project#10394)

  Show description for cf349c4
  Isotr0py

  authored
  cf349c4

• [platforms] refactor cpu code (vllm-project#10402)

  Show description for 8d74b5a
  youkaichao

  authored
  8d74b5a

• [Hardware] [HPU]add mark_step for hpu (vllm-project#10239)

  Show description for 76aab90
  jikunshang

  authored
  76aab90

• [Bugfix] Fix mrope_position_delta in non-last prefill chunk (vllm-project#10403)

  Show description for 80d85c5
  imkero

  authored
  80d85c5

• [Misc] Enhance offline_inference to support user-configurable paramet… (vllm-project#10392)

  Show description for d1557e6
  wchen61

  authored
  d1557e6

Commits on Nov 18, 2024

• [Misc] Add uninitialized params tracking for AutoWeightsLoader (vllm-project#10327)

  Show description for c4e4643
  Isotr0py

  authored
  c4e4643

• [Bugfix] Ignore ray reinit error when current platform is ROCm or XPU (vllm-project#10375)

  Show description for 47826ca
  HollowMan6

  authored
  47826ca

• [4/N][torch.compile] clean up set_torch_compile_backend (vllm-project#10401)

  Show description for 51bb12d
  youkaichao

  authored
  51bb12d

• [VLM] Report multi_modal_placeholders in output (vllm-project#10407)

  Show description for c7dec92
  lk-chen

  authored
  c7dec92

• [Model] Remove redundant softmax when using PoolingType.STEP (vllm-project#10415)

  Maybewuss

  authored
  01aae1c

• [Model][LoRA]LoRA support added for glm-4v (vllm-project#10418)

  Show description for 5be4e52
  B-201

  authored
  5be4e52

• [Model] Remove transformers attention porting in VITs (vllm-project#10414)

  Show description for e7ebb66
  Isotr0py

  authored
  e7ebb66

• [Doc] Update doc for LoRA support in GLM-4V (vllm-project#10425)

  Show description for 4186be8
  B-201

  authored
  4186be8

• [5/N][torch.compile] torch.jit.script --> torch.compile (vllm-project#10406)

  Show description for 7851b45
  youkaichao

  authored
  7851b45

• [Doc] Add documentation for Structured Outputs (vllm-project#9943)

  Show description for 31894a2
  ismael-dm

  authored
  31894a2

• Fix open_collective value in FUNDING.yml (vllm-project#10426)

  Show description for 4f686d1
  andrew

  authored
  4f686d1

• [Model][Bugfix] Support TP for PixtralHF ViT (vllm-project#10405)

  Show description for 281cc4b
  mgoin

  authored
  281cc4b

• [Hardware][XPU] AWQ/GPTQ support for xpu backend (vllm-project#10107)

  Show description for 6b2d25e
  yma11

  authored
  6b2d25e

• [Kernel] Explicitly specify other value in tl.load calls (vllm-project#9014)

  Show description for c2170a5
  angusYuhao

  authored
  c2170a5

• [Kernel] Initial Machete W4A8 support + Refactors (vllm-project#9855)

  Show description for 96d999f
  LucasWilkinson

  authored
  96d999f

• Merge branch 'main' of https://github.com/vllm-project/vllm into ibm-20241118

  Show description for 3444895
  fialhocoelho

  committed
  3444895

• Squash 9522

  Show description for e58ac91
  fialhocoelho

  committed
  e58ac91

• Squash 6357

  Show description for 9223ac3
  fialhocoelho

  committed
  9223ac3

• Squash 10235

  Show description for b715908
  fialhocoelho

  committed
  b715908

• Squash 10400

  Show description for 6aa7422
  fialhocoelho

  committed
  6aa7422

• Squash 10430

  Show description for 565cfcc
  fialhocoelho

  committed
  565cfcc

Commits on Nov 23, 2024

• pin mistral and install adapter from branch 🚀

  Show description for 049cf55
  fialhocoelho

  committed
  049cf55