Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[do-not-merge] Ibm 20241118 #236

Closed
wants to merge 462 commits into from
Closed

[do-not-merge] Ibm 20241118 #236

wants to merge 462 commits into from

Conversation

fialhocoelho
Copy link

To generate image

jeejeelee and others added 30 commits November 4, 2024 03:36
@jeejeelee
[Bugfix] Fix MiniCPMV and Mllama BNB bug (vllm-project#9917)
c49f040 
Signed-off-by: Jee Jee Li <[email protected]>
@gshtras
[Bugfix]Using the correct type hints (vllm-project#9885)
b67feb1 
Signed-off-by: Gregory Shtrasberg <[email protected]>
@zhengy001
[Misc] Compute query_start_loc/seq_start_loc on CPU (vllm-project#9447)
4dbcbbe 
Co-authored-by: Yang Zheng(SW)(Alex) <[email protected]>
@daitran2k1
[Bugfix] Fix E2EL mean and median stats (vllm-project#9984)
ea4aded 
Signed-off-by: daitran2k1 <[email protected]>
@MengqingCao
[Bugfix][OpenVINO] Fix circular reference vllm-project#9939 (vllm-pro…
ccb5376 
…ject#9974)

Signed-off-by: MengqingCao <[email protected]>
@chaunceyjiang
[Frontend] Multi-Modality Support for Loading Local Image Files (vllm…
ac6b8f1 
…-project#9915)

Signed-off-by: chaunceyjiang <[email protected]>
@youkaichao
[4/N] make quant config first-class citizen (vllm-project#9978)
8d72bb2 
Signed-off-by: youkaichao <[email protected]>
@jeejeelee
[Misc]Reduce BNB static variable (vllm-project#9987)
fb2716d 
Signed-off-by: Jee Jee Li <[email protected]>
@mzusman
[Model] factoring out MambaMixer out of Jamba (vllm-project#8993)
603a661 
Signed-off-by: mzusman <[email protected]>
@robertgshaw2-neuralmagic
[CI] Basic Integration Test For TPU (vllm-project#9968)
1c45f4c 
Signed-off-by: Robert Shaw <[email protected]>
@hissu-hyvarinen
[Bugfix][CI/Build][Hardware][AMD] Shard ID parameters in AMD tests ru…
5208dc7 
…nning parallel jobs (vllm-project#9279)

Signed-off-by: Hissu Hyvarinen <[email protected]>
@ywang96
[Doc] Update VLM doc about loading from local files (vllm-project#9999)
6e056bc 
Signed-off-by: Roger Wang <[email protected]>
@robertgshaw2-neuralmagic
[Bugfix] Fix MQLLMEngine hanging (vllm-project#9973)
04cef2c 
Signed-off-by: [email protected] <[email protected]>
@lk-chen
[Misc] Refactor benchmark_throughput.py (vllm-project#9779)
9a5664d 
Signed-off-by: Linkun Chen <[email protected]>
Co-authored-by: Linkun Chen <[email protected]>
Co-authored-by: Linkun Chen <[email protected]>
@tomeras91
[Frontend] Add max_tokens prometheus metric (vllm-project#9881)
ac04a97 
Signed-off-by: Tomer Asida <[email protected]>
@bnellnm
[Bugfix] Upgrade to pytorch 2.5.1 (vllm-project#10001)
d93478b 
Signed-off-by: Bill Nell <[email protected]>
@youkaichao
[4.5/N] bugfix for quant config in speculative decode (vllm-project#1…
2094062 
…0007)

Signed-off-by: youkaichao <[email protected]>
@mgoin
[Bugfix] Respect modules_to_not_convert within awq_marlin (vllm-proje…
8f0a9ca 
…ct#9895)

Signed-off-by: mgoin <[email protected]>
@tlrmchlsmth
[Core] Use os.sched_yield in ShmRingBuffer instead of time.sleep (vll…
04bbf38 
…m-project#9994)

Signed-off-by: Tyler Michael Smith <[email protected]>
@DarkLight1337
[Core] Make encoder-decoder inputs a nested structure to be more comp…
bbc3619 
…osable (vllm-project#9604)

Signed-off-by: DarkLight1337 <[email protected]>
@tlrmchlsmth
[Bugfix] Fixup Mamba (vllm-project#10004)
ad23318 
Signed-off-by: Tyler Michael Smith <[email protected]>
@GeneDer
[BugFix] Lazy import ray (vllm-project#10021)
7a83b1a
@chaunceyjiang
[Misc] vllm CLI flags should be ordered for better user readability (v…
93dee88 
…llm-project#10017)

Signed-off-by: chaunceyjiang <[email protected]>
@russellb
[Frontend] Fix tcp port reservation for api server (vllm-project#10012)
5952d81 
Signed-off-by: Russell Bryant <[email protected]>
@richardsliu
Refactor TPU requirements file and pin build dependencies (vllm-proje…
cd34029 
…ct#10010)

Signed-off-by: Richard Liu <[email protected]>
@yangalan123 @youkaichao
[Misc] Add logging for CUDA memory (vllm-project#10027)
09d3550 
Signed-off-by: Chenghao Yang <[email protected]>
Signed-off-by: youkaichao <[email protected]>
Co-authored-by: Chenghao Yang <[email protected]>
Co-authored-by: youkaichao <[email protected]>
@russellb
[CI/Build] Limit github CI jobs based on files changed (vllm-project#…
731aec5 
…9928)

Signed-off-by: Russell Bryant <[email protected]>
@mgoin
[Model] Support quantization of PixtralHFTransformer for PixtralHF (v…
a53046b 
…llm-project#9921)

Signed-off-by: mgoin <[email protected]>
@lk-chen
[Feature] Update benchmark_throughput.py to support image input (vllm…
d2e8033 
…-project#9851)

Signed-off-by: Linkun Chen <[email protected]>
Co-authored-by: Linkun Chen <[email protected]>
@jeejeelee
[Misc] Modify BNB parameter name (vllm-project#9997)
b9c64c0 
Signed-off-by: Jee Jee Li <[email protected]>
youkaichao and others added 20 commits November 17, 2024 23:57
@youkaichao
[4/N][torch.compile] clean up set_torch_compile_backend (vllm-project…
51bb12d 
…#10401)

Signed-off-by: youkaichao <[email protected]>
@lk-chen
[VLM] Report multi_modal_placeholders in output (vllm-project#10407)
c7dec92 
Signed-off-by: Linkun Chen <[email protected]>
@Maybewuss
[Model] Remove redundant softmax when using PoolingType.STEP (vllm-pr…
01aae1c 
…oject#10415)
@B-201
[Model][LoRA]LoRA support added for glm-4v (vllm-project#10418)
5be4e52 
Signed-off-by: B-201 <[email protected]>
@Isotr0py
[Model] Remove transformers attention porting in VITs (vllm-project#1…
e7ebb66 
…0414)

Signed-off-by: Isotr0py <[email protected]>
@B-201
[Doc] Update doc for LoRA support in GLM-4V (vllm-project#10425)
4186be8 
Signed-off-by: B-201 <[email protected]>
@youkaichao
[5/N][torch.compile] torch.jit.script --> torch.compile (vllm-project…
7851b45 
…#10406)

Signed-off-by: youkaichao <[email protected]>
@ismael-dm
[Doc] Add documentation for Structured Outputs (vllm-project#9943)
31894a2 
Signed-off-by: ismael-dm <[email protected]>
@andrew
Fix open_collective value in FUNDING.yml (vllm-project#10426)
4f686d1 
Signed-off-by: Andrew Nesbitt <[email protected]>
@mgoin
[Model][Bugfix] Support TP for PixtralHF ViT (vllm-project#10405)
281cc4b 
Signed-off-by: mgoin <[email protected]>
@yma11
[Hardware][XPU] AWQ/GPTQ support for xpu backend (vllm-project#10107)
6b2d25e 
Signed-off-by: yan ma <[email protected]>
@angusYuhao
[Kernel] Explicitly specify other value in tl.load calls (vllm-projec…
c2170a5 
…t#9014)

Signed-off-by: Angus Wang <[email protected]>
@LucasWilkinson
[Kernel] Initial Machete W4A8 support + Refactors (vllm-project#9855)
96d999f 
Signed-off-by: Lucas Wilkinson <[email protected]>
@fialhocoelho
Merge branch 'main' of https://github.com/vllm-project/vllm into ibm-…
3444895 
…20241118

Signed-off-by: Jefferson Fialho <[email protected]>
@fialhocoelho
Squash 9522
e58ac91 
Signed-off-by: Jefferson Fialho <[email protected]>
@fialhocoelho
Squash 6357
9223ac3 
Signed-off-by: Jefferson Fialho <[email protected]>
@fialhocoelho
Squash 10235
b715908 
Signed-off-by: Jefferson Fialho <[email protected]>
@fialhocoelho
Squash 10400
6aa7422 
Signed-off-by: Jefferson Fialho <[email protected]>
@fialhocoelho
Squash 10430
565cfcc 
Signed-off-by: Jefferson Fialho <[email protected]>
@fialhocoelho
pin mistral and using just pip in adapter install 🚀
550ccf4 
Signed-off-by: Jefferson Fialho <[email protected]>
@fialhocoelho fialhocoelho requested a review from njhill as a code owner November 20, 2024 12:12
@openshift-ci OpenShift CI
Copy link

openshift-ci bot commented Nov 20, 2024

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: fialhocoelho
Once this PR has been reviewed and has the lgtm label, please assign tarukumar for approval. For more information see the Kubernetes Code Review Process.

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@openshift-ci OpenShift CI
Copy link

openshift-ci bot commented Nov 21, 2024

@fialhocoelho: The following tests failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name Commit Details Required Rerun command
ci/prow/cuda-pr-image-mirror dcb1f69 link true /test cuda-pr-image-mirror
ci/prow/smoke-test dcb1f69 link true /test smoke-test
ci/prow/rocm-pr-image-mirror dcb1f69 link true /test rocm-pr-image-mirror
ci/prow/images dcb1f69 link true /test images

Full PR test history. Your PR dashboard.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@njhill njhill Awaiting requested review from njhill njhill is a code owner

@dtrifiro dtrifiro Awaiting requested review from dtrifiro

@RH-steve-grubb RH-steve-grubb Awaiting requested review from RH-steve-grubb

Assignees
No one assigned
Labels
do-not-merge/hold
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.