Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[do-not-merge] IBM 20241121 #237

Closed
wants to merge 463 commits into from
Closed

[do-not-merge] IBM 20241121 #237

wants to merge 463 commits into from

Conversation

fialhocoelho
Copy link

PR to trigger image

gshtras and others added 30 commits November 4, 2024 06:19
@gshtras
[Bugfix]Using the correct type hints (vllm-project#9885)
b67feb1 
Signed-off-by: Gregory Shtrasberg <[email protected]>
@zhengy001
[Misc] Compute query_start_loc/seq_start_loc on CPU (vllm-project#9447)
4dbcbbe 
Co-authored-by: Yang Zheng(SW)(Alex) <[email protected]>
@daitran2k1
[Bugfix] Fix E2EL mean and median stats (vllm-project#9984)
ea4aded 
Signed-off-by: daitran2k1 <[email protected]>
@MengqingCao
[Bugfix][OpenVINO] Fix circular reference vllm-project#9939 (vllm-pro…
ccb5376 
…ject#9974)

Signed-off-by: MengqingCao <[email protected]>
@chaunceyjiang
[Frontend] Multi-Modality Support for Loading Local Image Files (vllm…
ac6b8f1 
…-project#9915)

Signed-off-by: chaunceyjiang <[email protected]>
@youkaichao
[4/N] make quant config first-class citizen (vllm-project#9978)
8d72bb2 
Signed-off-by: youkaichao <[email protected]>
@jeejeelee
[Misc]Reduce BNB static variable (vllm-project#9987)
fb2716d 
Signed-off-by: Jee Jee Li <[email protected]>
@mzusman
[Model] factoring out MambaMixer out of Jamba (vllm-project#8993)
603a661 
Signed-off-by: mzusman <[email protected]>
@robertgshaw2-neuralmagic
[CI] Basic Integration Test For TPU (vllm-project#9968)
1c45f4c 
Signed-off-by: Robert Shaw <[email protected]>
@hissu-hyvarinen
[Bugfix][CI/Build][Hardware][AMD] Shard ID parameters in AMD tests ru…
5208dc7 
…nning parallel jobs (vllm-project#9279)

Signed-off-by: Hissu Hyvarinen <[email protected]>
@ywang96
[Doc] Update VLM doc about loading from local files (vllm-project#9999)
6e056bc 
Signed-off-by: Roger Wang <[email protected]>
@robertgshaw2-neuralmagic
[Bugfix] Fix MQLLMEngine hanging (vllm-project#9973)
04cef2c 
Signed-off-by: [email protected] <[email protected]>
@lk-chen
[Misc] Refactor benchmark_throughput.py (vllm-project#9779)
9a5664d 
Signed-off-by: Linkun Chen <[email protected]>
Co-authored-by: Linkun Chen <[email protected]>
Co-authored-by: Linkun Chen <[email protected]>
@tomeras91
[Frontend] Add max_tokens prometheus metric (vllm-project#9881)
ac04a97 
Signed-off-by: Tomer Asida <[email protected]>
@bnellnm
[Bugfix] Upgrade to pytorch 2.5.1 (vllm-project#10001)
d93478b 
Signed-off-by: Bill Nell <[email protected]>
@youkaichao
[4.5/N] bugfix for quant config in speculative decode (vllm-project#1…
2094062 
…0007)

Signed-off-by: youkaichao <[email protected]>
@mgoin
[Bugfix] Respect modules_to_not_convert within awq_marlin (vllm-proje…
8f0a9ca 
…ct#9895)

Signed-off-by: mgoin <[email protected]>
@tlrmchlsmth
[Core] Use os.sched_yield in ShmRingBuffer instead of time.sleep (vll…
04bbf38 
…m-project#9994)

Signed-off-by: Tyler Michael Smith <[email protected]>
@DarkLight1337
[Core] Make encoder-decoder inputs a nested structure to be more comp…
bbc3619 
…osable (vllm-project#9604)

Signed-off-by: DarkLight1337 <[email protected]>
@tlrmchlsmth
[Bugfix] Fixup Mamba (vllm-project#10004)
ad23318 
Signed-off-by: Tyler Michael Smith <[email protected]>
@GeneDer
[BugFix] Lazy import ray (vllm-project#10021)
7a83b1a
@chaunceyjiang
[Misc] vllm CLI flags should be ordered for better user readability (v…
93dee88 
…llm-project#10017)

Signed-off-by: chaunceyjiang <[email protected]>
@russellb
[Frontend] Fix tcp port reservation for api server (vllm-project#10012)
5952d81 
Signed-off-by: Russell Bryant <[email protected]>
@richardsliu
Refactor TPU requirements file and pin build dependencies (vllm-proje…
cd34029 
…ct#10010)

Signed-off-by: Richard Liu <[email protected]>
@yangalan123 @youkaichao
[Misc] Add logging for CUDA memory (vllm-project#10027)
09d3550 
Signed-off-by: Chenghao Yang <[email protected]>
Signed-off-by: youkaichao <[email protected]>
Co-authored-by: Chenghao Yang <[email protected]>
Co-authored-by: youkaichao <[email protected]>
@russellb
[CI/Build] Limit github CI jobs based on files changed (vllm-project#…
731aec5 
…9928)

Signed-off-by: Russell Bryant <[email protected]>
@mgoin
[Model] Support quantization of PixtralHFTransformer for PixtralHF (v…
a53046b 
…llm-project#9921)

Signed-off-by: mgoin <[email protected]>
@lk-chen
[Feature] Update benchmark_throughput.py to support image input (vllm…
d2e8033 
…-project#9851)

Signed-off-by: Linkun Chen <[email protected]>
Co-authored-by: Linkun Chen <[email protected]>
@jeejeelee
[Misc] Modify BNB parameter name (vllm-project#9997)
b9c64c0 
Signed-off-by: Jee Jee Li <[email protected]>
@mgoin
[CI] Prune tests/models/decoder_only/language/* tests (vllm-project#9940
0246246 
)

Signed-off-by: mgoin <[email protected]>
B-201 and others added 20 commits November 18, 2024 12:57
@B-201
[Model][LoRA]LoRA support added for glm-4v (vllm-project#10418)
5be4e52 
Signed-off-by: B-201 <[email protected]>
@Isotr0py
[Model] Remove transformers attention porting in VITs (vllm-project#1…
e7ebb66 
…0414)

Signed-off-by: Isotr0py <[email protected]>
@B-201
[Doc] Update doc for LoRA support in GLM-4V (vllm-project#10425)
4186be8 
Signed-off-by: B-201 <[email protected]>
@youkaichao
[5/N][torch.compile] torch.jit.script --> torch.compile (vllm-project…
7851b45 
…#10406)

Signed-off-by: youkaichao <[email protected]>
@ismael-dm
[Doc] Add documentation for Structured Outputs (vllm-project#9943)
31894a2 
Signed-off-by: ismael-dm <[email protected]>
@andrew
Fix open_collective value in FUNDING.yml (vllm-project#10426)
4f686d1 
Signed-off-by: Andrew Nesbitt <[email protected]>
@mgoin
[Model][Bugfix] Support TP for PixtralHF ViT (vllm-project#10405)
281cc4b 
Signed-off-by: mgoin <[email protected]>
@yma11
[Hardware][XPU] AWQ/GPTQ support for xpu backend (vllm-project#10107)
6b2d25e 
Signed-off-by: yan ma <[email protected]>
@angusYuhao
[Kernel] Explicitly specify other value in tl.load calls (vllm-projec…
c2170a5 
…t#9014)

Signed-off-by: Angus Wang <[email protected]>
@LucasWilkinson
[Kernel] Initial Machete W4A8 support + Refactors (vllm-project#9855)
96d999f 
Signed-off-by: Lucas Wilkinson <[email protected]>
@fialhocoelho
Merge branch 'main' of https://github.com/vllm-project/vllm into ibm-…
3444895 
…20241118

Signed-off-by: Jefferson Fialho <[email protected]>
@fialhocoelho
Squash 9522
e58ac91 
Signed-off-by: Jefferson Fialho <[email protected]>
@fialhocoelho
Squash 6357
9223ac3 
Signed-off-by: Jefferson Fialho <[email protected]>
@fialhocoelho
Squash 10235
b715908 
Signed-off-by: Jefferson Fialho <[email protected]>
@fialhocoelho
Squash 10400
6aa7422 
Signed-off-by: Jefferson Fialho <[email protected]>
@fialhocoelho
Squash 10430
565cfcc 
Signed-off-by: Jefferson Fialho <[email protected]>
@fialhocoelho
pin mistral and using just pip in adapter install 🚀
550ccf4 
Signed-off-by: Jefferson Fialho <[email protected]>
@fialhocoelho
reset Dockerfile.ubi to original (odh/main)
8c06d55 
Signed-off-by: Jefferson Fialho <[email protected]>
@fialhocoelho
changing dist path to workspace/dist
dcb1f69 
Signed-off-by: Jefferson Fialho <[email protected]>
@fialhocoelho
pin the CUDA arch just to A100
c5696ec 
Signed-off-by: Jefferson Fialho <[email protected]>
@fialhocoelho fialhocoelho requested a review from njhill as a code owner November 21, 2024 16:01
@openshift-ci openshift-ci bot requested review from rpancham and Xaenalt November 21, 2024 16:01
@openshift-ci OpenShift CI
Copy link

openshift-ci bot commented Nov 21, 2024

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: fialhocoelho
Once this PR has been reviewed and has the lgtm label, please assign tarukumar for approval. For more information see the Kubernetes Code Review Process.

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@fialhocoelho fialhocoelho changed the title IBM 20241121 [do-not-merge] IBM 20241121 Nov 21, 2024
@fialhocoelho
add adapter from branch
8423d51 
Signed-off-by: Jefferson Fialho <[email protected]>
@openshift-ci OpenShift CI
Copy link

openshift-ci bot commented Nov 21, 2024

@fialhocoelho: The following tests failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name Commit Details Required Rerun command
ci/prow/smoke-test 8423d51 link true /test smoke-test
ci/prow/rocm-pr-image-mirror 8423d51 link true /test rocm-pr-image-mirror
ci/prow/images 8423d51 link true /test images

Full PR test history. Your PR dashboard.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@njhill njhill Awaiting requested review from njhill njhill is a code owner

@rpancham rpancham Awaiting requested review from rpancham

@Xaenalt Xaenalt Awaiting requested review from Xaenalt

Assignees
No one assigned
Labels
do-not-merge/hold
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.