Skip to content

Pull requests: Snowflake-Labs/vllm

New pull request New
9 Open 12 Closed
9 Open 12 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

cherrypick two PRs from Snowflakedb main to swiftkv-refactor
#22 opened Nov 25, 2024 by sfc-gh-yewang Loading…
1
Add span metrics for model_forward, scheduler and sampler time
#21 opened Aug 1, 2024 by sfc-gh-mkeralapura Loading…
7
add the instrumentation needed to measure model forward time
#19 opened Jul 3, 2024 by sfc-gh-reyazda Loading…
Add the fp8-quantized GeMM for dense linear layers
#18 opened Jun 11, 2024 by sfc-gh-reyazda Loading…
1
Fix CUDA illegal memory access error
#16 opened May 23, 2024 by sfc-gh-goliaro Loading…
Hao pp
#15 opened May 23, 2024 by sfc-gh-hazhang • Draft
Arctic hao 0504
#11 opened May 4, 2024 by sfc-gh-hazhang • Draft
Add the fp8 version of fused-moe
#10 opened May 4, 2024 by sfc-gh-reyazda • Draft
2 tasks
Benchmark scripts
#6 opened Apr 24, 2024 by sfc-gh-aqiao Loading…
ProTip! Exclude everything labeled bug with -label:bug.