Skip to content

Rebase may 07 #1220

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 34 commits into
base: habana_main
Choose a base branch
from
Open

Rebase may 07 #1220

wants to merge 34 commits into from

Conversation

michalkuligowski
Copy link

No description provided.

mgoin and others added 30 commits May 6, 2025 06:49
@mgoin
[V1] Enable TPU V1 backend by default (vllm-project#17673)
d419aa5 
Signed-off-by: mgoin <[email protected]>
@bigPYJ1151
[V1][PP] Support PP for MultiprocExecutor (vllm-project#14219)
a6fed02 
Signed-off-by: jiang1.li <[email protected]>
Signed-off-by: jiang.li <[email protected]>
@heheda12345
[v1] AttentionMetadata for each layer (vllm-project#17394)
cba31c4 
Signed-off-by: Chen Zhang <[email protected]>
@aarnphm
[Feat] Add deprecated=True to CLI args (vllm-project#17426)
175bda6 
Signed-off-by: Aaron Pham <[email protected]>
@windsonsea
[Docs] Use gh-file to add links to tool_calling.md (vllm-project#17709)
0d11546 
Signed-off-by: windsonsea <[email protected]>
@heheda12345
[v1] Introduce KVCacheBlocks as interface between Scheduler and KVCac…
aabcd2c 
…heManager (vllm-project#17479)

Signed-off-by: Chen Zhang <[email protected]>
@reidliu41
[doc] Add RAG Integration example (vllm-project#17692)
7525d5f 
Signed-off-by: reidliu41 <[email protected]>
Co-authored-by: reidliu41 <[email protected]>
@DarkLight1337
[Bugfix] Fix modality limits in vision language example (vllm-project…
5b8c390 
…#17721)

Signed-off-by: DarkLight1337 <[email protected]>
@hmellor
Make right sidebar more readable in "Supported Models" (vllm-project#…
6115b11 
…17723)

Signed-off-by: Harry Mellor <[email protected]>
@bythew3i
[TPU] Increase block size and reset block shapes (vllm-project#16458)
621ca2c
@dtransposed
[Misc] Add Next Edit Prediction (NEP) datasets support in `benchmark_…
d456aea 
…serving.py` (vllm-project#16839)

Signed-off-by: dtransposed <damian@damian-ml-machine.europe-west3-b.c.jetbrains-grazie.internal>
Signed-off-by: dtransposed <>
Co-authored-by: dtransposed <damian@damian-ml-machine.europe-west3-b.c.jetbrains-grazie.internal>
@gshtras
[Bugfix] Fix for the condition to accept empty encoder inputs for mll…
de906b9 
…ama (vllm-project#17732)

Signed-off-by: Gregory Shtrasberg <[email protected]>
@tdoublep @LucasWilkinson
[Kernel] Unified Triton kernel that doesn't distinguish between prefi…
2f925e5 
…ll + decode (vllm-project#16828)

Signed-off-by: Thomas Parnell <[email protected]>
Signed-off-by: Lucas Wilkinson <[email protected]>
Co-authored-by: Lucas Wilkinson <[email protected]>
@hmellor
Fix doc build performance (vllm-project#17748)
022afbe 
Signed-off-by: Harry Mellor <[email protected]>
@hongxiayang
[ROCm] fix num_stages for default moe config to avoid triton OutOfRes…
ed3a1d2 
…ource error (vllm-project#17744)

Signed-off-by: Hongxia Yang <[email protected]>
@yangw-dev
Add logging for torch nightly version (vllm-project#17669)
6de3e13 
Signed-off-by: Yang Wang <[email protected]>
@cyang49
[Model] Mamba2 causal conv1d Refactor to Split Prefill and Decode Req…
18dd5e0 
…uests for Corresponding Kernels (vllm-project#17146)

Signed-off-by: Chih-Chieh-Yang <[email protected]>
@mgoin
Removed unused marlin cuda code (vllm-project#17684)
a17cef7 
Signed-off-by: mgoin <[email protected]>
@mgoin
[TPU] Add kernel test for moe_pallas (vllm-project#17496)
e50a1f1 
Signed-off-by: Michael Goin <[email protected]>
@mgoin
Replace lm-eval bash script with pytest and use enforce_eager for fas…
950b711 
…ter CI (vllm-project#17717)

Signed-off-by: mgoin <[email protected]>
@WoosukKwon
[BugFix][Spec Decode] Fix hidden size mismatch between target and eag…
8d84d83 
…le head (vllm-project#17740)

Signed-off-by: Woosuk Kwon <[email protected]>
@jeejeelee
[Misc] Split model loader (vllm-project#17712)
822de7f 
Signed-off-by: Jee Jee Li <[email protected]>
@Isotr0py
[Misc] Use apply_rotary_emb from vllm_flash_attn for Qwen2-VL visio…
c3e9d50 
…n RoPE (vllm-project#17726)

Signed-off-by: Isotr0py <[email protected]>
@SzymonOzog @Isotr0py
[Kernel] GGUF MoeVec kernel (vllm-project#16780)
1a45a61 
Signed-off-by: SzymonOzog <[email protected]>
Signed-off-by: SzymonOzog <[email protected]>
Signed-off-by: Isotr0py <[email protected]>
Co-authored-by: Isotr0py <[email protected]>
@Eviannn
[Kernel] Use fused rmsnorm for some models like qwen3 series (vllm-pr…
f80ae5b 
…oject#17735)

Signed-off-by: evian <[email protected]>
Co-authored-by: evian <[email protected]>
@jeejeelee
[Misc] Remove qlora_adapter_name_or_path (vllm-project#17699)
ba7703e 
Signed-off-by: Jee Jee Li <[email protected]>
@aws-satyajith @sssrijan-amazon
@chongmni-aws @aws-amulyaab @aws-patlange @elaineyz @aws-tailinpa @aws-navyadhara @aws-yishanm @mrinalks
Add NeuronxDistributedInference support, Speculative Decoding, Dynami…
043e4c4 
…c on-device sampling (vllm-project#16357)

Signed-off-by: Satyajith Chilappagari <[email protected]>
Co-authored-by: Aaron Dou <[email protected]>
Co-authored-by: Shashwat Srijan <[email protected]>
Co-authored-by: Chongming Ni <[email protected]>
Co-authored-by: Amulya Ballakur <[email protected]>
Co-authored-by: Patrick Lange <[email protected]>
Co-authored-by: Elaine Zhao <[email protected]>
Co-authored-by: Lin Lin Pan <[email protected]>
Co-authored-by: Navyadhara Gogineni <[email protected]>
Co-authored-by: Yishan McNabb <[email protected]>
Co-authored-by: Mrinal Shukla <[email protected]>
@DarkLight1337
[Frontend] Add missing chat templates for various MLLMs (vllm-project…
8a15c26 
…#17758)

Signed-off-by: DarkLight1337 <[email protected]>
@sarckk
Fix test_memory_usage_no_spec (vllm-project#17754)
324a311 
Signed-off-by: Yong Hoon Shin <[email protected]>
@sarckk
Make key optional for rotary embedding (vllm-project#17566)
98c89e1 
Signed-off-by: Yong Hoon Shin <[email protected]>
@michalkuligowski
Copy link
Author

/run-gaudi-tests

@michalkuligowski
Copy link
Author

/run-gaudi-tests

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@kzawora-intel kzawora-intel Awaiting requested review from kzawora-intel kzawora-intel is a code owner

@madamczyk-intel madamczyk-intel Awaiting requested review from madamczyk-intel madamczyk-intel is a code owner

@mgawarkiewicz-intel mgawarkiewicz-intel Awaiting requested review from mgawarkiewicz-intel mgawarkiewicz-intel is a code owner

@vivekgoe vivekgoe Awaiting requested review from vivekgoe vivekgoe is a code owner

@afierka-intel afierka-intel Awaiting requested review from afierka-intel afierka-intel is a code owner

@xuechendi xuechendi Awaiting requested review from xuechendi xuechendi is a code owner

@jikunshang jikunshang Awaiting requested review from jikunshang jikunshang is a code owner

@mswiniarsk mswiniarsk Awaiting requested review from mswiniarsk mswiniarsk is a code owner

At least 1 approving review is required to merge this pull request.

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.