Woosuk Kwon and GitHub
287471b994
[Model Refactoring] Migrate DeepSeek V4 to vllm/models/ [1/N] ( #43004 )
...
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai >
2026-05-18 19:50:02 -07:00
Wentao Ye and GitHub
37ece593c1
[Perf] Padded nvfp4 quant kernel to remove additional copy, 2.4%~5.7% e2e performance improvement ( #42774 )
...
Signed-off-by: yewentao256 <zhyanwentao@126.com >
2026-05-18 16:38:12 -07:00
Flora Feng and GitHub
57fef4e0bf
[Refactor] Extract shared coerce_to_schema_type utility from Minimax M2 tool parser ( #43006 )
...
Signed-off-by: sfeng33 <4florafeng@gmail.com >
2026-05-18 17:55:39 -04:00
Ronen Schaffer and GitHub
84747489de
Tier offload followup ( #42529 )
...
Signed-off-by: Ronen Schaffer <ronen.schaffer@ibm.com >
2026-05-18 19:41:58 +00:00
Bowen Bao and GitHub
a2c8fc6657
[ROCm][Quantization][3/N] Refactor quark_moe w4a4 w/ oracle ( #41436 )
...
Signed-off-by: Bowen Bao <bowenbao@amd.com >
2026-05-18 13:46:13 -04:00
Netanel Haber and GitHub
47829b1159
[Bugfix] mamba: run single-token extends as decodes ( #42430 )
...
Signed-off-by: Netanel Haber <58652339+netanel-haber@users.noreply.github.com >
2026-05-18 15:26:00 +00:00
Blanc Swan and GitHub
4a39b4f553
[Model] Add Apertus Tool Parser ( #41154 )
...
Signed-off-by: Blanc <swan.blanc@infomaniak.com >
2026-05-18 11:20:04 -04:00
78e7a7b9b0
Refactor AWQ Marlin MoE onto modular WNA16 oracle ( #42483 )
...
Signed-off-by: Siddharth Bedekar <bedeksid@gmail.com >
Signed-off-by: Siddharth Bedekar <104613085+bedeks@users.noreply.github.com >
Co-authored-by: Robert Shaw <robertgshaw2-redhat@users.noreply.github.com >
Co-authored-by: OpenAI Codex <codex@openai.com >
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-05-18 08:02:43 -07:00
e5417657e5
[KV Connector][Offloading] Flush all pending jobs on last step ( #42611 )
...
Signed-off-by: Liran Schour <lirans@il.ibm.com >
Signed-off-by: liranschour <liranschour@users.noreply.github.com >
Co-authored-by: Or Ozeri <or@ozery.com >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-05-18 12:59:42 +00:00
Nicolò Lucchesi and GitHub
69c91d010a
[MRv2] Default to MRv1 when a connector is present ( #42955 )
...
Signed-off-by: NickLucche <nlucches@redhat.com >
2026-05-18 20:34:16 +08:00
roikoren755 and GitHub
737bfa3a43
[Bugfix][Hybrid][NemotronH] Fix mamba_cache_mode=all + speculative decoding crash ( #41233 )
...
Signed-off-by: Roi Koren <roik@nvidia.com >
2026-05-18 14:54:00 +03:00
Yuwen Zhou and GitHub
88a860d754
[CPU] Add MXFP4 W4A16 MoE support ( #41922 )
...
Signed-off-by: yuwenzho <yuwen.zhou@intel.com >
Signed-off-by: Yuwen Zhou <yuwen.zhou@intel.com >
2026-05-18 03:04:45 -07:00
7d5b033782
[LoRA] Support 2D and 3D MoE LoRA adapter at the same time ( #42242 )
...
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com >
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai >
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Roger Wang <hey@rogerw.io >
2026-05-18 15:22:26 +08:00
e3aeee5ff8
[Bugfix] moe lora align kernel grid ( #40131 )
...
Signed-off-by: TheDuyIT <nduy250299@gmail.com >
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai >
Signed-off-by: dtnguyen <dtnguyen@nvidia.com >
Co-authored-by: Jee Jee Li <jeejeelee@inferact.ai >
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com >
2026-05-18 00:17:53 -07:00
Andreas Karatzas and GitHub
b50646e5ef
[ROCm][CI] Stabilize ROCm pooling and multimodal CI ( #42909 )
...
Signed-off-by: Andreas Karatzas <akaratza@amd.com >
2026-05-18 03:57:59 +00:00
Soyaazz and GitHub
990f49bdcb
[MM][CG] Enable encoder Cudagraph for Step3VL ( #42224 )
...
Signed-off-by: JisoLya <523420504@qq.com >
Signed-off-by: Soyaazz <523420504@qq.com >
2026-05-17 20:19:13 -07:00
107210442d
[CI] Add NIXL EP import canary ( #42567 )
...
Signed-off-by: Alec Flowers <aflowers@nvidia.com >
Co-authored-by: OpenAI Codex <codex@openai.com >
2026-05-17 19:11:46 -07:00
Taneem Ibrahim and GitHub
1c8e9c0399
Refactor: Pass num_labels explicitly to PoolerClassify instead of reading from global config ( #42851 )
...
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com >
2026-05-17 14:40:21 +00:00
0867497368
[CI/Build] Bump flashinfer to v0.6.11.post2 ( #41711 )
...
Signed-off-by: Artem Perevedentsev <aperevedents@nvidia.com >
Co-authored-by: Vadim Gimpelson <156319763+vadiklyutiy@users.noreply.github.com >
2026-05-16 14:55:12 -07:00
36e74c9ea4
[KV Connector] Support disk offloading in MooncakeStoreConnector ( #42689 )
...
Signed-off-by: Zhewen Li <zhewenli@inferact.ai >
Co-authored-by: Zhewen Li <zhewenli@inferact.ai >
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com >
2026-05-16 13:34:15 -07:00
Taneem Ibrahim and GitHub
787bc0d031
Add unit tests for pooler activation functions ( #42824 )
...
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com >
2026-05-16 14:58:16 -04:00
Jiangyun Zhu and GitHub
8a56da3845
[Experimental] Breakable CUDA graph ( #42304 )
...
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com >
2026-05-16 22:04:12 +08:00
Jee Jee Li and GitHub
32b7177909
[LoRA][Bugfix] Dedup LoRA wrapping for modules referenced from multiple attribute paths (MoE gate) ( #42757 )
...
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com >
2026-05-16 11:22:35 +08:00
39c67d714e
fix: add API key authorization to /v2 endpoints ( #42594 )
...
Signed-off-by: DustHunter <dusthunter@126.com >
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io >
Co-authored-by: Qwen-Coder <qwen-coder@alibabacloud.com >
Co-authored-by: wang.yuqi <yuqi.wang@daocloud.io >
2026-05-16 01:29:27 +00:00
Michael Goin and GitHub
b2a27b82d9
[Kernel][UX] Add --linear-backend arg for linear kernel selection ( #39538 )
...
Signed-off-by: mgoin <mgoin64@gmail.com >
2026-05-15 17:07:39 -07:00
1ccdf87507
[Bugfix] Fix layerwise reload alias-buffer corruption ( #42481 )
...
Signed-off-by: rasdani <73563550+rasdani@users.noreply.github.com >
Co-authored-by: OpenAI Codex <codex@openai.com >
Co-authored-by: Roger Wang <hey@rogerw.io >
2026-05-15 15:20:53 -07:00
b2c58ee942
[FlashAttn] Fix supports_kv_cache_dtype() accepting unhandled fp8 kv-cache dtype variants ( #42685 )
...
Signed-off-by: Lanze Liu <lanzetech@gmail.com >
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com >
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com >
2026-05-15 15:34:59 -04:00
06d020bb6e
[Bugfix] Fix SM121 (DGX Spark) exclusion from Marlin/CUTLASS FP8 paths ( #35568 )
...
Signed-off-by: Blake Ledden <blake@secondnaturecomputing.com >
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com >
Co-authored-by: Pavani Majety <pmajety@nvidia.com >
2026-05-15 10:59:00 -07:00
BadrBasowid and GitHub
fb5bd03f51
[Perf] Set IR Op Priority Once at Worker Init ( #42631 )
...
Signed-off-by: BadrBasowid <badr.basowid@gmail.com >
2026-05-15 15:56:13 +00:00
Aaron Hao and GitHub
e0a45f1455
[Feat][RL] IPC weight sync optimizations: multigpu support and chunked packed tensors ( #37476 )
...
Signed-off-by: ahao-anyscale <ahao@anyscale.com >
Signed-off-by: hao-aaron <ahao@anyscale.com >
2026-05-15 22:53:06 +08:00
d26a28ab03
fix: propagate revision/code_revision pins to all artifact boundaries ( #42616 )
...
Signed-off-by: jperezde <jperezde@redhat.com >
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk >
2026-05-15 02:31:54 -07:00
Yifan Qiao and GitHub
4b364f810e
[Core][DSV4] Skip caching SWA blocks that can never serve a prefix-cache hit ( #42258 )
...
Signed-off-by: Yifan Qiao <yifanqiao@inferact.ai >
2026-05-15 15:59:18 +08:00
bf610c2f56
[Bugfix] Fix inverted condition causing thinking_token_budget to be silently ignored ( #41674 )
...
Signed-off-by: Keyi Li <likey6688@gmail.com >
Co-authored-by: Keyi Li <likey6688@gmail.com >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-05-15 12:48:49 +08:00
faa4b76afa
[Model] Support InternS2 Preview ( #42705 )
...
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn >
Co-authored-by: zxy <46674730+CUHKSZzxy@users.noreply.github.com >
2026-05-14 21:30:26 -07:00
f351455f0f
[CPU][RISC-V] Add RVV-optimized attention kernels for RISC-V Vector Extension ( #40119 )
...
Signed-off-by: liuyudong <liuyudong@iscas.ac.cn >
Co-authored-by: Claude <noreply@anthropic.com >
2026-05-15 12:08:23 +08:00
Cyrus Leung and GitHub
56434e8651
[Bugfix] Fix incorrect chat template format for Qwen3.5 ( #42660 )
...
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk >
2026-05-14 20:52:52 -07:00
fa2a33b893
[Quant] Consolidate GPTQ: rename gptq_marlin.py to auto_gptq.py ( #38288 )
...
Signed-off-by: Chengyi Nie <cnie@roblox.com >
Co-authored-by: Chengyi Nie <cnie@roblox.com >
Co-authored-by: Cursor <cursoragent@cursor.com >
2026-05-15 08:25:52 +08:00
f8848b2f2d
[Bugfix] Add swiglu limits to deepgemm fp8 methods ( #41986 )
...
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com >
Co-authored-by: Claude <noreply@anthropic.com >
2026-05-14 15:43:13 -07:00
Charlie Fu and GitHub
4cfcc0866f
[CI][ROCm] Remove unsupported cases in test_fusion.py ( #38680 )
...
Signed-off-by: charlifu <charlifu@amd.com >
2026-05-14 17:37:18 -04:00
f887aa1a53
[Aiter][ROCm] RMSNormGated+GroupedQuantFP8 fusion ( #40710 )
...
Signed-off-by: Tres Popp <tres.popp@amd.com >
Signed-off-by: Tres Popp <trespopp@gmail.com >
Co-authored-by: Cursor <cursoragent@cursor.com >
2026-05-14 15:37:09 -04:00
Matthew Bonanni and GitHub
9898f94abe
[Attention] Remove deprecated MLA prefill arguments ( #42555 )
...
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com >
2026-05-14 10:34:06 -07:00
ae4f59f0ec
[Model Runner v2] Oracle for model runner v2 - qwen3 dense model by default [1/N] ( #39337 )
...
Signed-off-by: yewentao256 <zhyanwentao@126.com >
Signed-off-by: Nick Hill <nickhill123@gmail.com >
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com >
Co-authored-by: Nick Hill <nickhill123@gmail.com >
2026-05-14 10:02:33 -07:00
Ranran and GitHub
f3d5360591
[Bugfix][Multimodal] PyAV video backend returns keyframes labeled as targets ( #42586 )
...
Signed-off-by: Ranran <hzz5361@psu.edu >
2026-05-14 08:56:59 -07:00
Baorun (Lauren) Mu and GitHub
a7737cb4f3
[Fix] Misc Fixes in ViT CUDA Graph ( #38040 )
...
Signed-off-by: Baorun Mu <bmu@nvidia.com >
2026-05-14 23:49:06 +08:00
24337fb860
PD disagg with NIXL Connector: GDN support (Qwen3.5) ( #41869 )
...
Signed-off-by: Zhanqiu Hu <zhu@redhat.com >
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com >
2026-05-14 16:33:01 +02:00
c7560af424
[RFC] Replace shared-memory routed experts with ModelRunnerOutput transfer and HTTP support ( #39568 )
...
Signed-off-by: xhx1022 <1737006628@qq.com >
Signed-off-by: arlenxu <arlenxu@tencent.com >
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com >
Co-authored-by: arlenxu <arlenxu@tencent.com >
Co-authored-by: Junjie Zhang <junj.jay.zhang@gmail.com >
2026-05-14 14:12:30 +00:00
5bd8c71e79
[kv_offload] Implement reset_cache() for the offloading connector ( #41956 )
...
Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com >
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Or Ozeri <or@ozery.com >
2026-05-14 16:00:10 +03:00
rasmith and GitHub
addef3299c
[CI][AMD] Skip tests where models have problems or fails on both HW types ( #42126 )
...
Signed-off-by: Randall Smith <Randall.Smith@amd.com >
2026-05-14 08:21:06 +00:00
aoshen02 and GitHub
8c79ad6580
Revert "[Core] Replace routing replay with device cache and async D2H pipeline" ( #39917 ) ( #42434 )
...
Signed-off-by: aoshen02 <aoshen@inferact.ai >
2026-05-13 23:49:01 -07:00
0d2732dd91
[MLA Attention Backend] Add TOKENSPEED_MLA backend for DSR1/Kimi K25 prefill + decode on Blackwell ( #41778 )
...
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com >
Signed-off-by: Roger Wang <hey@rogerw.io >
Co-authored-by: Roger Wang <hey@rogerw.io >
2026-05-13 23:48:02 -07:00
