 Wentao YeandGitHub
|
59c62cd2b4
|
Merge branch 'main' into wentao-support-rms-norm-uncontiguous
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
|
2026-07-28 14:31:16 -04:00 |
|
|
Shanshan ShenandGitHub
|
6c7e679f04
|
[ROCm][Bugfix] Sanitize AITER paged-MQA logits before sparse top-k for DeepSeek-V4 (#49714)
Signed-off-by: shen-shanshan <467638484@qq.com>
|
2026-07-28 11:08:50 -07:00 |
|
|
labAxiaomingandGitHub
|
1db989bbf1
|
[Bugfix][Multimodal] Fix video temporal padding estimates (#49030)
Signed-off-by: xiaoming <1259730330@qq.com>
|
2026-07-29 01:57:31 +08:00 |
|
|
Andreas KaratzasandGitHub
|
05a0814863
|
[ROCm] Fix and optimize GPT-J-style MRoPE (#49906)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
|
2026-07-28 10:50:10 -06:00 |
|
|
Bugen ZhaoandGitHub
|
01661cc57f
|
[Rust][Benchmark] Make vllm bench serve Rust delegation opt-in (#50081)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-07-28 16:21:12 +00:00 |
|
|
|
ba702e978e
|
[Attention] Skip sparse indexer scoring for dense short prefills (#48407)
Signed-off-by: Yiliu Dong <91178480+qianlihuang@users.noreply.github.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-07-28 16:17:22 +00:00 |
|
|
|
6453fc0b8c
|
[Bugfix] Don't reuse engine core payload buffer while zmq is sending it (#50053)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-07-28 16:09:28 +00:00 |
|
|
|
30217b0e80
|
[Bugfix][KV Offload][P2P] Scope serve state to fetch rounds (#49877)
Signed-off-by: Itay Etelis <itay.etelis@ibm.com>
Co-authored-by: Itay Etelis <itay.etelis@ibm.com>
Co-authored-by: Itay Etelis <Itay.etelis@gmail.com>
|
2026-07-28 18:01:55 +03:00 |
|
|
Nick HillandGitHub
|
0d0504b54c
|
[Core] Warm up runner-owned Triton kernels before the first request (#49903)
|
2026-07-28 07:58:02 -07:00 |
|
|
|
1e81853afc
|
[Bugfix][KV Offload] Keep Mamba block span unscaled under DCP (#49964)
Signed-off-by: Jonguk Cheong <jdal3031@snu.ac.kr>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-07-28 17:41:55 +03:00 |
|
|
|
b6cbba8bc8
|
[Bugfix][Kernel] Fix batch invariance in RMSNorm kernels by pinning block size (#48391)
Signed-off-by: oops-oom <73481342@qq.com>
Signed-off-by: oops-oom <liubin8905@vip.qq.com>
Co-authored-by: oops-oom <73481342@qq.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Shengqi Chen <harry-chen@outlook.com>
|
2026-07-28 22:24:02 +08:00 |
|
|
|
94100b5915
|
[CI] Wire untethered test files into CI jobs (#49340)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-07-28 14:02:31 +00:00 |
|
|
|
601fa9a74e
|
[KV Connector] Support NIXL heterogeneous P/D block sizes for hybrid models (#49612)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-07-28 06:45:02 -07:00 |
|
|
|
948107acf7
|
[Bugfix] Enhance extra_config handling for layer name suffix matching (#48589)
Signed-off-by: Xin He <xin3.he@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-07-28 20:37:55 +08:00 |
|
|
Itay AlroyandGitHub
|
35efdf6b34
|
[Elastic EP] Async preparation (#47288)
Signed-off-by: Itay Alroy <ialroy@nvidia.com>
|
2026-07-28 05:19:13 -07:00 |
|
|
|
25ace8fe5d
|
[CI] Increase Qwen3.5 MTP GSM8K generation length (#49881)
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-07-28 18:04:36 +08:00 |
|
|
|
88402a41c4
|
[Test] Skip ROCm AITER MLA prefill tests on non-ROCm platforms (#49945)
Signed-off-by: Liangliang-Ma <liangliang.ma@intel.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-07-28 16:26:49 +08:00 |
|
|
Thien TranandGitHub
|
61ac368021
|
[Kimi-K3] Add AttnRes kernels (#50090)
Signed-off-by: Thien Tran <gau.nernst@yahoo.com.sg>
|
2026-07-28 00:22:09 -07:00 |
|
|
Shuolei WangandGitHub
|
9069a57139
|
[Core][Frontend] Add weight version tagging for RL rollouts (#49040)
Signed-off-by: Shuolei Wang <shuoleiwang123@gmail.com>
Signed-off-by: Shuolei Wang <948904026@qq.com>
|
2026-07-28 14:35:29 +08:00 |
|
|
afriedriandGitHub
|
f472ab0a4c
|
Remove triton per group quant [ROCm] [Bugfix] (#49621)
Signed-off-by: Andy Friedrich <afriedri@amd.com>
|
2026-07-28 05:53:46 +00:00 |
|
|
Ayushman SinghandGitHub
|
74587939b1
|
[Build] Fix CUDA arch detection producing kernel-less builds on SM121 (#49904)
|
2026-07-27 22:01:56 -07:00 |
|
|
|
52c3c4a42f
|
[Bugfix][KV Offload][OBJ] Preserve job completion during cleanup (#49947)
Signed-off-by: MINJUN GIL <alswnsrlf12@naver.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-07-28 07:10:52 +03:00 |
|
|
|
a8f296083f
|
[KV Offload] Make compact secondary identity TP-independent (#49858)
Signed-off-by: Change72 <changg@nvidia.com>
Co-authored-by: GPT-5.6 Sol <noreply@openai.com>
Co-authored-by: Or Ozeri <oro@il.ibm.com>
|
2026-07-28 07:10:20 +03:00 |
|
|
|
33fe71a4d3
|
[AMD] Revert Mxfp4MoeBackend.TRITON_UNFUSED fallback (#46491)
Signed-off-by: Felix Marty <Felix.Marty@amd.com>
Co-authored-by: Felix Marty <Felix.Marty@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-07-27 22:31:23 -05:00 |
|
|
|
d18ed2304a
|
[KV-offload][FS] : Batch store/load_block in C (#49152)
Signed-off-by: <>
Co-authored-by: Varun Sundar Rabindranath <varun-sundar-rabindranath@h100-01.nemg-001.lab.rdu2.dc.redhat.com>
|
2026-07-28 11:21:53 +08:00 |
|
|
nvbfalkandGitHub
|
60915c972c
|
[Feature] Add VidCom2 video token pruning (#47750)
Signed-off-by: Benedikt Falk <bfalk@nvidia.com>
|
2026-07-28 03:20:17 +00:00 |
|
|
|
7aea73d83d
|
[ROCm][Quark][6/N] Use MXFP4 linear kernel abstraction for aiter backend (#49348)
Signed-off-by: Felix Marty <Felix.Marty@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-07-27 21:35:57 -05:00 |
|
|
Yan MaandGitHub
|
73af7a362a
|
[XPU] Add online fp8 quantization test (#44513)
Signed-off-by: Yan Ma <yan.ma@intel.com>
|
2026-07-28 10:34:33 +08:00 |
|
|
Giancarlo DelfinandGitHub
|
272abd5f48
|
[Tests][Spec Decode] Add gemma4 MTP acceptance rates test (#47920)
Signed-off-by: Giancarlo Delfin <gdelfin@inferact.ai>
|
2026-07-27 16:15:54 -07:00 |
|
|
Netanel HaberandGitHub
|
1e34a13539
|
Fix Humming non-gated MoE (#49096)
|
2026-07-27 22:56:44 +00:00 |
|
|
|
ebcef33766
|
Fix MQA with tensor parallelism on transformers modeling backend (#49987)
Signed-off-by: microslaw <milosz.grunwald@intel.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-07-27 22:51:17 +00:00 |
|
|
|
28158b2fc3
|
[ROCm] [BugFix] Fix Quark GLM-5.2 Checkpoint inference: indexer wk per-channel FP8 dequant + missing sparse-MLA metadata fields (#48886)
Signed-off-by: Colin Zeng <Colin.Zeng@amd.com>
Signed-off-by: ColinZ22 <Colin.Zeng@amd.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
Co-authored-by: fanxingran <xingran.fan@amd.com>
|
2026-07-27 22:38:22 +00:00 |
|
|
fxmarty-amdandGitHub
|
53f6dd5c6f
|
[CI][ROCm] Fix test_ocp_mx_wikitext_correctness reference value (#49690)
Signed-off-by: Felix Marty <Felix.Marty@amd.com>
|
2026-07-27 21:47:07 +00:00 |
|
|
Andreas KaratzasandGitHub
|
99115fcdcd
|
[CI] Initialize DeepEP FP8 test weights (#49912)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
|
2026-07-28 05:29:08 +08:00 |
|
|
|
1053e248f0
|
[ROCm][Quantization][5/N] Refactor quark_moe w8a8-int8 w/ oracle (#46765)
Signed-off-by: amd-sourjya <amd-sourjya@users.noreply.github.com>
Co-authored-by: amd-sourjya <amd-sourjya@users.noreply.github.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-07-27 16:01:34 -05:00 |
|
|
Wentao YeandGitHub
|
b2f9e4caa4
|
[DSv4 Perf] Adaptive topk width, 1.0% E2E throughput improvement (#50004)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
|
2026-07-27 15:56:52 -04:00 |
|
|
|
831d3848f1
|
[Core] Fail fast when /dev/shm is too small for the shm ring buffer (#48879)
Signed-off-by: Dr Andrea Tassi <andrea@verticular.uk>
Co-authored-by: Dr Andrea Tassi <andrea@verticular.uk>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
|
2026-07-27 19:48:35 +00:00 |
|
|
|
fd10e8946d
|
[Test] Regression test for hybrid-Mamba eagle cache-peek in Mooncake connector (#43559) (#48361)
Signed-off-by: Rishi Puri <riship@nvidia.com>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
|
2026-07-27 19:03:58 +00:00 |
|
|
|
99de48e98f
|
Fix MLA padding and grouped topk routing in the Transformers modelling backend (#49982)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
|
2026-07-27 18:32:32 +00:00 |
|
|
|
bf2b45b5d6
|
[Attention] Integrate FlashAttention 4 SM100 headdim 256 support (#42669)
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
2026-07-27 18:25:50 +00:00 |
|
|
TobyJBellandGitHub
|
15d65f8669
|
[Bugfix] Changed speech to text chunk timestamp to cumulative approach (#41131)
Signed-off-by: Toby Bell <toby.bell1702@hotmail.co.uk>
|
2026-07-27 17:06:46 +00:00 |
|
|
|
e3c2fc3b3c
|
[Rust Frontend][gRPC] Add server and model discovery (#49491)
Signed-off-by: Connor Carpenter <connorc@nvidia.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
|
2026-07-27 09:53:27 -07:00 |
|
|
Nicolò LucchesiandGitHub
|
2b465b2c42
|
[Misc][PD] Nixl cleanup get_backend_aware_kv_block_len and virtually_split_kv_in_blocks (#49988)
Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai>
|
2026-07-27 18:51:37 +02:00 |
|
|
yzong-rhandGitHub
|
3f47a8384d
|
[Bugfix] Fix VLLM_ENFORCE_STRICT_TOOL_CALLING mutation in tests (#49846)
Signed-off-by: Yifan Zong <yzong@redhat.com>
|
2026-07-27 16:12:14 +00:00 |
|
|
|
04502deca2
|
[Perf] Hash videos by source bytes (#49607)
Signed-off-by: Guan-Ming (Wesley) Chiu <105915352+guan404ming@users.noreply.github.com>
Signed-off-by: Guan-Ming Chiu <105915352+guan404ming@users.noreply.github.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-07-27 23:57:55 +08:00 |
|
|
Umut PolatandGitHub
|
27d7061ef6
|
[Bugfix] Restore truncate_prompt_tokens for Jina rerank/score online (#49963)
Signed-off-by: Umut Polat <52835619+umut-polat@users.noreply.github.com>
|
2026-07-27 22:52:59 +08:00 |
|
|
|
59a6b0411d
|
[Core] Fix internal LB load-balancing (#49204)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-07-27 14:00:46 +00:00 |
|
|
Harry MellorandGitHub
|
92e8518d37
|
Improve Transformers modelling backend fx tracer (#49957)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-07-27 12:51:16 +01:00 |
|
|
Ronen SchafferandGitHub
|
77cba0259f
|
[KV Offloading] Per-request tier filtering with TierFilter/TierMatcher (#48123)
Signed-off-by: Ronen Schaffer <ronen.schaffer@ibm.com>
|
2026-07-27 13:29:57 +03:00 |
|
|
|
0906123953
|
[ROCm] [Model] Enable TML inkling (#48841)
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-07-27 10:05:46 +00:00 |
|