|
89c6a41001
|
[Bench] Add BFCL dataset for vllm bench serve tool-calling workloads (#42457)
Signed-off-by: Li Zhang <lzhanga@amazon.com>
Co-authored-by: Li Zhang <lzhanga@amazon.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
|
2026-06-09 23:59:18 -07:00 |
|
|
|
7fdfa6441d
|
Model/colbert autoweightsloader (#44999)
Signed-off-by: Furkan Fidan <dev@yufufi.com>
Co-authored-by: wang.yuqi <yuqi.wang@daocloud.io>
|
2026-06-09 23:58:50 -07:00 |
|
|
Harry MellorandGitHub
|
e9b728de8a
|
Change from owning configs to owning config utils (#45058)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-06-10 06:40:25 +00:00 |
|
|
|
5828a205ef
|
Fix Harmony tool descriptions for optional fields (#44686)
Signed-off-by: Varun Shenoy <varun.vinayak.shenoy@oracle.com>
Co-authored-by: Codex <codex@openai.com>
|
2026-06-09 23:29:22 -07:00 |
|
|
Yaoming ZhanandGitHub
|
7a74f31d2e
|
[Rust Frontend] Add seed_oss and step3p5 reasoning parsers (#44552)
Signed-off-by: yzhan1 <zhanyaoming2014@gmail.com>
|
2026-06-09 23:01:33 -07:00 |
|
|
|
47930b59ca
|
[Bugfix] Handle HWC images in ImageProcessorItems.get_image_size (#45057)
Signed-off-by: YellowFoxH4XOR <yellowfoxh4xor@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-06-10 05:35:50 +00:00 |
|
|
Flora FengandGitHub
|
6aec99f030
|
[Refactor] Remove dead states from chat completion serving (#45081)
Signed-off-by: sfeng33 <4florafeng@gmail.com>
|
2026-06-09 22:20:15 -07:00 |
|
|
bnellnmandGitHub
|
f4966f8b3d
|
[Bugfix] Fix weight loading issues caused by #41184 (#45054)
Signed-off-by: Bill Nell <bnell@redhat.com>
|
2026-06-10 01:20:13 -04:00 |
|
|
Mohammad Miadh AngkadandGitHub
|
2c9c07c85e
|
[Bugfix][CI/Build] Fix Rust frontend build after chat conversion refactor (#45085)
Signed-off-by: Mohammad Miadh Angkad <176301910+mmangkad@users.noreply.github.com>
|
2026-06-09 20:04:41 -07:00 |
|
|
Change72andGitHub
|
320c52b134
|
[Bench] benchmark_serving_multi_turn: make non-standard conversation_id payload opt-in (#43756)
Signed-off-by: Change72 <cguo51@asu.edu>
|
2026-06-09 19:41:56 -07:00 |
|
|
|
6deb05e0e4
|
[Core][Model] Gemma4: Unified FA4 for all layers + FlashAttention mm_prefix support (#42175)
Signed-off-by: Luciano Martins <lucianommartins@users.noreply.github.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Luciano Martins <lucianommartins@users.noreply.github.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
|
2026-06-09 17:45:39 -07:00 |
|
|
Flora FengandGitHub
|
d82ac00923
|
[Refactor][Mistral] Extract parsing logic into MistralParser (#44596)
Signed-off-by: sfeng33 <4florafeng@gmail.com>
|
2026-06-10 00:12:23 +00:00 |
|
|
Bugen ZhaoandGitHub
|
dac9e9a640
|
[Rust Frontend] Extract shared options in route helper params (#44884)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-06-09 17:02:35 -07:00 |
|
|
Wentao YeandGitHub
|
d7607ad273
|
[Bug] Fix deepseek v4 OOM issue (#44914)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
|
2026-06-09 15:47:06 -07:00 |
|
|
|
d955745d58
|
[ROCm][CI] fix test_rope_kvcache_fusion.py (#44678)
Signed-off-by: charlifu <charlifu@amd.com>
Co-authored-by: Rohan Potdar <66227218+Rohan138@users.noreply.github.com>
|
2026-06-09 21:53:46 +00:00 |
|
|
Micah WilliamsonandGitHub
|
e1ed89dbee
|
Revert "[Kernel] Speed up silu_and_mul_per_block_quant with warp-shuf… (#45066)
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
|
2026-06-09 14:12:06 -07:00 |
|
|
|
1c2ffc6f88
|
feat(multi-turn-bench): add api_key and custom headers for multi turn benchmark (#44516)
Signed-off-by: Jimmy <jinmingyi1998@sina.cn>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: simon-mo <simon.mo@hey.com>
|
2026-06-09 14:00:07 -07:00 |
|
|
Jiangyun ZhuandGitHub
|
ca4cfd8731
|
[Bugfix] fix qwen3.5 ep weight loading (#45002)
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
|
2026-06-09 13:55:30 -07:00 |
|
|
Micah WilliamsonandGitHub
|
c9c1540e61
|
[ROCm][V2] Fix failed assertion in Llama models when using EAGLE with ROCM_AITER_FA (#44936)
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
|
2026-06-09 13:30:52 -05:00 |
|
|
|
c1d754d681
|
[Mooncake] Use all HCAs on multi-NIC hosts instead of GPU-indexed RNIC selection (#43799)
Signed-off-by: Dao Le <Dao007forever@gmail.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
2026-06-09 11:05:36 -07:00 |
|
|
|
01d8cd92dd
|
[ROCm][Perf] Use fused softplus-sqrt-topk router under AITER fused-MoE (#44945)
Co-authored-by: vLLM Contributor <contributor@vllm.ai>
|
2026-06-09 17:53:05 +00:00 |
|
|
|
a4b14b98c6
|
[Kernel] Speed up silu_and_mul_per_block_quant with warp-shuffle reduction + vectorized I/O (#44173)
Signed-off-by: SII-yangdian <yangdian@sii.edu.cn>
Co-authored-by: SII-yangdian <yangdian@sii.edu.cn>
|
2026-06-09 10:41:26 -07:00 |
|
|
Juan Pérez de AlgabaandGitHub
|
cf1c906724
|
[Security] Fix image EXIF orientation and tRNS transparency handling (#44974)
Signed-off-by: jperezde <jperezde@redhat.com>
|
2026-06-09 09:34:44 -07:00 |
|
|
|
766ce2bb6b
|
Fix MiDashengLM TP>1 crash in audio encoder attention (#44408)
Signed-off-by: Michał Ganczarenko <michal.ganczarenko@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-06-09 09:29:14 -07:00 |
|
|
|
3d119f78f7
|
[Docs] Add KV offloading usage guide (single- and multi-tier) (#44415)
Signed-off-by: Ronen Schaffer <ronen.schaffer@ibm.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-06-09 19:20:23 +03:00 |
|
|
Juan Pérez de AlgabaandGitHub
|
1b1359c332
|
[Security] Fix DoS via audio decompression bomb in speech-to-text endpoint (#44970)
Signed-off-by: jperezde <jperezde@redhat.com>
|
2026-06-10 00:18:53 +08:00 |
|
|
Tyko NiemiandGitHub
|
cad4ca12b8
|
[Bugfix] Add X-Session-ID from conversation_id in multi-turn benchmark (#44663)
Signed-off-by: Tyko Niemi <tyko.niemi@amd.com>
|
2026-06-09 08:57:00 -07:00 |
|
|
Andreas KaratzasandGitHub
|
b697119800
|
[ROCm][CI] Stabilize ModernBERT token-classification parity against Hugging Face (#44040)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
|
2026-06-09 16:52:36 +01:00 |
|
|
Kunshang JiandGitHub
|
b4c6dc6454
|
[WIP][XPU] upgrade torch-xpu to 2.12 (#42262)
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
|
2026-06-09 15:51:39 +00:00 |
|
|
Raushan TurganbayandGitHub
|
2ee5106372
|
Remove raw_inputs from transformers backend (#39425)
Signed-off-by: raushan <raushan@huggingface.co>
|
2026-06-09 15:01:04 +00:00 |
|
|
Jiangyun ZhuandGitHub
|
7a89b72564
|
[Perf] fuse qk rmsnorm rope gate for qwen3.5 (#44176)
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
|
2026-06-09 22:12:17 +08:00 |
|
|
Jee Jee LiandGitHub
|
dc10e467a9
|
[Bugfix] Fix minimax_qk_norm_fusion (#44983)
|
2026-06-09 06:43:46 -07:00 |
|
|
Terrence ZhaoandGitHub
|
ee4d7df2b5
|
[Cohere] Cohere2 moe parser fix (#44907)
Signed-off-by: Terrencezzj <terrence@cohere.ai>
|
2026-06-09 06:32:18 -07:00 |
|
|
Terrence ZhaoandGitHub
|
3e8afdf785
|
[Cohere] Fix Cohere2MoE weight loading when using Transformers ≥5.10 (#44747)
Signed-off-by: Terrencezzj <terrence@cohere.ai>
|
2026-06-09 06:27:40 -07:00 |
|
|
Nicolò LucchesiandGitHub
|
6690a0c4de
|
[PD][Bugfix] Fix KV Cache sharing with HMA (#44629)
Signed-off-by: NickLucche <nlucches@redhat.com>
|
2026-06-09 06:10:06 -07:00 |
|
|
Maria GuevaraandGitHub
|
1c23c42030
|
[Rust Frontend] Support Kimi K2 tool call IDs (#44901)
|
2026-06-09 05:31:26 -07:00 |
|
|
xiangdongandGitHub
|
b12e42d132
|
[XPU][CI] Refine docker image build and pull/create lock mechanism in Intel GPU CI (#44481)
Signed-off-by: zengxian <xiangdong.zeng@intel.com>
|
2026-06-09 20:20:32 +08:00 |
|
|
|
69fdaffbcd
|
[Rust Frontend] Add /tokenize and /detokenize endpoints (#44222)
Signed-off-by: Tan Ngoc Do <darkknightkhtn2008@gmail.com>
Signed-off-by: TanNgocDo <darkknightkhtn2008@gmail.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
|
2026-06-09 05:11:37 -07:00 |
|
|
|
80e2c4462d
|
[ROCm][Compile] Fuse AR + RMSNorm + per-group FP8 quant (+ DSv3.2 indexer fan-out) (#42864)
Signed-off-by: Markus Hartikainen <markus.hartikainen@amd.com>
Co-authored-by: Frida Andersson <fanderss@amd.com>
|
2026-06-09 12:06:56 +00:00 |
|
|
SageandGitHub
|
5b3807e862
|
[KV Events] Switch event structs from array to map encoding (#42892)
Signed-off-by: Sage Ahrac <sagiahrak@gmail.com>
|
2026-06-09 11:39:52 +00:00 |
|
|
Qiuyang YueandGitHub
|
59401ac9f1
|
[Kernel][Perf] Tune fused_moe FP8 config for Qwen3-Next-80B tp=4 on H100 (+25% at batch 96-512) (#44830)
Signed-off-by: Qiuyang Yue <yueqiuyang1389@gmail.com>
|
2026-06-09 04:15:51 -07:00 |
|
|
|
d841386d27
|
[Rust Frontend] Support API key authentication (#44321)
Signed-off-by: RickyChen / 陳昭儒 <ricky.chen@infinirc.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-06-09 10:15:20 +00:00 |
|
|
Mohammad Miadh AngkadandGitHub
|
fff9210b2a
|
[CI/Docs] Remove stale disagg prefill links (#44918)
Signed-off-by: Mohammad Miadh Angkad <176301910+mmangkad@users.noreply.github.com>
|
2026-06-09 03:05:53 -07:00 |
|
|
Ma JianandGitHub
|
70db1488c5
|
[DSV4][XPU] Add MHC fused_post_pre support (#44144)
Signed-off-by: Ma Jian <jian1.ma@intel.com>
|
2026-06-09 17:23:17 +08:00 |
|
|
Andreas KaratzasandGitHub
|
2385e140d6
|
[ROCm][CI] Stabilize sleep-mode memory release (#43022)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
|
2026-06-09 16:51:12 +08:00 |
|
|
Nicolò LucchesiandGitHub
|
dab60fc658
|
[Bugfix][CI] Fix test_offloading_connector.py::test_fs_tiering_offloading (#44903)
Signed-off-by: NickLucche <nlucches@redhat.com>
|
2026-06-09 00:57:34 -07:00 |
|
|
wang.yuqiandGitHub
|
996222f4bf
|
[CI] Reorganize entrypoints CI (#44947)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
|
2026-06-09 00:46:11 -07:00 |
|
|
|
e6fc848d4f
|
[Bugfix][MiniCPM-o] Fix cuda/cpu device mismatch in Resampler2_5 pos_embed (#43844)
Signed-off-by: Parth Ashwin Jain <parthash@amd.com>
Co-authored-by: Parth Ashwin Jain <parthash@amd.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-06-08 23:28:26 -07:00 |
|
|
Andreas KaratzasandGitHub
|
f843ac1a1c
|
[Bugfix][CI] Gemma3 Transformers multimodal encoder profiling and build prompt-embedding fixtures (#44952)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
|
2026-06-09 05:49:30 +00:00 |
|
|
|
7c2aa3108a
|
fix: prevent MM cache hang from stale LRU order keys (#43595)
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-06-08 22:48:31 -07:00 |
|