|
766ce2bb6b
|
Fix MiDashengLM TP>1 crash in audio encoder attention (#44408)
Signed-off-by: Michał Ganczarenko <michal.ganczarenko@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-06-09 09:29:14 -07:00 |
|
|
|
3d119f78f7
|
[Docs] Add KV offloading usage guide (single- and multi-tier) (#44415)
Signed-off-by: Ronen Schaffer <ronen.schaffer@ibm.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-06-09 19:20:23 +03:00 |
|
|
Juan Pérez de AlgabaandGitHub
|
1b1359c332
|
[Security] Fix DoS via audio decompression bomb in speech-to-text endpoint (#44970)
Signed-off-by: jperezde <jperezde@redhat.com>
|
2026-06-10 00:18:53 +08:00 |
|
|
Tyko NiemiandGitHub
|
cad4ca12b8
|
[Bugfix] Add X-Session-ID from conversation_id in multi-turn benchmark (#44663)
Signed-off-by: Tyko Niemi <tyko.niemi@amd.com>
|
2026-06-09 08:57:00 -07:00 |
|
|
Andreas KaratzasandGitHub
|
b697119800
|
[ROCm][CI] Stabilize ModernBERT token-classification parity against Hugging Face (#44040)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
|
2026-06-09 16:52:36 +01:00 |
|
|
Kunshang JiandGitHub
|
b4c6dc6454
|
[WIP][XPU] upgrade torch-xpu to 2.12 (#42262)
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
|
2026-06-09 15:51:39 +00:00 |
|
|
Raushan TurganbayandGitHub
|
2ee5106372
|
Remove raw_inputs from transformers backend (#39425)
Signed-off-by: raushan <raushan@huggingface.co>
|
2026-06-09 15:01:04 +00:00 |
|
|
Jiangyun ZhuandGitHub
|
7a89b72564
|
[Perf] fuse qk rmsnorm rope gate for qwen3.5 (#44176)
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
|
2026-06-09 22:12:17 +08:00 |
|
|
Jee Jee LiandGitHub
|
dc10e467a9
|
[Bugfix] Fix minimax_qk_norm_fusion (#44983)
|
2026-06-09 06:43:46 -07:00 |
|
|
Terrence ZhaoandGitHub
|
ee4d7df2b5
|
[Cohere] Cohere2 moe parser fix (#44907)
Signed-off-by: Terrencezzj <terrence@cohere.ai>
|
2026-06-09 06:32:18 -07:00 |
|
|
Terrence ZhaoandGitHub
|
3e8afdf785
|
[Cohere] Fix Cohere2MoE weight loading when using Transformers ≥5.10 (#44747)
Signed-off-by: Terrencezzj <terrence@cohere.ai>
|
2026-06-09 06:27:40 -07:00 |
|
|
Nicolò LucchesiandGitHub
|
6690a0c4de
|
[PD][Bugfix] Fix KV Cache sharing with HMA (#44629)
Signed-off-by: NickLucche <nlucches@redhat.com>
|
2026-06-09 06:10:06 -07:00 |
|
|
Maria GuevaraandGitHub
|
1c23c42030
|
[Rust Frontend] Support Kimi K2 tool call IDs (#44901)
|
2026-06-09 05:31:26 -07:00 |
|
|
xiangdongandGitHub
|
b12e42d132
|
[XPU][CI] Refine docker image build and pull/create lock mechanism in Intel GPU CI (#44481)
Signed-off-by: zengxian <xiangdong.zeng@intel.com>
|
2026-06-09 20:20:32 +08:00 |
|
|
|
69fdaffbcd
|
[Rust Frontend] Add /tokenize and /detokenize endpoints (#44222)
Signed-off-by: Tan Ngoc Do <darkknightkhtn2008@gmail.com>
Signed-off-by: TanNgocDo <darkknightkhtn2008@gmail.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
|
2026-06-09 05:11:37 -07:00 |
|
|
|
80e2c4462d
|
[ROCm][Compile] Fuse AR + RMSNorm + per-group FP8 quant (+ DSv3.2 indexer fan-out) (#42864)
Signed-off-by: Markus Hartikainen <markus.hartikainen@amd.com>
Co-authored-by: Frida Andersson <fanderss@amd.com>
|
2026-06-09 12:06:56 +00:00 |
|
|
SageandGitHub
|
5b3807e862
|
[KV Events] Switch event structs from array to map encoding (#42892)
Signed-off-by: Sage Ahrac <sagiahrak@gmail.com>
|
2026-06-09 11:39:52 +00:00 |
|
|
Qiuyang YueandGitHub
|
59401ac9f1
|
[Kernel][Perf] Tune fused_moe FP8 config for Qwen3-Next-80B tp=4 on H100 (+25% at batch 96-512) (#44830)
Signed-off-by: Qiuyang Yue <yueqiuyang1389@gmail.com>
|
2026-06-09 04:15:51 -07:00 |
|
|
|
d841386d27
|
[Rust Frontend] Support API key authentication (#44321)
Signed-off-by: RickyChen / 陳昭儒 <ricky.chen@infinirc.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-06-09 10:15:20 +00:00 |
|
|
Mohammad Miadh AngkadandGitHub
|
fff9210b2a
|
[CI/Docs] Remove stale disagg prefill links (#44918)
Signed-off-by: Mohammad Miadh Angkad <176301910+mmangkad@users.noreply.github.com>
|
2026-06-09 03:05:53 -07:00 |
|
|
Ma JianandGitHub
|
70db1488c5
|
[DSV4][XPU] Add MHC fused_post_pre support (#44144)
Signed-off-by: Ma Jian <jian1.ma@intel.com>
|
2026-06-09 17:23:17 +08:00 |
|
|
Andreas KaratzasandGitHub
|
2385e140d6
|
[ROCm][CI] Stabilize sleep-mode memory release (#43022)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
|
2026-06-09 16:51:12 +08:00 |
|
|
Nicolò LucchesiandGitHub
|
dab60fc658
|
[Bugfix][CI] Fix test_offloading_connector.py::test_fs_tiering_offloading (#44903)
Signed-off-by: NickLucche <nlucches@redhat.com>
|
2026-06-09 00:57:34 -07:00 |
|
|
wang.yuqiandGitHub
|
996222f4bf
|
[CI] Reorganize entrypoints CI (#44947)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
|
2026-06-09 00:46:11 -07:00 |
|
|
|
e6fc848d4f
|
[Bugfix][MiniCPM-o] Fix cuda/cpu device mismatch in Resampler2_5 pos_embed (#43844)
Signed-off-by: Parth Ashwin Jain <parthash@amd.com>
Co-authored-by: Parth Ashwin Jain <parthash@amd.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-06-08 23:28:26 -07:00 |
|
|
Andreas KaratzasandGitHub
|
f843ac1a1c
|
[Bugfix][CI] Gemma3 Transformers multimodal encoder profiling and build prompt-embedding fixtures (#44952)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
|
2026-06-09 05:49:30 +00:00 |
|
|
|
7c2aa3108a
|
fix: prevent MM cache hang from stale LRU order keys (#43595)
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-06-08 22:48:31 -07:00 |
|
|
|
ebf53ba373
|
[Bugfix][Rust Frontend] Set a structured-output backend so requests do not 500 (#44729)
Signed-off-by: Ting Sun <suntcrick@gmail.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
|
2026-06-08 22:30:54 -07:00 |
|
|
|
baacbfcebf
|
[ROCm][MLA][Bugfix] Reserve FP8 prefill workspace before lock for Kimi-K2.5 (#42978)
Signed-off-by: Xavier Aguilar <xavier.aguilarfruto@amd.com>
Co-authored-by: Douglas Lehr <91553416+dllehr-amd@users.noreply.github.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-06-08 22:25:52 -07:00 |
|
|
|
d8218b1ee7
|
[Bugfix] Propagate ImportError from load_audio_pyav when vllm[audio] … (#44750)
Signed-off-by: littlecircle0730 <littlecircle0730@gmail.com>
Signed-off-by: Hsiao-Yuan Chen <hy.c@Hsiao-YuandeMacBook-Pro.local>
Co-authored-by: Hsiao-Yuan Chen <hy.c@Hsiao-YuandeMacBook-Pro.local>
|
2026-06-09 04:24:52 +00:00 |
|
|
|
9f153aa781
|
[MM][Perf][CG] Support ViT full CUDA graph for glm4_1v image and video inference (#40576)
Signed-off-by: grYe99 <guorongye99@gmail.com>
Co-authored-by: grYe99 <guorongye99@gmail.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
|
2026-06-09 11:13:56 +08:00 |
|
|
Kunshang JiandGitHub
|
d3de61502f
|
[XPU][CI] fix test case path (#44940)
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-06-08 20:02:31 -07:00 |
|
|
Lanze LiuandGitHub
|
540aaf2140
|
[Bugfix][Model] Qwen3-Omni: move cu_seqlens to GPU before VIT attention (#44264)
Signed-off-by: Lanze Liu <lanzetech@gmail.com>
|
2026-06-08 20:02:27 -07:00 |
|
|
Lanze LiuandGitHub
|
4128605ad4
|
[Docs] Remove broken link to deleted disaggregated_prefill.sh (#44929)
Signed-off-by: Lanze Liu <lanzetech@gmail.com>
|
2026-06-09 01:40:06 +00:00 |
|
|
|
e2f993dc41
|
[WideEP] Integrate DeepEP v2 (#41183)
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
|
2026-06-08 18:07:29 -07:00 |
|
|
Andreas KaratzasandGitHub
|
05cb606cad
|
[ROCm][CI] Re-route NixlConnector jobs (#44809)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
|
2026-06-08 18:57:11 -05:00 |
|
|
|
3f627ebef7
|
[Misc] usage_stats: report more engine, spec-decode, and EP config (#44595)
Signed-off-by: Zach Xi <zachary.xi@gmail.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-06-08 15:20:00 -07:00 |
|
|
Bugen ZhaoandGitHub
|
bc941f375d
|
[Rust Frontend] [Refactor] Refine utility call interfaces (#44856)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-06-08 15:13:08 -07:00 |
|
|
Michael GoinandGitHub
|
6afa25000c
|
[Bugfix] Canonicalize FP8 weight layout to (K, N) at the source (#44735)
Signed-off-by: mgoin <mgoin64@gmail.com>
|
2026-06-08 14:37:36 -06:00 |
|
|
Mohammad Miadh AngkadandGitHub
|
823a0ab754
|
[Bugfix][MoE] Fix fused MoE expert mapping helper call sites (#44897)
Signed-off-by: Mohammad Miadh Angkad <176301910+mmangkad@users.noreply.github.com>
|
2026-06-08 13:35:04 -07:00 |
|
|
Wentao YeandGitHub
|
2c27c294c0
|
[Model Runner V2] Fix mrv2 mm lora issue (#44450)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
|
2026-06-08 14:30:09 -04:00 |
|
|
|
ba94a3b998
|
[Attention] Extract KV-cache update from CPU attention backend (#40470)
Signed-off-by: Diego Maniloff <diego.maniloff@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
|
2026-06-08 15:43:05 +00:00 |
|
|
bnellnmandGitHub
|
dc68bd8c41
|
[MoE Refactor] FusedMoE/MoERunner inversion refactor (#41184)
Signed-off-by: Bill Nell <bnell@redhat.com>
|
2026-06-08 10:42:58 -04:00 |
|
|
|
753e9d55e6
|
[Quantization] add online fp8 ptpc (#44132)
Signed-off-by: walterbm <walter.beller.morales@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-06-08 22:42:11 +08:00 |
|
|
akii96andGitHub
|
ac3409d162
|
[Benchmark] Auto-detect and correct client/server tokenizer mismatch for random dataset (#44708)
|
2026-06-08 06:10:20 -07:00 |
|
|
wang.yuqiandGitHub
|
93ee4cd47f
|
[CI] Consolidate multimodal entrypoint tests. (#44819)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
|
2026-06-08 04:48:08 -07:00 |
|
|
Li, JiangandGitHub
|
980796cd07
|
[CI/Build][CPU] Fix flaky CI image build failure and unexpected warnings (#44852)
Signed-off-by: jiang1.li <jiang1.li@intel.com>
|
2026-06-08 11:10:06 +00:00 |
|
|
Nicolò LucchesiandGitHub
|
5add018beb
|
[Connector] Remove P2pNcclConnector (#44854)
Signed-off-by: NickLucche <nlucches@redhat.com>
|
2026-06-08 18:58:29 +08:00 |
|
|
|
d5fe994e79
|
[CPU][Spec Decode] Warn about throughput loss when libiomp5 is not preloaded (#44419)
Signed-off-by: jmamou <jonathan.mamou@intel.com>
Signed-off-by: Jonathan Mamou <jonathan.mamou@intel.com>
Co-authored-by: Li, Jiang <bigpyj64@gmail.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
|
2026-06-08 03:45:08 -07:00 |
|
|
Chaojun ZhangandGitHub
|
fa662b1a8b
|
[XPU] Cap topk/topp Triton BLOCK_SIZE to 4096 to fix Top-p mask difference failures (#44470)
Signed-off-by: Chaojun Zhang <chaojun.zhang@intel.com>
|
2026-06-08 09:36:51 +00:00 |
|