|
1aad125815
|
[CPU] Enable chunked prefill and prefix caching for qwen3.5 (#46202)
Signed-off-by: Li, Tianmu <tianmu.li@intel.com>
Co-authored-by: Claude Sonnet 4.6 (1M context) <noreply@anthropic.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
|
2026-06-25 03:49:21 +00:00 |
|
|
|
dc55936f64
|
[AMD][CI] Fix Pipeline + Context Parallelism test group (#46650)
Signed-off-by: aarushjain29 <Aarushi.Jain2@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-06-24 22:23:42 -05:00 |
|
|
Bugen ZhaoandGitHub
|
76c3c4ff63
|
[Rust Frontend] Introduce unified parser interface & combined parser (#46583)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-06-25 03:17:31 +00:00 |
|
|
|
efb5acffd5
|
[Bugfix] fix: stream Mimimax m2 tool call string arguments (#46382)
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Flora Feng <4florafeng@gmail.com>
|
2026-06-25 03:12:45 +00:00 |
|
|
|
6e3a983cf3
|
[ROCm] Remove erroneous inclusion of gptq_marlin as supported quant scheme on ROCm (#46655)
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-06-24 21:27:19 -05:00 |
|
|
Xin YangandGitHub
|
1273a8f05a
|
[Kernel] Add swap AB optimization to fused_moe_kernel (#36559)
Signed-off-by: Xin Yang <xyangx@amazon.com>
|
2026-06-25 01:44:30 +00:00 |
|
|
|
9e88e969c0
|
[Perf][KVConnector][Mooncake] Parallelize KV load with a receive-thread pool (#45971)
Signed-off-by: Yifan Qiao <yifanqiao@inferact.ai>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-06-24 18:25:12 -07:00 |
|
|
|
dda3aca47f
|
[Speculative Decoding] Propagate norm_output and fc_norm config for Eagle3 speculators (#46488)
Signed-off-by: Orestis Zambounis <orestis.zambounis@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-06-25 00:51:33 +00:00 |
|
|
Jee Jee LiandGitHub
|
23aed9b0ee
|
[Kernel] Enable PDL for per_token_group_quant_8bit_kernel (#46508)
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
|
2026-06-25 08:42:51 +08:00 |
|
|
Maxwill LinandGitHub
|
cd347298e8
|
[Frontend] Port seed_oss to the streaming parser engine as a Qwen3 subclass (#46314)
Signed-off-by: EazyReal <8047065+EazyReal@users.noreply.github.com>
|
2026-06-24 20:08:42 -04:00 |
|
|
Yifan QiaoandGitHub
|
b69816043a
|
[Bugfix][MooncakeStore] track resumed requests via scheduler's resumed_req_ids (#46595)
Signed-off-by: Yifan Qiao <yifanqiao@inferact.ai>
|
2026-06-24 23:50:56 +00:00 |
|
|
Kaihang JiangandGitHub
|
fc7fc421e9
|
[Kernel][MoE] Allow FlashInfer MXINT4 MoE for gated SiLU (#46518)
Signed-off-by: Kaihang Jiang <kaihangj@nvidia.com>
|
2026-06-24 18:32:50 -05:00 |
|
|
cyqandGitHub
|
e06a83445c
|
[Bugfix] Normalize slashes in Helion GPU names (#46101)
Signed-off-by: cyq <15000851237@163.com>
|
2026-06-24 18:22:49 -05:00 |
|
|
|
d7ab9be775
|
[Bugfix] Support -1 (invalid/non-local) slots in topk_ids for Triton MoE (#46408)
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-06-24 13:59:42 -07:00 |
|
|
|
6a1570711c
|
[Bugfix] Support non-power-of-2 top_k in legacy triton_kernels routing (#46406)
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-06-24 13:52:09 -07:00 |
|
|
Micah WilliamsonandGitHub
|
d6696e2385
|
[ROCm] Begin Deprecation Window for CUDA_VISIBLE_DEVICES on ROCm (#46636)
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
|
2026-06-24 20:40:28 +00:00 |
|
|
ChaunceyandGitHub
|
84c2f9f0fb
|
[Frontend] Fix Kimi K2 tool call IDs for required tool choice (#46344)
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
|
2026-06-24 19:59:40 +00:00 |
|
|
|
49f2104c53
|
[Feature] Support DCP with FP8 KV cache in MLA decode path (#44044)
Signed-off-by: shivampr <shivampr.dev@gmail.com>
Signed-off-by: Shivam <shivamprasad91@gmail.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-06-24 19:28:17 +00:00 |
|
|
|
d511b5bae9
|
Chore: Fix minor doc sentence, grammar, quote errors (#40469)
Signed-off-by: Ashwin Phadke <23502062+ashwin-phadke@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-06-24 18:58:24 +00:00 |
|
|
|
3c43237233
|
[Bugfix][Model Runner V2][Spec Decode] Fix int32 offset overflow in sampler kernels (#46560)
Signed-off-by: xiaojun.wei <jessiewei747@gmail.com>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
|
2026-06-24 11:00:57 -07:00 |
|
|
|
56ca5997ea
|
Humming support for 2/3/5/6/7-bit pack-quantized weight-only inference (#46389)
Signed-off-by: HDCharles <charlesdavidhernandez@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
|
2026-06-24 13:53:54 -04:00 |
|
|
Aarushi JainandGitHub
|
cf57311187
|
Run DeepSeek-V2-Lite prefetch-offload eval eager on ROCm (#46386)
Signed-off-by: aarushjain29 <Aarushi.Jain2@amd.com>
|
2026-06-24 12:25:57 -05:00 |
|
|
Lucas WilkinsonandGitHub
|
e7df232288
|
[KV Offload] Gate packed HMA KV cache on cross-layer config (#46252)
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
|
2026-06-24 11:55:30 -04:00 |
|
|
|
b3a688cb9e
|
[ROCm] Fix OOB During Model Warmup With ROCM_ATTN and MRV2 (#46548)
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
Signed-off-by: Matthew Wong <Matthew.Wong2@amd.com>
Co-authored-by: Matthew Wong <Matthew.Wong2@amd.com>
|
2026-06-24 10:53:21 -05:00 |
|
|
Wentao YeandGitHub
|
1cd3e0e945
|
[Bug] Fix IndentationError: expected an indented block after 'with' statement (#46627)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
|
2026-06-24 23:14:17 +08:00 |
|
|
Yiwei HuandGitHub
|
f889325c51
|
[KV Offload] Use background thread for mmap / cpu_tensors pinning (#45850)
Signed-off-by: Sorryhorizon <arikara6666@gmail.com>
|
2026-06-24 18:13:27 +03:00 |
|
|
|
bb61177e49
|
[KV Offloading] Replace bool|None lookup return with LookupResult enum (#46363)
Signed-off-by: Ronen Schaffer <ronen.schaffer@ibm.com>
Co-authored-by: Or Ozeri <oro@il.ibm.com>
|
2026-06-24 18:06:08 +03:00 |
|
|
|
7f99e80c3b
|
[Perf][ThinkingBudget] reduce search space for thinking tokens (#46425)
Signed-off-by: walterbm <walter.beller.morales@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-06-24 23:02:25 +08:00 |
|
|
|
2801b11156
|
[Test] Pin block_size in auto-fit max_model_len test (#45914)
Signed-off-by: Ma, Liangliang <liangliang.ma@intel.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-06-24 22:56:21 +08:00 |
|
|
|
007b5a52ed
|
[Log] Update to log once (#46511)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
|
2026-06-24 14:45:16 +00:00 |
|
|
Cyrus LeungandGitHub
|
24d5186138
|
[Bugfix] Re-enable FP8 MoE on NVIDIA Thor (#46339)
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
|
2026-06-24 07:35:46 -07:00 |
|
|
Nemani Harsha VardhanandGitHub
|
7dc036058b
|
[Doc] Document Qwen3.6 (dense + MoE) ViT CUDA graph support (#44720)
Signed-off-by: harsha20032020 <nhvardhan2020@gmail.com>
|
2026-06-24 14:35:08 +00:00 |
|
|
|
61ee183d28
|
[ROCm] Fix AITER FP8 quantization schema tests (#46414)
Signed-off-by: Djordje Ramic <djoramic@amd.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-06-24 22:29:19 +08:00 |
|
|
|
84c62e1cbd
|
[Model Runner V2][MM] Support EVS (#46535)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-06-24 10:18:56 -04:00 |
|
|
Fadi ArafehandGitHub
|
061043eaca
|
[CPU][Perf] Accelerate unquantized MoE for AArch64 (#46353)
Signed-off-by: Fadi Arafeh <fadi.arafeh@arm.com>
|
2026-06-24 14:14:35 +00:00 |
|
|
|
93ec645878
|
[Bugfix] Fix illegal memory access from a forward during a partial wake_up (#44483)
Signed-off-by: Meihan-chen <zr010426ztt@outlook.com>
Signed-off-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
|
2026-06-24 22:12:23 +08:00 |
|
|
Kunshang JiandGitHub
|
563c628968
|
[XPU] bump up vllm_xpu_kernels to v0.1.10.1 (#46607)
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-06-24 10:05:31 -04:00 |
|
|
|
0bc479e6eb
|
[Perf][LoRA] Replace O(n) list.index() with a dict in convert_mapping (#46542)
Signed-off-by: Lynn <lynnhe02@gmail.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-06-24 21:41:46 +08:00 |
|
|
Tae JeongandGitHub
|
62890e204c
|
Fix duplicated logging when loading a corrupt or partial video (#46467)
Signed-off-by: hhhhhhhhhhhhhhhhho <man2719@naver.com>
|
2026-06-24 06:14:13 -07:00 |
|
|
Nicolò LucchesiandGitHub
|
a2cb08b3d5
|
[Misc][PD] Disable bidirectional xfer mode for NixlPushConnector (#46473)
Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai>
|
2026-06-24 21:14:05 +08:00 |
|
|
|
cf9fd6457e
|
Fix KV offload request-finished lifecycle contract (#46284)
Signed-off-by: test test <2260891073@qq.com>
Signed-off-by: Rui Yin <2260891073@qq.com>
Co-authored-by: Or Ozeri <oro@il.ibm.com>
|
2026-06-24 15:42:40 +03:00 |
|
|
Kunshang JiandGitHub
|
d4448b511d
|
[XPU][Docker] switch to ubuntu 24.04 as base image (#45973)
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-06-24 20:39:20 +08:00 |
|
|
|
f1a6703edd
|
[Bugfix][Config] Keep pydantic validation for fields with a TYPE_CHECKING Literal alias (#46220)
Signed-off-by: Ting Sun <suntcrick@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-06-24 12:25:50 +00:00 |
|
|
Roy WangandGitHub
|
160c80a34c
|
[Rust Frontend] Raise frontend JSON body limit (#46582)
Signed-off-by: esmeetu <jasonailu87@gmail.com>
|
2026-06-24 12:15:31 +00:00 |
|
|
Martin HickeyandGitHub
|
f237e16b41
|
[KV Offload] Replace OffloadingHandler with OffloadingWorker (#45053)
Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com>
|
2026-06-24 14:44:24 +03:00 |
|
|
|
70749fdcca
|
[Feature] Triton INT4 per-token-head KV cache quantization (#40835)
Signed-off-by: JartX <sagformas@epdcenter.es>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-06-24 10:21:25 +00:00 |
|
|
|
d20dbf921b
|
[Mooncake] Only check and store new KV cache range (#46412)
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
Signed-off-by: Yifan Qiao <yifanqiao@inferact.ai>
Co-authored-by: Yifan Qiao <yifanqiao@inferact.ai>
|
2026-06-24 03:10:50 -07:00 |
|
|
|
ede54b926e
|
set AttentionCGSupport.UNIFORM_BATCH for fa2 on xpu (#46555)
Signed-off-by: Xinyu Chen <xinyu1.chen@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-06-24 18:05:02 +08:00 |
|
|
|
52fbe12283
|
[Perf][Multimodal] Avoid building a full timestamps list in video frame sampling (#46543)
Signed-off-by: Lynn <lynnhe02@gmail.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-06-24 09:38:27 +00:00 |
|
|
Dakai AnandGitHub
|
dc0d318177
|
[Attention] Add FLASH_ATTN_MLA_SPARSE backend for Hopper sparse MLA (#46189)
Signed-off-by: Dakai An <dakaian108@gmail.com>
|
2026-06-24 09:33:10 +00:00 |
|