 Teresa ChenandGitHub
|
1a659a0c37
|
Upgrade tpu-inference to v0.25.0 (#49431)
|
2026-07-22 11:52:56 +00:00 |
|
|
SageandGitHub
|
0f6cf7f628
|
[Rust Frontend] Extract request preparation from the inference path (#49045)
Signed-off-by: Sage Ahrac <sagiahrak@gmail.com>
|
2026-07-22 11:31:36 +00:00 |
|
|
|
c79ad3ae21
|
[Rust Frontend][gRPC] Add abort control RPC (#49255)
Co-authored-by: OpenAI Codex <codex@openai.com>
Signed-off-by: Connor Carpenter <connorc@nvidia.com>
|
2026-07-22 11:31:01 +00:00 |
|
|
wang.yuqiandGitHub
|
61c9ef986a
|
[Frontend] Parallelize preprocessing within the same request for pooling models online serving. (#49153)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
|
2026-07-22 10:56:23 +00:00 |
|
|
LiangqiusongandGitHub
|
d6dbdb9b0d
|
[XPU] WA of topk_softplus_sqrt arg mismatch on XPU (#49408)
Signed-off-by: xiaolong <xiaolong.guo@intel.com>
|
2026-07-22 16:16:13 +08:00 |
|
|
liuzhenweiandGitHub
|
06da482fb4
|
[XPU] WA of topk_softmax arg mismatch on XPU (#49395)
Signed-off-by: zhenwei-intel <zhenwei.liu@intel.com>
|
2026-07-22 01:05:01 -07:00 |
|
|
|
2f75e7f712
|
[CI] Increase timeouts for jobs exceeding current limits (#49374)
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-07-22 00:16:16 -07:00 |
|
|
Ziming HuangandGitHub
|
7c21548ce3
|
[PD][Bugfix] Fix NIXL hybrid MLA+mamba heterogeneous TP (#49297)
Signed-off-by: ZeldaHuang <zelda.huanghuang@gmail.com>
|
2026-07-22 07:11:39 +00:00 |
|
|
Guan-Ming ChiuandGitHub
|
9df2f91232
|
[Renderer] Offload derender CPU work to renderer thread pool (#49396)
Signed-off-by: Guan-Ming (Wesley) Chiu <105915352+guan404ming@users.noreply.github.com>
|
2026-07-22 06:55:03 +00:00 |
|
|
|
387189c429
|
[ROCm] Remove redundant AITER fused_qk_rmsnorm probe (avoids config-time HIP init) (#47992)
Signed-off-by: Stefan Koncarevic <stefan.koncarevic@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-07-21 22:58:14 -05:00 |
|
|
Kunshang JiandGitHub
|
75576c63be
|
Add auto label for xpu relate issue (#49398)
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-07-22 03:33:20 +00:00 |
|
|
Andreas KaratzasandGitHub
|
16aca639b7
|
[ROCm] Upgrade NIXL and UCX (#49251)
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
|
2026-07-21 22:30:02 -05:00 |
|
|
Woosuk KwonandGitHub
|
6049424b7e
|
[MRV2] Always build attn metadata at capture time (#49364)
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
|
2026-07-21 19:27:16 -07:00 |
|
|
|
060b5f61dc
|
[Bugfix][Attention] Ignore empty MLA context chunks during merge (#49294)
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-07-22 02:23:48 +00:00 |
|
|
|
ec59c1579f
|
[MoE Refactor] Migrate MoeWNA16Method quantization method over to using the new MK oracle scheme. (#44120)
Signed-off-by: Bill Nell <bnell@redhat.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
|
2026-07-21 19:20:30 -07:00 |
|
|
Isotr0pyandGitHub
|
1750e443f2
|
[Misc] Move PyNvVideoCodec stuff out of gpu worker (#49322)
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
|
2026-07-22 10:11:56 +08:00 |
|
|
|
ba18929079
|
[Bugfix][SpecDecode] Scope MTP completeness checks outside bucketed updates (#49178)
Signed-off-by: aoshen02 <aoshen02@users.noreply.github.com>
Co-authored-by: aoshen02 <aoshen02@users.noreply.github.com>
|
2026-07-21 18:56:39 -07:00 |
|
|
|
0500ca6a58
|
[CI][Bugfix] Fix ROCm FP8 KV cache dtype in attention backend test (#49380)
Signed-off-by: pei.zhang <pei.zhang@amd.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-07-22 01:34:49 +00:00 |
|
|
|
a1c15bcb0f
|
[CI][Bugfix] Fix and wire streaming-input tests (#49356)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-07-22 00:35:23 +00:00 |
|
|
Nick HillandGitHub
|
4809de7317
|
[Misc] Fix terminal output logo coloring (#49344)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
|
2026-07-22 00:21:29 +00:00 |
|
|
stefankoncarevicandGitHub
|
05781e21dd
|
[ROCm][CI] Fix order-dependent failure in test_flash_attn_accepts_handled_fp8_variants (MI355) (#49329)
Signed-off-by: Stefan Koncarevic <Stefan.Koncarevic@amd.com>
|
2026-07-21 18:54:33 -05:00 |
|
|
gnovackandGitHub
|
85f638a2b8
|
skip cudagraph/DP padding in topk (#48979)
Signed-off-by: gnovack <novackgm@gmail.com>
|
2026-07-21 15:20:30 -07:00 |
|
|
Nick HillandGitHub
|
08e5067561
|
[CI] Bump timeout of entrypoints-integration-api-server-openai-part-2 (#49359)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
|
2026-07-21 14:54:03 -07:00 |
|
|
|
a7d00ec051
|
[Bugfix] DFlash fc sized wrong when num_target_layers != num_hidden_layers (#48524)
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Codex <noreply@openai.com>
|
2026-07-21 14:42:52 -07:00 |
|
|
Michael GoinandGitHub
|
b8fb56d970
|
[CI] Add gemma-4-E4B-it-assistant to CI gsm8k for GemmaMTP (#49243)
Signed-off-by: mgoin <mgoin64@gmail.com>
|
2026-07-21 16:51:04 -04:00 |
|
|
|
96a739289e
|
[Bugfix] fix cutalss version upgrade bug, need update MSG new commit (#49016)
Signed-off-by: lengrongfu <lenronfu@gmail.com>
Co-authored-by: Yongye Zhu <zyy1102000@gmail.com>
|
2026-07-21 13:42:14 -07:00 |
|
|
|
60d443f738
|
[CI/Build][The Rock][BugFix] Use fork method in test_multiproc_executor_multi_node for py 3.14 compat and fix test_multiproc_executor_shutdown_cleanup (#48655)
Signed-off-by: Randall Smith <Randall.Smith@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-07-21 15:40:29 -05:00 |
|
|
|
1dca300653
|
[CI] Fix and wire encoder/manager cudagraph unit tests (#49339)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-07-21 20:41:16 +01:00 |
|
|
Flora FengandGitHub
|
fca252d59e
|
[CI][Bugfix] Reduce max_model_len in OOT embedding test to fix KV-cache OOM on small GPUs (#49351)
Signed-off-by: sfeng33 <4florafeng@gmail.com>
|
2026-07-21 15:00:06 -04:00 |
|
|
|
33178f9006
|
Fix Qwen3-VL M-RoPE on the Transformers modeling backend (grids + compile) (#49292)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-07-21 18:28:39 +00:00 |
|
|
|
b2b8f679d0
|
[Bugfix][Spec Decode] Restrict embedding-width share guard to EAGLE drafts (#47953)
Signed-off-by: Evan Takahashi <evan10takahashi@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
|
2026-07-21 10:53:37 -07:00 |
|
|
|
de6ec294ef
|
[Bugfix] Fix DSA crash under breakable piecewise cudagraphs (#49302)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-07-21 18:28:13 +01:00 |
|
|
stefankoncarevicandGitHub
|
61e10f0116
|
[ROCm][CI] Fix AITER MLA fp8 decode metadata regression test (#48845)
Signed-off-by: Stefan Koncarevic <Stefan.Koncarevic@amd.com>
|
2026-07-21 12:19:45 -05:00 |
|
|
|
6e96891ba0
|
[ROCm] Bump AITER to v0.1.16.post5 (#48683)
Signed-off-by: Fangzhou Ai <fangzhouai@gmail.com>
Signed-off-by: Fangzhou Ai <31551580+Fangzhou-Ai@users.noreply.github.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-07-21 10:39:11 -05:00 |
|
|
|
47f1b47a73
|
Ci/add laguna xs gsm8k (#49241)
Signed-off-by: Joe Rowell <joerowell4@gmail.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Joe Rowell <joerowell4@gmail.com>
|
2026-07-21 11:30:42 -04:00 |
|
|
|
5aab491bc9
|
[CI] Wire tests/models/inkling into a B200 job (#49325)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-07-21 15:43:20 +01:00 |
|
|
|
5812e1a66b
|
[Test] Add DeepSeek MTP parallel-load tests (#41653)
Signed-off-by: Stefano Castagnetta <scastagnetta@nvidia.com>
Co-authored-by: Benjamin Chislett <bchislett@nvidia.com>
|
2026-07-21 10:38:20 -04:00 |
|
|
|
8950394e0a
|
[Bugfix] Prefix-cache metrics double-counted when a KV connector defers requests (#48860)
Signed-off-by: Seiji Eicher <58963096+eicherseiji@users.noreply.github.com>
Signed-off-by: Seiji Eicher <seiji@anyscale.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Lixi Zhang <muxixibbb@gmail.com>
Co-authored-by: harjothkhara <harjoth.khara@gmail.com>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
|
2026-07-21 15:02:03 +01:00 |
|
|
Roberto L. CastroandGitHub
|
7bb49be4d1
|
[Bugfix] Handle MLA fallback during FA4 JIT warmup (#49306)
|
2026-07-21 13:58:05 +00:00 |
|
|
|
c67650f04b
|
[XPU][DeepSeekV4]Add DeepSeek-V4 fuse_index_q SYCL kernel path (#45991)
Signed-off-by: Avery Miao <avery.miao@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-07-21 21:22:34 +08:00 |
|
|
|
f890e1dbe2
|
[BugFix] Set graph_pool_id before FULL CUDA graph capture in ModelRunner V2 (#48843)
Signed-off-by: Markov Ilya <markovilya19@gmail.com>
Co-authored-by: Markov Ilya <markovilya19@gmail.com>
|
2026-07-21 08:59:26 -04:00 |
|
|
Umut PolatandGitHub
|
040cbf95cc
|
[Misc] Use VLLMValidationError in chat completion tool and batch validators (#49214)
Signed-off-by: Umut Polat <52835619+umut-polat@users.noreply.github.com>
|
2026-07-21 11:38:20 +00:00 |
|
|
|
5b3762a7f0
|
[Bugfix][CPU] Fix Clang OpenMP build on macOS (#49021)
Signed-off-by: markyangcc <mmdou3@163.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
|
2026-07-21 09:58:52 +00:00 |
|
|
bastefaniakandGitHub
|
4d30c510ce
|
[bugfix] Fix Cosmos3 Edge checkpoint weights filtering, video loading, prompt expansion (#49190)
Signed-off-by: Bartosz Stefaniak <bstefaniak@nvidia.com>
|
2026-07-21 17:18:36 +08:00 |
|
|
|
6700813f86
|
[3/N][KV-Cache Layout Refactor] Standardize Mamba cache; drop get_transfer_cache_regions (#44456)
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-07-21 09:16:15 +00:00 |
|
|
Bugen ZhaoandGitHub
|
eb44b3aaa4
|
[Rust][Benchmark] Use async HTTP clients (#49295)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-07-21 16:53:57 +08:00 |
|
|
Nicolò LucchesiandGitHub
|
7a98c7a392
|
[Misc] Remove old now unsupported max_num_partial_prefills and max_long_partial_prefills (#49244)
Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai>
|
2026-07-21 08:52:52 +00:00 |
|
|
Lena OnyshchenkoandGitHub
|
0d9e60619b
|
[Misc][Docs] Fix XPU compute-runtime driver link version mismatch (#49299)
Signed-off-by: oonyshch <xonyshch@gmail.com>
|
2026-07-21 08:45:41 +00:00 |
|
|
|
1134545b6f
|
Revert "[Sampler] Stop upcasting logits to fp32 in apply_sampling_params" (#48641) (#49033)
Co-authored-by: vllm-agent <vllm-agent@users.noreply.github.com>
|
2026-07-21 09:36:45 +01:00 |
|
|
|
3e0c887511
|
[Bugfix] Fix Ovis2_5 special tokens for transformers v5 (#47298)
Signed-off-by: mgrunwal <milosz.grunwald@intel.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-07-21 08:09:20 +00:00 |
|