 yewentao256
|
69b33fe11e
|
reduce mrv2 code change
Signed-off-by: yewentao256 <zhyanwentao@126.com>
|
2026-07-23 15:04:11 +00:00 |
|
|
yewentao256
|
251c90ee90
|
reduce mrv2 change
Signed-off-by: yewentao256 <zhyanwentao@126.com>
|
2026-07-23 14:47:27 +00:00 |
|
|
yewentao256
|
d7e63e8f69
|
update
Signed-off-by: yewentao256 <zhyanwentao@126.com>
|
2026-07-22 21:10:24 +00:00 |
|
|
yewentao256
|
a23f528b81
|
Merge branch 'main' into wentao-epd-support-for-MRv2
Signed-off-by: yewentao256 <zhyanwentao@126.com>
|
2026-07-22 18:48:47 +00:00 |
|
|
|
b44311b6ef
|
[CI] stabilize GDN prefill CuTeDSL test (#49388)
Signed-off-by: Thien Tran <gau.nernst@yahoo.com.sg>
Co-authored-by: Codex <noreply@openai.com>
|
2026-07-22 09:03:46 -07:00 |
|
|
Nick HillandGitHub
|
b0d7875180
|
[CI] Increase timeout of pytorch-compilation-unit-tests (#49450)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
|
2026-07-22 15:39:09 +00:00 |
|
|
Divakar VermaandGitHub
|
53c2f20dd9
|
[ROCm][CI] skip moe weight padding for eplb (#49350)
Signed-off-by: Divakar Verma <divakar.verma@amd.com>
|
2026-07-22 10:18:01 -05:00 |
|
|
Wentao YeandGitHub
|
37e370fe93
|
[DSv4 Perf] Skip empty c128 kernel launch, around 2x kernel performance improvement. (#48957)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
|
2026-07-22 10:55:20 -04:00 |
|
|
Guan-Ming ChiuandGitHub
|
2dc5a72e7e
|
[Bugfix][Renderer] Rebuild vision chunk UUIDs in async render path (#49400)
Signed-off-by: Guan-Ming (Wesley) Chiu <105915352+guan404ming@users.noreply.github.com>
|
2026-07-22 14:11:24 +00:00 |
|
|
Andrey TalmanandGitHub
|
c79ff5f918
|
[Build] Bump vllm-flash-attn to C++20-compatible commit for torch-nightly (#49326)
Signed-off-by: Andrey Talman <atalman@fb.com>
|
2026-07-22 13:51:59 +00:00 |
|
|
Teresa ChenandGitHub
|
1a659a0c37
|
Upgrade tpu-inference to v0.25.0 (#49431)
|
2026-07-22 11:52:56 +00:00 |
|
|
SageandGitHub
|
0f6cf7f628
|
[Rust Frontend] Extract request preparation from the inference path (#49045)
Signed-off-by: Sage Ahrac <sagiahrak@gmail.com>
|
2026-07-22 11:31:36 +00:00 |
|
|
|
c79ad3ae21
|
[Rust Frontend][gRPC] Add abort control RPC (#49255)
Co-authored-by: OpenAI Codex <codex@openai.com>
Signed-off-by: Connor Carpenter <connorc@nvidia.com>
|
2026-07-22 11:31:01 +00:00 |
|
|
wang.yuqiandGitHub
|
61c9ef986a
|
[Frontend] Parallelize preprocessing within the same request for pooling models online serving. (#49153)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
|
2026-07-22 10:56:23 +00:00 |
|
|
LiangqiusongandGitHub
|
d6dbdb9b0d
|
[XPU] WA of topk_softplus_sqrt arg mismatch on XPU (#49408)
Signed-off-by: xiaolong <xiaolong.guo@intel.com>
|
2026-07-22 16:16:13 +08:00 |
|
|
liuzhenweiandGitHub
|
06da482fb4
|
[XPU] WA of topk_softmax arg mismatch on XPU (#49395)
Signed-off-by: zhenwei-intel <zhenwei.liu@intel.com>
|
2026-07-22 01:05:01 -07:00 |
|
|
|
2f75e7f712
|
[CI] Increase timeouts for jobs exceeding current limits (#49374)
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-07-22 00:16:16 -07:00 |
|
|
Ziming HuangandGitHub
|
7c21548ce3
|
[PD][Bugfix] Fix NIXL hybrid MLA+mamba heterogeneous TP (#49297)
Signed-off-by: ZeldaHuang <zelda.huanghuang@gmail.com>
|
2026-07-22 07:11:39 +00:00 |
|
|
Guan-Ming ChiuandGitHub
|
9df2f91232
|
[Renderer] Offload derender CPU work to renderer thread pool (#49396)
Signed-off-by: Guan-Ming (Wesley) Chiu <105915352+guan404ming@users.noreply.github.com>
|
2026-07-22 06:55:03 +00:00 |
|
|
|
387189c429
|
[ROCm] Remove redundant AITER fused_qk_rmsnorm probe (avoids config-time HIP init) (#47992)
Signed-off-by: Stefan Koncarevic <stefan.koncarevic@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-07-21 22:58:14 -05:00 |
|
|
Kunshang JiandGitHub
|
75576c63be
|
Add auto label for xpu relate issue (#49398)
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-07-22 03:33:20 +00:00 |
|
|
Andreas KaratzasandGitHub
|
16aca639b7
|
[ROCm] Upgrade NIXL and UCX (#49251)
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
|
2026-07-21 22:30:02 -05:00 |
|
|
Woosuk KwonandGitHub
|
6049424b7e
|
[MRV2] Always build attn metadata at capture time (#49364)
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
|
2026-07-21 19:27:16 -07:00 |
|
|
|
060b5f61dc
|
[Bugfix][Attention] Ignore empty MLA context chunks during merge (#49294)
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-07-22 02:23:48 +00:00 |
|
|
|
ec59c1579f
|
[MoE Refactor] Migrate MoeWNA16Method quantization method over to using the new MK oracle scheme. (#44120)
Signed-off-by: Bill Nell <bnell@redhat.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
|
2026-07-21 19:20:30 -07:00 |
|
|
Isotr0pyandGitHub
|
1750e443f2
|
[Misc] Move PyNvVideoCodec stuff out of gpu worker (#49322)
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
|
2026-07-22 10:11:56 +08:00 |
|
|
|
ba18929079
|
[Bugfix][SpecDecode] Scope MTP completeness checks outside bucketed updates (#49178)
Signed-off-by: aoshen02 <aoshen02@users.noreply.github.com>
Co-authored-by: aoshen02 <aoshen02@users.noreply.github.com>
|
2026-07-21 18:56:39 -07:00 |
|
|
|
0500ca6a58
|
[CI][Bugfix] Fix ROCm FP8 KV cache dtype in attention backend test (#49380)
Signed-off-by: pei.zhang <pei.zhang@amd.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-07-22 01:34:49 +00:00 |
|
|
|
a1c15bcb0f
|
[CI][Bugfix] Fix and wire streaming-input tests (#49356)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-07-22 00:35:23 +00:00 |
|
|
Nick HillandGitHub
|
4809de7317
|
[Misc] Fix terminal output logo coloring (#49344)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
|
2026-07-22 00:21:29 +00:00 |
|
|
stefankoncarevicandGitHub
|
05781e21dd
|
[ROCm][CI] Fix order-dependent failure in test_flash_attn_accepts_handled_fp8_variants (MI355) (#49329)
Signed-off-by: Stefan Koncarevic <Stefan.Koncarevic@amd.com>
|
2026-07-21 18:54:33 -05:00 |
|
|
gnovackandGitHub
|
85f638a2b8
|
skip cudagraph/DP padding in topk (#48979)
Signed-off-by: gnovack <novackgm@gmail.com>
|
2026-07-21 15:20:30 -07:00 |
|
|
Nick HillandGitHub
|
08e5067561
|
[CI] Bump timeout of entrypoints-integration-api-server-openai-part-2 (#49359)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
|
2026-07-21 14:54:03 -07:00 |
|
|
|
a7d00ec051
|
[Bugfix] DFlash fc sized wrong when num_target_layers != num_hidden_layers (#48524)
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Codex <noreply@openai.com>
|
2026-07-21 14:42:52 -07:00 |
|
|
Michael GoinandGitHub
|
b8fb56d970
|
[CI] Add gemma-4-E4B-it-assistant to CI gsm8k for GemmaMTP (#49243)
Signed-off-by: mgoin <mgoin64@gmail.com>
|
2026-07-21 16:51:04 -04:00 |
|
|
|
96a739289e
|
[Bugfix] fix cutalss version upgrade bug, need update MSG new commit (#49016)
Signed-off-by: lengrongfu <lenronfu@gmail.com>
Co-authored-by: Yongye Zhu <zyy1102000@gmail.com>
|
2026-07-21 13:42:14 -07:00 |
|
|
|
60d443f738
|
[CI/Build][The Rock][BugFix] Use fork method in test_multiproc_executor_multi_node for py 3.14 compat and fix test_multiproc_executor_shutdown_cleanup (#48655)
Signed-off-by: Randall Smith <Randall.Smith@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-07-21 15:40:29 -05:00 |
|
|
|
1dca300653
|
[CI] Fix and wire encoder/manager cudagraph unit tests (#49339)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-07-21 20:41:16 +01:00 |
|
|
Flora FengandGitHub
|
fca252d59e
|
[CI][Bugfix] Reduce max_model_len in OOT embedding test to fix KV-cache OOM on small GPUs (#49351)
Signed-off-by: sfeng33 <4florafeng@gmail.com>
|
2026-07-21 15:00:06 -04:00 |
|
|
|
33178f9006
|
Fix Qwen3-VL M-RoPE on the Transformers modeling backend (grids + compile) (#49292)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-07-21 18:28:39 +00:00 |
|
|
|
b2b8f679d0
|
[Bugfix][Spec Decode] Restrict embedding-width share guard to EAGLE drafts (#47953)
Signed-off-by: Evan Takahashi <evan10takahashi@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
|
2026-07-21 10:53:37 -07:00 |
|
|
|
de6ec294ef
|
[Bugfix] Fix DSA crash under breakable piecewise cudagraphs (#49302)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-07-21 18:28:13 +01:00 |
|
|
stefankoncarevicandGitHub
|
61e10f0116
|
[ROCm][CI] Fix AITER MLA fp8 decode metadata regression test (#48845)
Signed-off-by: Stefan Koncarevic <Stefan.Koncarevic@amd.com>
|
2026-07-21 12:19:45 -05:00 |
|
|
|
6e96891ba0
|
[ROCm] Bump AITER to v0.1.16.post5 (#48683)
Signed-off-by: Fangzhou Ai <fangzhouai@gmail.com>
Signed-off-by: Fangzhou Ai <31551580+Fangzhou-Ai@users.noreply.github.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-07-21 10:39:11 -05:00 |
|
|
|
47f1b47a73
|
Ci/add laguna xs gsm8k (#49241)
Signed-off-by: Joe Rowell <joerowell4@gmail.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Joe Rowell <joerowell4@gmail.com>
|
2026-07-21 11:30:42 -04:00 |
|
|
|
5aab491bc9
|
[CI] Wire tests/models/inkling into a B200 job (#49325)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-07-21 15:43:20 +01:00 |
|
|
|
5812e1a66b
|
[Test] Add DeepSeek MTP parallel-load tests (#41653)
Signed-off-by: Stefano Castagnetta <scastagnetta@nvidia.com>
Co-authored-by: Benjamin Chislett <bchislett@nvidia.com>
|
2026-07-21 10:38:20 -04:00 |
|
|
|
8950394e0a
|
[Bugfix] Prefix-cache metrics double-counted when a KV connector defers requests (#48860)
Signed-off-by: Seiji Eicher <58963096+eicherseiji@users.noreply.github.com>
Signed-off-by: Seiji Eicher <seiji@anyscale.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Lixi Zhang <muxixibbb@gmail.com>
Co-authored-by: harjothkhara <harjoth.khara@gmail.com>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
|
2026-07-21 15:02:03 +01:00 |
|
|
Roberto L. CastroandGitHub
|
7bb49be4d1
|
[Bugfix] Handle MLA fallback during FA4 JIT warmup (#49306)
|
2026-07-21 13:58:05 +00:00 |
|
|
|
c67650f04b
|
[XPU][DeepSeekV4]Add DeepSeek-V4 fuse_index_q SYCL kernel path (#45991)
Signed-off-by: Avery Miao <avery.miao@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-07-21 21:22:34 +08:00 |
|