 Chinmay Kulkarni
|
200cbdd308
|
[ZenCPU] Changes with respect to docker build and relevant cpu tests
Signed-off-by: Chinmay Kulkarni <Chinmay.Kulkarni@amd.com>
|
2026-05-05 06:03:31 -06:00 |
|
|
|
98661fe012
|
[Bugfix][KVConnector] Support DCP/PCP in OffloadingConnector (#41549)
Signed-off-by: Itay Etelis <itay.etelis@ibm.com>
Co-authored-by: Itay Etelis <itay.etelis@ibm.com>
|
2026-05-05 14:54:29 +03:00 |
|
|
Harry MellorandGitHub
|
b0765bee17
|
Fix DeepSeek-OCR for Transformers v4 (#41460)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-05-05 11:11:21 +00:00 |
|
|
|
0a201b60cf
|
[Model] support Qianfan-OCR model (#40136)
Signed-off-by: bairongz <baiyuu.cs@gmail.com>
Signed-off-by: zhuangbairong <zhuangbairong@baidu.com>
Co-authored-by: zhuangbairong <zhuangbairong@baidu.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
2026-05-05 10:51:25 +00:00 |
|
|
|
8b9ea2f881
|
[Feature] Add Triton kernel JIT compilation monitor for inference (#40137)
Signed-off-by: Artem Perevedentsev <aperevedents@nvidia.com>
Co-authored-by: Jiangyun Zhu <riverclouds.zhu@qq.com>
|
2026-05-05 14:08:57 +04:00 |
|
|
Kunshang JiandGitHub
|
2ceea42958
|
[XPU] use xpu topk topp sample kernel (#39285)
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-05-05 18:05:17 +08:00 |
|
|
|
bee126165f
|
[P/D][Mooncake] Add KVConnectorStats for transfer observability (#40414)
Signed-off-by: Zhewen Li <zhewenli@inferact.ai>
Co-authored-by: Zhewen Li <zhewenli@inferact.ai>
|
2026-05-05 02:17:38 -07:00 |
|
|
BitTobyandGitHub
|
27cc676be3
|
[Model] Use AutoWeightsLoader for Plamo2 (#41699)
Signed-off-by: bittoby <218712309+bittoby@users.noreply.github.com>
|
2026-05-05 08:56:24 +00:00 |
|
|
|
4845aee6b7
|
[Benchmark] Add --trust-remote-code flag to multi-turn benchmark (#41661)
Signed-off-by: Dao Le <daole@inferact.ai>
Signed-off-by: Dao Le <Dao007forever@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-05-05 01:00:37 -07:00 |
|
|
BitTobyandGitHub
|
0c620d2e08
|
[Model] Use AutoWeightsLoader for CohereMoe (#41690)
Signed-off-by: bittoby <218712309+bittoby@users.noreply.github.com>
|
2026-05-05 04:44:15 +00:00 |
|
|
|
6bb924bbf3
|
[Model] Fix Gemma4 MoE activation mismatch (#41574)
Signed-off-by: Luciano Martins <lucianommartins@users.noreply.github.com>
Co-authored-by: Luciano Martins <lucianommartins@users.noreply.github.com>
|
2026-05-05 04:34:11 +00:00 |
|
|
czhu-cohereandGitHub
|
eaec7be446
|
[BugFix] Preserve max_seq_len in ubatch metadata during CUDA graph capture (#40961)
Signed-off-by: root <conway.zhu@cohere.com>
Signed-off-by: <conway.zhu@cohere.com>
|
2026-05-05 04:29:34 +00:00 |
|
|
Jeffrey WangandGitHub
|
f04fd1677b
|
[Ray] Enable RayExecutorV2 by default (#41421)
Signed-off-by: Jeffrey Wang <jeffreywang@anyscale.com>
|
2026-05-05 04:27:34 +00:00 |
|
|
|
420b0a5c95
|
[Hardware][Power]Add Power VSX Attention Backend and fix l2 Cache Crash (#40451)
Signed-off-by: Akash Kaothalkar <akashkaothalkar@akashs-mbp.bl1-in.ibm.com>
Signed-off-by: Akash Kaothalkar <akash.kaothalkar@ibm.com>
Signed-off-by: Akash kaothalkar <akash.kaothalkar@ibm.com>
Co-authored-by: Akash Kaothalkar <akashkaothalkar@akashs-mbp.bl1-in.ibm.com>
Co-authored-by: Akash Kaothalkar <akash.kaothalkar@ibm.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
|
2026-05-04 20:51:09 -07:00 |
|
|
Bowen BaoandGitHub
|
1e9500410a
|
[ROCm][Quantization][2/N] Refactor quark_moe w4a8 w/ oracle (#39136)
Signed-off-by: Bowen Bao <bowenbao@amd.com>
|
2026-05-04 19:50:38 -07:00 |
|
|
Nick HillandGitHub
|
416f9cdede
|
[Perf][2/n] Eliminate GPU<->CPU syncs in pooling code (#41433)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
|
2026-05-05 02:43:25 +00:00 |
|
|
|
685bf811d6
|
[XPU] enable is_act_and_mul for xpu (#37481)
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-05-05 01:07:39 +00:00 |
|
|
Giancarlo DelfinandGitHub
|
e1e4646b06
|
[Model Runner V2] Rebuild attn metadata between draft decode steps (#41162)
Signed-off-by: Giancarlo Delfin <gdelfin@inferact.ai>
|
2026-05-05 00:44:55 +00:00 |
|
|
|
4f2af1a7c0
|
[Feature] TurboQuant: support hybrid models and uniform quantization (#39931)
Signed-off-by: JartX <sagformas@epdcenter.es>
Signed-off-by: Jim Smith <jhsmith0@me.com>
Co-authored-by: Jim Smith <jhsmith0@me.com>
Co-authored-by: Sandermage <sandermage@users.noreply.github.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-05-04 20:14:01 -04:00 |
|
|
Wentao YeandGitHub
|
577b9623e6
|
[Bug] Fix status update address for non-MOE model within external dp mode (#40839)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
|
2026-05-04 16:37:16 -07:00 |
|
|
Andreas KaratzasandGitHub
|
1cb0838721
|
[ROCm][CI] Fix MLA prefill scale for DeepSeek GSM8K (#41569)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
|
2026-05-04 16:32:55 -07:00 |
|
|
Matthew BonanniandGitHub
|
be5983b874
|
[Docs] Add non-causal support to attention backend docs (#41643)
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
|
2026-05-04 20:35:15 +00:00 |
|
|
fxmarty-amdandGitHub
|
9c07342fdc
|
[NVFP4][fix] Fix layer.weight -> w13 typo in NVFP4 MOE emulation kernel preparation (#41630)
Signed-off-by: Felix Marty <Felix.Marty@amd.com>
|
2026-05-04 20:13:37 +00:00 |
|
|
|
844df54269
|
feat: update xgrammar==0.2.0 to use structural tags for strict tool calling + reasoning for more models (#40894)
Signed-off-by: Yuchuan <yuchuan.7streams@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Ubospica <ubospica@gmail.com>
Signed-off-by: sfeng33 <4florafeng@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Ubospica <ubospica@gmail.com>
Co-authored-by: sfeng33 <4florafeng@gmail.com>
|
2026-05-04 12:45:24 -07:00 |
|
|
|
422dd02598
|
[bugfix] Fix prompt logprobs on request eviction during chunked prefill (#41411)
Signed-off-by: Joachim Studnia <joachim@mistral.ai>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
|
2026-05-04 11:46:00 -07:00 |
|
|
|
8c780943b4
|
Fix Nano Nemotron text-only weight loading (#41205)
Signed-off-by: sunghoon.baek <sunghoon.baek@connectfy.cloud>
Signed-off-by: Baekpica <35071468+Baekpica@users.noreply.github.com>
Signed-off-by: sunghoon.baek <seanbb93@gmail.com>
Co-authored-by: sunghoon.baek <sunghoon.baek@connectfy.cloud>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Netanel Haber <58652339+netanel-haber@users.noreply.github.com>
|
2026-05-04 21:43:07 +03:00 |
|
|
|
e724b0ea8d
|
[ROCm] ROCm7.2.2 + profiler fix + AITER 0.1.12.post2 (#41386)
Signed-off-by: Rohan138 <rohanpotdar138@gmail.com>
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
Co-authored-by: Rohan138 <rohanpotdar138@gmail.com>
|
2026-05-04 13:07:19 -05:00 |
|
|
|
712ad0286c
|
[Bugfix] KimiK2ReasoningParser: guard against buffered end-token in streaming (#41068)
Signed-off-by: Keyi Li <likey6688@gmail.com>
Co-authored-by: Keyi Li <likey6688@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Flora Feng <4florafeng@gmail.com>
|
2026-05-04 17:42:05 +00:00 |
|
|
Ekagra RanjanandGitHub
|
321fa2d6d1
|
Limit gpu utils and lower max BS on test_transcription_api_correctness.py (#41649)
Signed-off-by: Ekagra Ranjan <3116519+ekagra-ranjan@users.noreply.github.com>
|
2026-05-04 10:30:02 -07:00 |
|
|
Wentao YeandGitHub
|
3e1ad4435f
|
[Bug] Fix tests/compile/test_config.py AttributeError: 'NoneType' object has no attribute 'dtype' (#41288)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
|
2026-05-05 00:22:07 +08:00 |
|
|
Netanel HaberandGitHub
|
8decbfa02c
|
Test nemotron nano-v2 and nemotron nano-v3 separately, disable super-omni redundant tests (#41616)
Signed-off-by: Netanel Haber <58652339+netanel-haber@users.noreply.github.com>
|
2026-05-04 16:31:37 +03:00 |
|
|
Stefano CastagnettaandGitHub
|
62ba7516e8
|
Revert "[Doc] Fix RTD build: pytorch.org/docs/stable/objects.inv returns 404" (#41618)
Signed-off-by: Stefano Castagnetta <scastagnetta@nvidia.com>
|
2026-05-04 04:47:42 -07:00 |
|
|
Stefano CastagnettaandGitHub
|
6f53753fc9
|
[Bugfix] Apply ruff-format to hyperclovax.py (#41620)
Signed-off-by: Stefano Castagnetta <scastagnetta@nvidia.com>
|
2026-05-04 03:37:16 -07:00 |
|
|
Andreas KaratzasandGitHub
|
6ec9bbec38
|
[CI] Stabilize cpu offload compressed tensors test (#41102)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
|
2026-05-04 05:22:42 +00:00 |
|
|
Andreas KaratzasandGitHub
|
01d4d1ad37
|
[ROCm][CI] Align spec decode logprob test prefill settings (#41335)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
|
2026-05-04 04:33:29 +00:00 |
|
|
|
c103c02a1a
|
[Transformers v5] Vendor HCXVisionConfig for compatibility (#38447)
Signed-off-by: Fang Han <fhan0520@gmail.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
2026-05-04 04:19:52 +00:00 |
|
|
Andreas KaratzasandGitHub
|
67058ca326
|
[CI] Clean up remote servers on pytest parent exit (#41570)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
|
2026-05-04 03:11:22 +00:00 |
|
|
Akim TsvigunandGitHub
|
894a02500b
|
[Bench] Forward --seed to CustomDataset and CustomMMDataset shuffle (#40788)
Signed-off-by: akimtsvigun <akimtsvigun@gmail.com>
|
2026-05-04 00:39:10 +00:00 |
|
|
|
66dfee7121
|
[Bugfix] Fix degenerate KV cache stride causing TMA cudaErrorIllegalInstruction (#40737)
Signed-off-by: David Oy <david@baseten.co>
Signed-off-by: David Oy <58150256+the-david-oy@users.noreply.github.com>
Signed-off-by: David Oy <david.oy@baseten.co>
Co-authored-by: David Oy <david@baseten.co>
Co-authored-by: Claude <claude@anthropic.com>
Co-authored-by: Vadim Gimpelson <156319763+vadiklyutiy@users.noreply.github.com>
|
2026-05-03 23:52:18 +00:00 |
|
|
Alex BrooksandGitHub
|
db9a84e0cd
|
[Bugfix] Fix FP8 Bias Loading (#41424)
Signed-off-by: Alex Brooks <albrooks@redhat.com>
|
2026-05-03 20:30:04 +00:00 |
|
|
tomeras91andGitHub
|
cb03fee32b
|
[Bugfix][Ray] Fix RayExecutorV2 actor name collision with DP > 1 (#40398)
Signed-off-by: Tomer Asida <57313761+tomeras91@users.noreply.github.com>
|
2026-05-03 13:00:41 -07:00 |
|
|
Wei ZhaoandGitHub
|
c51df43005
|
Disable flashinfer autotune temporarily due to correctness issues (#41524)
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
|
2026-05-03 16:19:59 +00:00 |
|
|
Taneem IbrahimandGitHub
|
54dc64d5d3
|
[Doc] Add Qwen3-30B-A3B-Thinking-2507-FP8 to batch invariance verified models (#41513)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
|
2026-05-03 08:47:55 -04:00 |
|
|
Woosuk KwonandGitHub
|
e6ff3e9c83
|
[MRV2] Add shutdown() method (#41297)
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
v0.20.2rc0
|
2026-05-02 21:06:30 -07:00 |
|
|
Jinzhen LinandGitHub
|
08834cc3ce
|
[Quantization] add humming mxfp4 moe backend (#41083)
Signed-off-by: Jinzhen Lin <jinzhen.ljz@antgroup.com>
|
2026-05-02 18:36:03 -07:00 |
|
|
|
856ec4804a
|
[DSv4] Tune default value of VLLM_MULTI_STREAM_GEMM_TOKEN_THRESHOLD (#41526)
Co-authored-by: Copilot <copilot@github.com>
|
2026-05-02 18:32:09 -07:00 |
|
|
Yongye ZhuandGitHub
|
1c607d7b2c
|
[DSV4] Guard megamoe flag with Pure TP (#41522)
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
|
2026-05-02 16:41:40 -07:00 |
|
|
|
4f7309fcc0
|
[CI] Add ci-fetch-log.sh helper for Buildkite job logs (#41517)
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
2026-05-02 15:23:59 -07:00 |
|
|
Michael GoinandGitHub
|
0a9362d6ab
|
Revert "[Build] Make bundled DeepGEMM wheel portable across Python versions" (#41512)
|
2026-05-02 09:42:41 -07:00 |
|
|
|
cfd2573f23
|
[Build] Switch CUDA 13.0 wheel builds to PyTorch manylinux_2_28 base (#41416)
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-05-02 05:51:28 -07:00 |
|