 Sage MooreandGitHub
|
3173441b0f
|
[EPLB] Consolidate is_unchanged/is_received_locally into TransferMetadata (#37341)
Signed-off-by: Sage Moore <sage@neuralmagic.com>
|
2026-04-20 21:12:42 +00:00 |
|
|
Cao QianandGitHub
|
8b1f3bebca
|
[LMCache MP Connector] Add num_lmcache_extra_cached_token in KVTransferParams (#39843)
Signed-off-by: aeon-x <talexcao@gmail.com>
|
2026-04-20 20:42:49 +00:00 |
|
|
|
2390caf157
|
Enable building MoRI with AMD AINIC stack (#38371)
Signed-off-by: Theresa Shan <thshan@smci355-ccs-aus-n08-21.prov.aus.ccs.cpe.ice.amd.com>
Signed-off-by: Theresa Shan <theresa.shan@amd.com>
Co-authored-by: Theresa Shan <thshan@smci355-ccs-aus-n08-21.prov.aus.ccs.cpe.ice.amd.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
|
2026-04-20 11:17:59 -07:00 |
|
|
Frederik GossenandGitHub
|
87805fa11e
|
[Core] Cache InductorPass.hash_source with functools.cache (#39328)
Signed-off-by: Frederik Gossen <frgossen@meta.com>
|
2026-04-20 14:06:15 -04:00 |
|
|
Nicolò LucchesiandGitHub
|
304d5ba1a0
|
[Bugfix][CI] Fix tests/distributed/test_torchrun_example_moe.py (#40349)
Signed-off-by: NickLucche <nlucches@redhat.com>
|
2026-04-20 11:05:44 -07:00 |
|
|
Tyler Michael SmithandGitHub
|
81d954f454
|
[WideEP] Remove naive all2all. Use allgather_reducescatter instead (#33728)
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
|
2026-04-20 17:53:55 +00:00 |
|
|
Frederik GossenandGitHub
|
47fcb8ca68
|
[Core] Pass donate_graph_module=True to standalone_compile (#39733)
Signed-off-by: Frederik Gossen <frgossen@meta.com>
|
2026-04-20 17:40:52 +00:00 |
|
|
baiandGitHub
|
191e3fdaa1
|
Update flashinfer to 0.6.8 (#39959)
Signed-off-by: bai <v@gor.io>
|
2026-04-20 10:37:23 -07:00 |
|
|
Frederik GossenandGitHub
|
b9cf629bd0
|
[Core] Label torch trace logging overhead with dynamo_timed (#39329)
Signed-off-by: Frederik Gossen <frgossen@meta.com>
|
2026-04-20 17:31:03 +00:00 |
|
|
|
3461c8b027
|
[EPLB] Refactor Async EPLB synchronization logic (#37601)
Signed-off-by: Sage Moore <sage@neuralmagic.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
|
2026-04-20 17:05:41 +00:00 |
|
|
|
726efe177b
|
[MoE Refactor] Move the shared/fused expert output sum into MoERunnerBase (#35949)
Signed-off-by: Bill Nell <bnell@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
|
2026-04-20 12:28:46 -04:00 |
|
|
Yan MaandGitHub
|
595562651a
|
[XPU] fix MoE triton backend in online fp8 quantization (#40109)
Signed-off-by: Yan Ma <yan.ma@intel.com>
|
2026-04-20 11:31:39 -04:00 |
|
|
Hashem HashemiandGitHub
|
3a30eaa1d7
|
Properly enable wvSplitK fp8 path for RDNA (#37712)
Signed-off-by: Hashem Hashemi <hashem.hashemi@amd.com>
|
2026-04-20 10:09:24 -05:00 |
|
|
Rita BrugarolasandGitHub
|
fb5635d3f9
|
[ROCm] Add MLA dual RMS norm fusion (Q, KV) pass for DeepSeek/Kimi-K2 (#39242)
Signed-off-by: Rita Brugarolas Brufau <rita.brugarolasbrufau@amd.com>
|
2026-04-20 14:56:27 +00:00 |
|
|
Wentao YeandGitHub
|
b42e878ec0
|
[Bug] Fix dcp error message (#40053)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
|
2026-04-20 10:52:32 -04:00 |
|
|
|
7243e02aa1
|
[ROCm][Feature] Enable AITER MLA attention backend to work with Eagle3 speculative decoding on ROCm (#39616)
Signed-off-by: larryli2-amd <larryli2@amd.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
|
2026-04-20 09:44:43 -05:00 |
|
|
Sage MooreandGitHub
|
def8f52200
|
[CI][EPLB] Add Async EPLB end-to-end integration test to CI (#40168)
Signed-off-by: Sage Moore <sage@neuralmagic.com>
|
2026-04-20 10:22:54 -04:00 |
|
|
Vasiliy KuznetsovandGitHub
|
38fa87caca
|
mxfp8 online quant move to new frontend (#40152)
Signed-off-by: Vasiliy Kuznetsov <vasiliy@meta.com>
|
2026-04-20 06:26:12 -07:00 |
|
|
|
a023edfa5b
|
[bugfix] Use only onlines CPUs in lscpu (#40161)
Signed-off-by: kse <kevin.sejourne@cloud-temple.com>
Co-authored-by: kse <kevin.sejourne@cloud-temple.com>
|
2026-04-20 13:19:57 +00:00 |
|
|
|
b82fc1364d
|
[Anthropic][Frontend] Added chat_template_kwargs to /v1/messages (#40125)
Signed-off-by: Aleksandar Yanakiev <alexander.yanakiev@discretestack.com>
Co-authored-by: Aleksandar Yanakiev <alexander.yanakiev@discretestack.com>
|
2026-04-20 06:10:45 -07:00 |
|
|
Yan MaandGitHub
|
e06de7f005
|
[XPU] enable triton attention test on XPU by removing cuda device binding (#39627)
Signed-off-by: Yan Ma <yan.ma@intel.com>
|
2026-04-20 20:57:11 +08:00 |
|
|
zhanqiuhuandGitHub
|
cc3993b05d
|
nixl refactor [2/N]: unify TpKVTopology + HeteroTPTransferConfig into TransferTopology (#39529)
Signed-off-by: Zhanqiu Hu <zhu@redhat.com>
|
2026-04-20 12:39:08 +02:00 |
|
|
Ilya MarkovandGitHub
|
50dd4cb427
|
[EPLB] Add nixl-based eplb communicator (#36276)
Signed-off-by: ilmarkov <markovilya197@gmail.com>
Signed-off-by: Markov Ilya <markovilya19@gmail.com>
|
2026-04-20 10:24:23 +00:00 |
|
|
|
f774ba028a
|
[kv_offload+HMA][4/N]: Support sliding window lookup (#36645)
Signed-off-by: Or Ozeri <oro@il.ibm.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
|
2026-04-20 12:53:51 +03:00 |
|
|
Fadi ArafehandGitHub
|
2aab9acf48
|
[CPU][BugFix] Fix inter-node pipeline parallel (#40150)
Signed-off-by: Fadi Arafeh <fadi.arafeh@arm.com>
|
2026-04-20 17:21:12 +08:00 |
|
|
nemanjaudovicandGitHub
|
58631d7c3f
|
[Bugfix] Fix scaled_mm output narrowing for 3D input tensors (#38093)
Signed-off-by: nemanjaudovic <nudovic@amd.com>
|
2026-04-20 16:58:39 +08:00 |
|
|
Andreas KaratzasandGitHub
|
a943839e9a
|
[ROCm][CI] Introducing new MI300 nodes (#39531)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
|
2026-04-20 16:09:58 +08:00 |
|
|
milesialandGitHub
|
6d8b80802b
|
[Docs] Fix thinking_token_budget docs (#40316)
Signed-off-by: milesial <milesial@users.noreply.github.com>
|
2026-04-20 08:09:44 +00:00 |
|
|
wuyingjunandGitHub
|
77fd2c8631
|
[Bugfix] Forward mm_processor_kwargs in offline generate APIs (#40251)
Signed-off-by: wuyingjun <wuyingjun_yewu@cmss.chinamobile.com>
|
2026-04-20 00:56:56 -07:00 |
|
|
San-NguyenandGitHub
|
e729cc823d
|
[Fix] Add Spacing when Requesting Output Token > max_model_len (#40324)
Signed-off-by: San-Nguyen <san.nguyen@ibm.com>
|
2026-04-20 00:25:06 -07:00 |
|
|
velonica0andGitHub
|
ec7aafc02a
|
[CPU][RISC-V] Support multiple RVV VLEN targets via compile-time dispatch (#39478)
Signed-off-by: velonica0 <like@mail.nankai.edu.cn>
|
2026-04-20 14:36:59 +08:00 |
|
|
Julien DenizeandGitHub
|
6097afb9bd
|
[BUGFIX] Fix Pixtral consolidated format vision weight loading (#39916)
Signed-off-by: Julien Denize <julien.denize@mistral.ai>
Signed-off-by: juliendenize <julien.denize@mistral.ai>
|
2026-04-19 22:25:03 -07:00 |
|
|
|
4f4713f96e
|
[XPU] [torch.compile] Skipping CUDA graph memory estimation to avoid startup errors. (#39977)
Signed-off-by: chaojun-zhang <chaojun.zhang@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-04-20 13:04:39 +08:00 |
|
|
Tao HeandGitHub
|
8936118134
|
[Qwen][Bugfix] Fixes sigmoid activation in torch impl of RMSNormGated. (#40245)
Signed-off-by: Tao He <linzhu.ht@alibaba-inc.com>
|
2026-04-20 04:28:19 +00:00 |
|
|
Yuan TangandGitHub
|
67ed01c353
|
fix: Do not make function calls when request has no tools for /v1/responses (#40314)
Signed-off-by: Yuan Tang <terrytangyuan@gmail.com>
|
2026-04-20 04:17:30 +00:00 |
|
|
|
6e10cb54f6
|
[Bugfix][Responses API] Fix streaming tool calls on /v1/responses (#39892)
Signed-off-by: Hoang Nguyen <118159510+hnt2601@users.noreply.github.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-04-20 11:24:52 +08:00 |
|
|
|
fcb31c1ac3
|
[Bugfix] Properly initialize PerTensorScaleParameter for fused-on-disk checkpoints (#39765)
Signed-off-by: Hemmi Shinichi <shemmi@preferred.jp>
Signed-off-by: Shinichi Hemmi <50256998+Alnusjaponica@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
2026-04-20 02:53:04 +00:00 |
|
|
LxxandGitHub
|
d886c26d4d
|
[Doc] Fix typos in token_embed pooling documentation (#40266)
Signed-off-by: YifanLi3 <lyfqlx3@gmail.com>
|
2026-04-19 19:27:32 -07:00 |
|
|
|
898beca5a8
|
[BugFix][XPU] fix lora ops bgmv_expand size not match (#39989)
Signed-off-by: Ma, Liangliang <liangliang.ma@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-04-20 08:24:50 +08:00 |
|
|
Kevin H. LuuandGitHub
|
629d45eacb
|
[ci] Make ecr authenticate non blocking (#40305)
Signed-off-by: Kevin H. Luu <khluu000@gmail.com>
|
2026-04-19 15:37:53 -07:00 |
|
|
Andrew BarnesandGitHub
|
f150107efd
|
[ROCm] Fix cu_seqlens_q off-by-one in AITER FA speculative decode path (#39120)
Signed-off-by: Bortlesboat <bortstheboat@gmail.com>
|
2026-04-19 18:34:33 +00:00 |
|
|
daniserebandGitHub
|
d1135a5087
|
Fix MoE backend selection for LoRA (unquantized MoE) (#40273)
Signed-off-by: Daniel Serebrenik <daserebrenik@nvidia.com>
|
2026-04-19 17:18:40 +00:00 |
|
|
|
982beae809
|
Optimize nemotron VL image/video preprocessing (#40283)
Signed-off-by: milesial <milesial@users.noreply.github.com>
Co-authored-by: milesial <milesial@users.noreply.github.com>
|
2026-04-19 15:06:20 +00:00 |
|
|
TJianandGitHub
|
45232a454e
|
[FEAT] [Perf] [Gemma4] Fused Gemma4 Routing Function Triton (#39083)
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
|
2026-04-19 09:57:39 +00:00 |
|
|
Flora FengandGitHub
|
03ce1c6ed9
|
[Bugfix] Kimi-K2 tool parser streaming - fix token leakage, argument truncation, and content dropping (#38579)
Signed-off-by: sfeng33 <4florafeng@gmail.com>
|
2026-04-19 01:30:27 -07:00 |
|
|
omerpaz95andGitHub
|
4353c9cb4a
|
[KV Offload] Pass request context (#39185)
Signed-off-by: omerpaz95 <omerpaz95@gmail.com>
|
2026-04-19 08:54:59 +03:00 |
|
|
|
4b7f5ea1a0
|
[KV Connector] Allow metrics of multiple connectors of same types in multi connector. (#40010)
Signed-off-by: omerpaz95 <omerpaz95@gmail.com>
Co-authored-by: Or Ozeri <oro@il.ibm.com>
|
2026-04-19 07:49:10 +03:00 |
|
|
|
38907e4391
|
[Frontend] Preserve structured output special tokens in offline LLM.chat (#39352)
Signed-off-by: Luciano Martins <lucianommartins@users.noreply.github.com>
Co-authored-by: Luciano Martins <lucianommartins@users.noreply.github.com>
Co-authored-by: Flora Feng <4florafeng@gmail.com>
|
2026-04-18 19:46:07 -04:00 |
|
|
|
d0359f3e04
|
[Bugfix] Guard mxfp4_experts_quant bindings on ENABLE_NVFP4_SM100 (#40191)
Signed-off-by: ultranationalism <www913363043@gmail.com>
Signed-off-by: mgoin <mike.goin12@gmail.com>
Co-authored-by: mgoin <mike.goin12@gmail.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
2026-04-18 13:58:46 -07:00 |
|
|
Dan AlistarhandGitHub
|
ed0622e3a8
|
[Attention] TurboQuant: remove redundant random signs, add prior art attribution (#40194)
Signed-off-by: Dan Alistarh <d.alistarh@gmail.com>
|
2026-04-18 14:31:59 -04:00 |
|