Alexander Matveev
a60418e6fb
Sparse MLA on Hopper: Use SGLang's kernel for the sparse mla low latency runs
...
Signed-off-by: Alexander Matveev <amatveev@redhat.com >
2026-04-17 16:51:32 +00:00
sychen52 and GitHub
6b2b7bd0eb
Add nvfp4 support to reshape_and_cache_flash ( #37332 )
...
Signed-off-by: Shiyang Chen <shiychen@nvidia.com >
2026-04-17 07:28:00 -07:00
Chauncey and GitHub
7a51b3e415
[Bugfix] Fix empty delta detection in Qwen3XMLToolParser streaming ( #40090 )
...
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com >
2026-04-17 13:34:55 +00:00
Li, Jiang and GitHub
d02421a7db
[CPU] Refactor CPU affinity and memory management ( #39781 )
...
Signed-off-by: jiang1.li <jiang1.li@intel.com >
2026-04-17 21:01:08 +08:00
Shinichi Hemmi and GitHub
4c47710bf7
[CI/Build] Apply ruff formatter to pass pre-commit ( #40078 )
...
Signed-off-by: Hemmi Shinichi <shemmi@preferred.jp >
2026-04-17 08:54:32 +08:00
bnellnm and GitHub
79e799ebbd
[Bugfix] Temporarily disable B200 fp4 MoE layer tests ( #40057 )
...
Signed-off-by: Bill Nell <bnell@redhat.com >
2026-04-16 19:26:55 -04:00
BadrBasowid and GitHub
29057d3bee
[Compilation] Add Unit Tests for VllmFusionPatternMatcherPass ( #39692 )
...
Signed-off-by: BadrBasowid <badr.basowid@gmail.com >
2026-04-16 22:57:16 +00:00
Asaf Gardin and GitHub
ad2b1277f9
[Quantization] Consolidate experts_int8 with fp8 online quantization ( #38463 )
...
Signed-off-by: Josephasafg <ajgard7@gmail.com >
2026-04-16 13:12:20 -07:00
roikoren755 and GitHub
b897f00c9c
Gate SSU dispatch setup ( #40039 )
...
Signed-off-by: Roi Koren <roik@nvidia.com >
2026-04-16 13:06:01 -07:00
adf9bb3c57
[CI] Add weight transfer tests to CI ( #39821 )
...
Signed-off-by: SumanthRH <sumanthrh99@gmail.com >
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com >
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk >
2026-04-16 15:51:45 -04:00
Roger Wang and GitHub
3abb7560c0
[Bugfix] Fix audioflamingo test ( #40052 )
...
Signed-off-by: Roger Wang <hey@rogerw.io >
2026-04-16 11:53:58 -07:00
Nikita Shapovalov and GitHub
692db29cd4
[Bugfix] Fix Ray compiled-DAG SHM channel stalls by detaching zero-copy np.ndarray logprobs buffers ( #35736 )
...
Signed-off-by: Nikita Shapovalov <nikita@poolside.ai >
2026-04-16 23:49:29 +08:00
Nicolò Lucchesi and GitHub
3daca38e22
[Misc] toy_proxy_server handle min_tokens ( #39706 )
...
Signed-off-by: NickLucche <nlucches@redhat.com >
2026-04-16 15:08:22 +00:00
daiyu1111 and GitHub
a302a8fd1b
[Bugfix] Fix LLM priority normalization for single-string prompts ( #40011 )
...
Signed-off-by: daiyu1111 <2356690121@qq.com >
2026-04-16 07:56:06 -07:00
Li, Jiang and GitHub
324a3d2bd8
[CI/Build] Improve stability of CPU tests ( #39966 )
...
Signed-off-by: jiang1.li <jiang1.li@intel.com >
2026-04-16 21:50:36 +08:00
4269b79409
[Model] Use mm_features to compute mrope positions for PaddleOCR-VL ( #39888 )
...
Signed-off-by: grYe99 <guorongye99@gmail.com >
Co-authored-by: grYe99 <guorongye99@gmail.com >
2026-04-16 06:14:00 -07:00
edc3648966
[Kernel][Helion] Fix inductor fusion of Helion HOP ( #39944 )
...
Signed-off-by: Yanan Cao <gmagogsfm@gmail.com >
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com >
2026-04-16 04:41:26 -07:00
lalit10 and GitHub
17d87168d2
[Model] Use mm_features for Keye-VL and Keye-1.5-VL M-RoPE ( #39869 )
...
Signed-off-by: Lalit Laxminarayan Bangad <lalitbangad@gmail.com >
2026-04-16 02:16:06 -07:00
2cdf86044d
Add Jina Embeddings v5 model support ( fixes #38633 ) ( #39575 )
...
Signed-off-by: Abhijit <abroy@redhat.com >
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io >
Co-authored-by: wang.yuqi <yuqi.wang@daocloud.io >
2026-04-16 06:37:10 +00:00
realliujiaxu and GitHub
7845379230
[Bugfix] add support for 'num_attention_groups' in ModelArchConfigConvertorBase for Step3p5 ( #39796 )
...
Signed-off-by: realliujiaxu <realliujiaxu@163.com >
2026-04-16 05:48:00 +00:00
445b7093fd
[perf][cpu] Accelerate BF16 GELU with LUT impl on Arm CPUs ( #37469 )
...
Signed-off-by: Fadi Arafeh <fadi.arafeh@arm.com >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-04-15 22:26:17 -07:00
18013df6ae
[Bugfix] Reject empty tools array with HTTP 400 ( #39780 )
...
Signed-off-by: Jigang Zhou <zjg0907008@gmail.com >
Co-authored-by: Claude <noreply@anthropic.com >
2026-04-16 12:08:04 +08:00
Julien Denize and GitHub
c0722f22de
[Mistral Grammar] Fix tool and reasoning parsing ( #39217 )
...
Signed-off-by: juliendenize <julien.denize@mistral.ai >
2026-04-15 21:05:04 -07:00
vllmellm and GitHub
5f7fab881a
[ROCm][FEAT] Integrate aiter gemm w8a8 ptpc ( #33773 )
...
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com >
2026-04-16 09:55:29 +08:00
Asaf Gardin and GitHub
19fa90ed0d
[Quantization] - Layerwise reloading of Attention/KV quantized models ( #38995 )
...
Signed-off-by: Josephasafg <ajgard7@gmail.com >
2026-04-15 18:03:32 -07:00
03f8d3a548
Update to transformers v5 ( #30566 )
...
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
Signed-off-by: khluu <khluu000@gmail.com >
Signed-off-by: Kevin H. Luu <khluu000@gmail.com >
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com >
Co-authored-by: khluu <khluu000@gmail.com >
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com >
Co-authored-by: jiang1.li <jiang1.li@intel.com >
2026-04-15 16:29:15 -07:00
Collin McCarthy and GitHub
27c0ca50a0
Update registry for Nemotron-v3 VL Nano/Super ( #39747 )
...
Signed-off-by: Collin McCarthy <cmccarthy@nvidia.com >
2026-04-15 16:09:11 -07:00
Wentao Ye and GitHub
7c636432c6
[CI Bug] fix flaky test ( #39938 )
...
Signed-off-by: yewentao256 <zhyanwentao@126.com >
2026-04-15 17:20:06 -04:00
Wentao Ye and GitHub
39ac640490
[Bug] Fix batch invariant test issue, bs=1 with max_seq_num = 1 ( #39320 )
...
Signed-off-by: yewentao256 <zhyanwentao@126.com >
2026-04-15 16:28:43 -04:00
zhanqiuhu and GitHub
0b790a2501
[Speculative Decoding] Add DFlash speculators config parsing ( #38300 )
...
Signed-off-by: Zhanqiu Hu <zhu@redhat.com >
2026-04-15 16:22:15 -04:00
zhanqiuhu and GitHub
41488f2acd
[Bugfix][NIXL] Fix _logical_to_kernel_block_ids conversion for non-mamba models ( #39724 )
...
Signed-off-by: Zhanqiu Hu <zhu@redhat.com >
2026-04-15 20:08:58 +00:00
55e1a8e103
[Mooncake] Fix mixed MLA+Eagle block-size validation ( #39596 )
...
Signed-off-by: Zhewen Li <zhewenli@inferact.ai >
Co-authored-by: Zhewen Li <zhewenli@inferact.ai >
Co-authored-by: OpenAI Codex <codex@openai.com >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-04-15 11:36:47 -07:00
Mark McLoughlin and GitHub
8ad6ff0037
[Test] Fix @create_new_process_for_each_test("fork") in interactive shell pipeline ( #29130 )
...
Signed-off-by: Mark McLoughlin <markmc@redhat.com >
2026-04-15 12:22:20 -04:00
Chauncey and GitHub
db8d4a4a06
[BugFix][Graph] fix: handle empty sym_shape_indices in PiecewiseBackend. ( #39395 )
...
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com >
2026-04-15 09:28:09 -04:00
Csrayz and GitHub
68be0f853e
[Metrics] Add request_id to FinishedRequestStats to enable correlation between metrics and requests ( #39710 )
...
Enables external `StatLogger` plugins to correlate per-request metrics
with request-level context. Also, this is a pre-requisite for Prometheus
exemplars in #30972 .
Signed-off-by: Csrayz <33659823+Csrayz@users.noreply.github.com >
2026-04-15 11:24:17 +00:00
Zhenzhong Xu and GitHub
60995c05b4
[Quantization][Autoround][CPU] Add W4A16 Support ( #38192 )
...
Signed-off-by: Zhenzhong1 <zhenzhong.xu@intel.com >
Signed-off-by: Zhenzhong Xu <zhenzhong.xu@intel.com >
2026-04-15 18:38:31 +08:00
Or Ozeri and GitHub
235e1f930a
[kv_offload+HMA][3/N]: Remove block_size from KVEvents ( #36644 )
...
Signed-off-by: Or Ozeri <oro@il.ibm.com >
2026-04-15 11:53:19 +03:00
+86
431cea3eea
[Bugfix] Fix tool_calls Iterable consumed when debug logging is enabled ( #34844 )
...
Signed-off-by: Wojciech Wais <wojciech.wais@gmail.com >
Signed-off-by: mgoin <mgoin64@gmail.com >
Signed-off-by: Xinyu Chen <xinyu1.chen@intel.com >
Signed-off-by: Ekagra Ranjan <3116519+ekagra-ranjan@users.noreply.github.com >
Signed-off-by: Rishi Puri <riship@nvidia.com >
Signed-off-by: Jaebok Lee <jaebok9541@naver.com >
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk >
Signed-off-by: yuwei <yuwei@dev.local >
Signed-off-by: Artem Perevedentsev <aperevedents@nvidia.com >
Signed-off-by: Ibrahim Arshad <38925737+ibrahim1023@users.noreply.github.com >
Signed-off-by: Li <chuali@amd.com >
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com >
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com >
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com >
Signed-off-by: R <Ganesh.R@amd.com >
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com >
Signed-off-by: lkm2835 <lkm2835@gmail.com >
Signed-off-by: Ronen Schaffer <ronen.schaffer@ibm.com >
Signed-off-by: vnadathur <glvikramn@gmail.com >
Signed-off-by: WorldExplored <srreyansh.sethi@gmail.com >
Signed-off-by: Srreyansh Sethi <107075589+WorldExplored@users.noreply.github.com >
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn >
Signed-off-by: Elham Harirpoush <elham.harirpoush@arm.com >
Signed-off-by: Yan Ma <yan.ma@intel.com >
Signed-off-by: Nick Hill <nickhill123@gmail.com >
Signed-off-by: jackcfwang <jackcfwang@tencent.com >
Signed-off-by: Chendi Xue <chendi.xue@intel.com >
Signed-off-by: Injae Ryou <injaeryou@gmail.com >
Signed-off-by: Richard Zou <zou3519@gmail.com >
Signed-off-by: milesial <milesial@users.noreply.github.com >
Signed-off-by: Elvir Crncevic <elvircrn@gmail.com >
Signed-off-by: whx-sjtu <2952154980@qq.com >
Signed-off-by: Lalithnarayan C <Lalithnarayan.C@amd.com >
Signed-off-by: PatchouliTaisa <patchychen@tencent.com >
Signed-off-by: jatseng-ai <jatseng@amd.com >
Signed-off-by: jatseng-ai <janet.tseng@amd.com >
Signed-off-by: Matthias Gehre <matthias.gehre@amd.com >
Signed-off-by: xaguilar-amd <xaguilar@amd.com >
Signed-off-by: rdondeti <ravitez.dondeti@gmail.com >
Signed-off-by: Ravitez Dondeti <ravitez.dondeti@gmail.com >
Signed-off-by: NickLucche <nlucches@redhat.com >
Signed-off-by: Peter Nguyen <petern0408@gmail.com >
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io >
Signed-off-by: zhuhaoran <zhuhaoran.zhr@alibaba-inc.com >
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com >
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com >
Signed-off-by: Jesus Federico <jefp@amazon.com >
Signed-off-by: manu <fortin.emmanuel@gmail.com >
Signed-off-by: ZhanqiuHu <zhu@redhat.com >
Signed-off-by: Yifan Zong <yzong@redhat.com >
Signed-off-by: Rahul-Tuli <rtuli@redhat.com >
Signed-off-by: Fynn Schmitt-Ulms <fschmitt@redhat.com >
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
Signed-off-by: Michael Goin <mgoin64@gmail.com >
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com >
Signed-off-by: Tianyu Guo <guoty9@mail2.sysu.edu.cn >
Signed-off-by: leeyongjun <jqueen.astro@gmail.com >
Signed-off-by: Ziying Tao <tzzying@outlook.com >
Signed-off-by: jiang1.li <jiang1.li@intel.com >
Signed-off-by: Vibhav Agarwal <vibhavagarwal5@gmail.com >
Signed-off-by: ShubyM <shubymishra20@gmail.com >
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com >
Signed-off-by: Itay Etelis <itay.etelis@ibm.com >
Signed-off-by: EdalatiAli <aliedalati@cohere.com >
Signed-off-by: Andreas Karatzas <akaratza@amd.com >
Signed-off-by: r266-tech <r266.tech@gmail.com >
Signed-off-by: Roger Wang <hey@rogerw.io >
Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com >
Signed-off-by: Mark McLoughlin <markmc@redhat.com >
Signed-off-by: Animesh Jain <anijain@umich.edu >
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com >
Signed-off-by: zhxchen17 <zhxchen17@fb.com >
Signed-off-by: EricccYang <yangyang4991@gmail.com >
Signed-off-by: Kaicheng Yang <53411596+EricccYang@users.noreply.github.com >
Signed-off-by: baoloongmao <baoloongmao@tencent.com >
Signed-off-by: sihao.li <sihao.li@intel.com >
Signed-off-by: sfeng33 <4florafeng@gmail.com >
Signed-off-by: Yufeng He <40085740+he-yufeng@users.noreply.github.com >
Signed-off-by: Zhu, Zufang <zufang.zhu@intel.com >
Signed-off-by: Tihomir Elek <tiho.elek@gmail.com >
Signed-off-by: yiliu30 <yi4.liu@intel.com >
Signed-off-by: yewentao256 <zhyanwentao@126.com >
Signed-off-by: Santino Ramos <santinor@inferact.ai >
Signed-off-by: haosdent <haosdent@gmail.com >
Signed-off-by: JartX <sagformas@epdcenter.es >
Signed-off-by: George-ao <yuyiao772@gmail.com >
Signed-off-by: Yuyi Ao <yuyiao772@gmail.com >
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com >
Signed-off-by: Mukesh Baphna <mukesh@hippocraticai.com >
Signed-off-by: Pedram Razavi <pedram.razavi@gmail.com >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com >
Co-authored-by: Xinyu Chen <xinyu1.chen@intel.com >
Co-authored-by: Ekagra Ranjan <3116519+ekagra-ranjan@users.noreply.github.com >
Co-authored-by: Rishi Puri <riship@nvidia.com >
Co-authored-by: zzaebok <44357534+zzaebok@users.noreply.github.com >
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk >
Co-authored-by: Yuwei An <ayw.sirius19@gmail.com >
Co-authored-by: yuwei <yuwei@dev.local >
Co-authored-by: Artem Perevedentsev <aperevedents@nvidia.com >
Co-authored-by: Ibrahim Arshad <38925737+ibrahim1023@users.noreply.github.com >
Co-authored-by: Chuan (Richard) Li <chuali@amd.com >
Co-authored-by: Chauncey <chaunceyjiang@gmail.com >
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com >
Co-authored-by: Ganesh R <ganesh.r@amd.com >
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com >
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com >
Co-authored-by: Kyungmin Lee <30465912+lkm2835@users.noreply.github.com >
Co-authored-by: Ronen Schaffer <ronen.schaffer@ibm.com >
Co-authored-by: Srreyansh Sethi <107075589+WorldExplored@users.noreply.github.com >
Co-authored-by: vnadathur <glvikramn@gmail.com >
Co-authored-by: vnadathur <236933696+vnadathur@users.noreply.github.com >
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn >
Co-authored-by: Elham <elham.harirpoush@arm.com >
Co-authored-by: Yan Ma <yan.ma@intel.com >
Co-authored-by: Nick Hill <nickhill123@gmail.com >
Co-authored-by: Chaofan Wang <jackcfwang@tencent.com >
Co-authored-by: Chendi.Xue <chendi.xue@intel.com >
Co-authored-by: Injae Ryou <injaeryou@gmail.com >
Co-authored-by: Richard Zou <zou3519@users.noreply.github.com >
Co-authored-by: milesial <milesial@users.noreply.github.com >
Co-authored-by: Elvir Crnčević <elvircrn@gmail.com >
Co-authored-by: Claude Sonnet 4 <noreply@anthropic.com >
Co-authored-by: Hexiang Wang <56632993+whx-sjtu@users.noreply.github.com >
Co-authored-by: Lalithnarayan C <Lalithnarayan.C@amd.com >
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com >
Co-authored-by: PatchyTIS <58251192+PatchouliTIS@users.noreply.github.com >
Co-authored-by: PatchouliTaisa <patchychen@tencent.com >
Co-authored-by: jatseng-ai <janet.tseng@amd.com >
Co-authored-by: Matthias Gehre <matthias.gehre@amd.com >
Co-authored-by: xaguilar-amd <xavier.aguilarfruto@amd.com >
Co-authored-by: Ravitez Dondeti <dondetir@users.noreply.github.com >
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com >
Co-authored-by: Peter Nguyen <petern0408@gmail.com >
Co-authored-by: wang.yuqi <yuqi.wang@daocloud.io >
Co-authored-by: zhrrr <43847754+izhuhaoran@users.noreply.github.com >
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com >
Co-authored-by: TJian <tunjian.tan@embeddedllm.com >
Co-authored-by: Jesus Federico <14651+jefp@users.noreply.github.com >
Co-authored-by: Manu <efortin@users.noreply.github.com >
Co-authored-by: zhanqiuhu <49648934+ZhanqiuHu@users.noreply.github.com >
Co-authored-by: yzong-rh <yzong@redhat.com >
Co-authored-by: Fynn Schmitt-Ulms <fschmitt@redhat.com >
Co-authored-by: Rahul-Tuli <rtuli@redhat.com >
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
Co-authored-by: Benjamin Chislett <bchislett@nvidia.com >
Co-authored-by: Tianyu Guo <guoty9@mail2.sysu.edu.cn >
Co-authored-by: Lee Yongjun <35302114+elwhyjay@users.noreply.github.com >
Co-authored-by: z1ying <55220715+z1ying@users.noreply.github.com >
Co-authored-by: Li, Jiang <jiang1.li@intel.com >
Co-authored-by: Vibhav Agarwal <vibhavagarwal5@gmail.com >
Co-authored-by: vibhav-agarwal <vibhav.agarwal@glance.com >
Co-authored-by: ShubyM <shubymishra20@gmail.com >
Co-authored-by: Wei Zhao <51183510+wzhao18@users.noreply.github.com >
Co-authored-by: Itay Etelis <92247226+Etelis@users.noreply.github.com >
Co-authored-by: Itay Etelis <itay.etelis@ibm.com >
Co-authored-by: EdalatiAli <aliedalati@cohere.com >
Co-authored-by: Andreas Karatzas <akaratza@amd.com >
Co-authored-by: r266-tech <r2668940489@gmail.com >
Co-authored-by: Roger Wang <hey@rogerw.io >
Co-authored-by: Martin Hickey <martin.hickey@ie.ibm.com >
Co-authored-by: Or Ozeri <or@ozery.com >
Co-authored-by: Mark McLoughlin <markmc@redhat.com >
Co-authored-by: Le Yang <562593859@qq.com >
Co-authored-by: Animesh Jain <anijain@umich.edu >
Co-authored-by: Yongye Zhu <zyy1102000@gmail.com >
Co-authored-by: Zhengxu Chen <zhxchen17@fb.com >
Co-authored-by: Kaicheng Yang <53411596+EricccYang@users.noreply.github.com >
Co-authored-by: maobaolong <baoloongmao@tencent.com >
Co-authored-by: sihao_li <165983188+1643661061leo@users.noreply.github.com >
Co-authored-by: Flora Feng <4florafeng@gmail.com >
Co-authored-by: Yufeng He <40085740+he-yufeng@users.noreply.github.com >
Co-authored-by: zofia <110436990+zufangzhu@users.noreply.github.com >
Co-authored-by: Tihomir Elek <tiho.elek@gmail.com >
Co-authored-by: Yi Liu <yi4.liu@intel.com >
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com >
Co-authored-by: Santino Ramos <51103228+santiramos27@users.noreply.github.com >
Co-authored-by: haosdent <haosdent@gmail.com >
Co-authored-by: JartX <sagformas@epdcenter.es >
Co-authored-by: Yuyi Ao <yuyiao772@gmail.com >
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com >
Co-authored-by: mukesh-hai <mukesh@hippocraticai.com >
Co-authored-by: Pedram Razavi <pedram@sierra.ai >
2026-04-15 01:32:47 -07:00
wliao2 and GitHub
3abf858443
[Test] Refactor hard coded device string in test files under compile/quantization/models/model_executor folders ( #38901 )
...
Signed-off-by: Liao, Wei <wei.liao@intel.com >
2026-04-15 11:02:35 +08:00
f4b42df048
[Attention Backend] TurboQuant: 2-bit KV cache compression with 4x capacity ( #38479 )
...
Signed-off-by: vibhavagarwal5 <vibhavagarwal5@gmail.com >
Signed-off-by: Michael Goin <mgoin64@gmail.com >
Co-authored-by: Xinyu Chen <xinyu1.chen@intel.com >
Co-authored-by: Michael Goin <mgoin64@gmail.com >
2026-04-14 19:57:13 -07:00
bnellnm and GitHub
19ec9a0a62
[MoE Refactor] Refactor ZeroExpertFusedMoE into new framework ( #35549 )
...
Signed-off-by: Bill Nell <bnell@redhat.com >
2026-04-14 16:11:20 -04:00
1a9353bb02
[MoE] Move GPT OSS Triton kernel experts into fused_moe/experts/ ( #39007 )
...
Signed-off-by: Robert Shaw <robertgshaw2@gmail.com >
Signed-off-by: Jackmin801 <ongjackm@gmail.com >
Co-authored-by: Robert Shaw <robertgshaw2@gmail.com >
2026-04-14 19:27:39 +00:00
roikoren755 and GitHub
ecf5ff7ce3
[Mamba] Flashinfer selective_state_update ( #36162 )
...
Signed-off-by: Roi Koren <roik@nvidia.com >
2026-04-14 15:10:58 -04:00
zhanqiuhu and GitHub
30679319e8
[CI][KVConnector][Metrics] Update multi KV connector edge case according to prefill stats changes ( #39808 )
...
Signed-off-by: Zhanqiu Hu <zhu@redhat.com >
2026-04-14 18:59:15 +00:00
240f2636ca
[Kernel] Support TRTLLM GEN NVFP4 MoE for non-512-aligned hidden dims via weight padding ( #39510 )
...
Signed-off-by: root <root@lyris0017.lyris.clusters.nvidia.com >
Signed-off-by: Daniel Afrimi <dafrimi@nvidia.com >
Co-authored-by: root <root@lyris0017.lyris.clusters.nvidia.com >
2026-04-14 11:49:56 -07:00
be0c855ebd
[KV Offload] Unified memory layout for offloading workers ( #37206 )
...
Signed-off-by: omerpaz95 <omerpaz95@gmail.com >
Co-authored-by: Or Ozeri <oro@il.ibm.com >
2026-04-14 21:33:33 +03:00
Micah Williamson and GitHub
4f4f8eaa78
[ROCm][CI] Fix condition for test_per_token_group_quant_fp8_packed ( #39730 )
...
Signed-off-by: Micah Williamson <micah.williamson@amd.com >
2026-04-14 16:14:31 +00:00
e1e318af01
[MoE Refactor] Remove MoE DP chunking ( #39107 )
...
Signed-off-by: Bill Nell <bnell@redhat.com >
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com >
2026-04-14 09:48:05 -04:00
6f786f2c50
[Bugfix][Model] Fix Devstral Small 2 HF format weight loading ( #39293 )
...
Signed-off-by: thomasmaindron <thomasmaindron@users.noreply.github.com >
Co-authored-by: thomasmaindron <thomasmaindron@users.noreply.github.com >
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com >
2026-04-14 10:11:18 +00:00
fxmarty-amd and GitHub
4eee77b877
[fix][MOE] Fix MOE experts intermediate_size dimension not being narrowed before weight loading ( #39688 )
...
Signed-off-by: Felix Marty <Felix.Marty@amd.com >
2026-04-14 09:35:28 +00:00
