 Nick HillandGitHub
|
4787f2dd1b
|
[Bugfix] Don't read KV cache past seq_len in triton paged attn kernels (#47305)
|
2026-07-01 12:43:00 -07:00 |
|
|
Nick HillandGitHub
|
8cfeb84dba
|
[ModelRunner V2] Warmup cross-attn properly in encoder-decoder case (#47308)
|
2026-07-01 12:36:48 -07:00 |
|
|
Chaitanya Sri Krishna LollaandGitHub
|
5fd442187c
|
[ROCm][P/D] MoRIIO toy proxy: support JSON Content-Type for OpenAI clients. (#46482)
Signed-off-by: lcskrishna <lollachaitanya@gmail.com>
|
2026-07-01 19:17:05 +00:00 |
|
|
|
00eb7cefa3
|
[Bugfix] Prevent padding placeholders from reaching embeddings (#47029)
Signed-off-by: qianlihuang <91178480+qianlihuang@users.noreply.github.com>
Signed-off-by: Yiliu Dong <91178480+qianlihuang@users.noreply.github.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
|
2026-07-01 09:26:03 -07:00 |
|
|
Michał GanczarenkoandGitHub
|
c8bdcc0116
|
[Bench][BugFix] Fix empty decoder prompt for Cohere ASR in throughput benchmark (#47135)
Signed-off-by: Michal Ganczarenko <michal.ganczarenko@intel.com>
|
2026-07-01 15:42:27 +00:00 |
|
|
|
f5a8d73377
|
[Spec Decode] DSpark (#46995)
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
Signed-off-by: Giancarlo Delfin <gdelfin@inferact.ai>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Giancarlo Delfin <gdelfin@inferact.ai>
Co-authored-by: mgoin <mgoin64@gmail.com>
|
2026-07-01 08:30:24 -07:00 |
|
|
|
63fcce4de1
|
[Bugfix] Fix GraniteMoeShared weight loading broken by #41184 (#47031)
Signed-off-by: <Michal Ganczarenko> <michal.ganczarenko@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-07-01 22:39:12 +08:00 |
|
|
Bugen ZhaoandGitHub
|
c638f9216a
|
[Rust Frontend] Split engine core DTOs into separate modules (#47265)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-07-01 15:28:21 +01:00 |
|
|
Chaojun ZhangandGitHub
|
13c49f9845
|
[xpu][lora]: Align LoRA implementation with Punica GPU: fix _apply_expand rank mismatch, add_inputs hardcode, and MoE EP (#45368)
Signed-off-by: Chaojun Zhang <chaojun.zhang@intel.com>
|
2026-07-01 22:14:04 +08:00 |
|
|
Nick HillandGitHub
|
f1cf6b0086
|
[CI] Fix segfault in tracing test (#47299)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
|
2026-07-01 14:00:37 +00:00 |
|
|
Harry MellorandGitHub
|
a78c15616f
|
Migrate GPTBigCode and Starcoder2 to the Transformers modeling backend (#30966)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-07-01 13:41:36 +00:00 |
|
|
|
5c4db60f01
|
docs(security): document gRPC interface as insecure for private use only (#45903)
Signed-off-by: jperezde <jperezde@redhat.com>
Signed-off-by: Russell Bryant <russell.bryant@gmail.com>
Co-authored-by: Russell Bryant <russell.bryant@gmail.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>
|
2026-07-01 12:39:57 +00:00 |
|
|
|
4e5ca89cfe
|
[ROCm][MiniMax-M3] Cross-layer lightning-indexer top-k sharing (#47269)
Signed-off-by: Fangzhou Ai <fangzhouai@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-07-01 10:50:09 +00:00 |
|
|
Harry MellorandGitHub
|
a22e0dfc69
|
[Model] Remove AyaVision, MusicFlamingo (#47263)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-07-01 10:39:33 +00:00 |
|
|
stevenkuangandGitHub
|
cc56379e28
|
[Model] Support Hy3 token suffix and JSON Schema array types (#47192)
Signed-off-by: stevenkuang-tencent <stevenkuang@tencent.com>
|
2026-07-01 10:16:07 +00:00 |
|
|
|
024b06b0dc
|
[Bugfix] Expose usage field in GenerateResponse for disaggregated serving (#42748)
Signed-off-by: AIvashov <ivashov.aleksey@proton.me>
Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai>
Co-authored-by: NickLucche <nicolo.lucchesi@mistral.ai>
|
2026-07-01 10:00:19 +00:00 |
|
|
Harry MellorandGitHub
|
e7d0fcbc09
|
[CI] Fix various failures on main (#47197)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-07-01 10:35:34 +01:00 |
|
|
akii96andGitHub
|
aa8bb5562e
|
[ROCm][Perf][Bugfix] DSv4 indexer: use platform FP8 dtype (fnuz) for Q-quant on gfx942 (#46730)
Signed-off-by: Aakif Nawaz <aakif.nawaz@amd.com>
|
2026-07-01 17:33:55 +08:00 |
|
|
Andy LoandGitHub
|
fa4bec9056
|
[Bugfix] Fix pooled Whisper sliding-window KV sizing (#47071)
Signed-off-by: Andy Lo <andy@mistral.ai>
|
2026-07-01 11:33:19 +02:00 |
|
|
|
dee5da1dec
|
[Test] Run SageMaker handler-override tests in-process via TestClient (#47250)
Signed-off-by: Jyothirmai Kottu <jkottu@amazon.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-07-01 09:14:00 +00:00 |
|
|
|
ed41aa270a
|
[ROCm][DSV4] Use aiter mHC pre/post as the default ROCm path (#43950)
Signed-off-by: Fangzhou Ai <fangzhou.ai@amd.com>
Signed-off-by: Fangzhou-Ai <fangzhouai@gmail.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-07-01 16:27:42 +08:00 |
|
|
|
77a9c5ae28
|
Weight sync refactor + move sparse nccl engine (#44353)
Signed-off-by: hao-aaron <ahao@anyscale.com>
Signed-off-by: haoaaron <ahao@anyscale.com>
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
|
2026-07-01 01:25:19 -07:00 |
|
|
|
f651a8a9a4
|
[XPU][UT]Enable ut qk_norm_rope_fusion (#42486)
Signed-off-by: Lai, Yejing <yejing.lai@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-07-01 07:38:03 +00:00 |
|
|
Jee Jee LiandGitHub
|
8f82be5705
|
[CI/Build] Fix LoRA testing (#47242)
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
|
2026-07-01 15:36:13 +08:00 |
|
|
Nils MattesonandGitHub
|
a461070d1c
|
[Core] Make sleep-mode backend capability flags communicator-agnostic (#47243)
|
2026-07-01 07:17:44 +00:00 |
|
|
|
4470ae84de
|
Remove mantis (#46806)
Signed-off-by: Xianbao QIAN <xianbao.qian@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-07-01 07:13:58 +00:00 |
|
|
ChaunceyandGitHub
|
697c34b97b
|
[Bugfix] Fix beam search candidate indexing when logprobs count varies (#47126)
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
|
2026-07-01 07:07:06 +00:00 |
|
|
Blas Rodriguez IrizarandGitHub
|
5b431b905c
|
[Rust Frontend] Coerce completion max_tokens: null to default (#47166)
Signed-off-by: Blas Rodriguez Irizar <rodrigblas@gmail.com>
|
2026-07-01 06:41:33 +00:00 |
|
|
|
89e99202f2
|
[CPU][Perf]Added tanh AOR for faster gelu activations. (#44639)
Signed-off-by: Anna Mayne <anna.mayne@arm.com>
Signed-off-by: almayne <anna.mayne@arm.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
|
2026-06-30 23:24:40 -07:00 |
|
|
Micah WilliamsonandGitHub
|
b446792306
|
[ROCm][Bugfix] Fix Triton "out of resource: shared memory" Error In One-Shot LoRA MoE (#47209)
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
|
2026-06-30 23:24:36 -07:00 |
|
|
Micah WilliamsonandGitHub
|
c3b1f9e827
|
[ROCm][CI] Enable LoRA TP Distributed Test Group In AMD CI (#47193)
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
|
2026-06-30 23:24:32 -07:00 |
|
|
Jonathan MamouandGitHub
|
df802a87b7
|
[CPU] Remove speculative decoding stream overrides from CPUModelRunner (#47162)
Signed-off-by: jmamou <jonathan.mamou@intel.com>
|
2026-07-01 06:12:49 +00:00 |
|
|
Nils MattesonandGitHub
|
93d8f834dd
|
[Core] Pluggable sleep-mode backend abstraction (RFC #34303) (#44074)
|
2026-06-30 22:00:53 -07:00 |
|
|
Maria GuevaraandGitHub
|
aeb35b90f0
|
[Rust Frontend] Add error context in tool parser failures (#46512)
Signed-off-by: Maria Guevara <kawaiiplush14@gmail.com>
|
2026-07-01 12:48:55 +08:00 |
|
|
Gabriel WuandGitHub
|
9a08a5118e
|
fix: skip cooperative top-K on SM120 (#47164)
Signed-off-by: Zihua Wu <13583761+lucifer1004@users.noreply.github.com>
|
2026-06-30 21:32:54 -07:00 |
|
|
|
c5200d3565
|
[Attention][DSA] support dcp for FLASHINFER_MLA_SPARSE (#46076)
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Signed-off-by: Jingyi Yang <girasoleyang@gmail.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: GirasoleY <girasoleyang@gmail.com>
Co-authored-by: Jingyi Yang <girasoleyang@gmail.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-07-01 00:32:20 -04:00 |
|
|
MattandGitHub
|
3c1396bab6
|
[Hardware][AMD][CI] Toggle test coredumps on ROCm debug agent (#47222)
Signed-off-by: Matthew Wong <Matthew.Wong2@amd.com>
|
2026-06-30 23:30:10 -05:00 |
|
|
Benjamin ChislettandGitHub
|
9969466a59
|
[Spec Decode] Support SWA + DFlash for MiMo (#46104)
|
2026-06-30 20:34:47 -07:00 |
|
|
achyuthan.sandGitHub
|
3406e8f83d
|
[Bugfix][Frontend][gpt-oss] Return raw output when Harmony parser ends non-terminal (#47062)
Signed-off-by: Achyuthan Sivasankar <achyuthan.sivasankar@gmail.com>
|
2026-07-01 01:46:01 +00:00 |
|
|
|
a264e41975
|
[Distributed] Default FlashInfer allreduce to mnnvl on single node (#47219)
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-06-30 18:35:56 -07:00 |
|
|
Woosuk KwonandGitHub
|
f098ee70c7
|
[GLM5] Support FlashMLA FP8 KV cache (Hopper & Blackwell) (#47090)
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
|
2026-06-30 18:13:21 -07:00 |
|
|
|
9294dd27eb
|
fix(reasoning): guard rfind in ernie45 streaming </response> branch (#46255)
Signed-off-by: Chenglun Hu <chenglunhu@gmail.com>
Co-authored-by: Flora Feng <4florafeng@gmail.com>
|
2026-07-01 01:01:14 +00:00 |
|
|
yzong-rhandGitHub
|
b1190d03cc
|
[Refactor][GPT-OSS] Harmony Responses API Refactor to use HarmonyParser (#47185)
Signed-off-by: Yifan Zong <yzong@redhat.com>
|
2026-06-30 19:23:20 -04:00 |
|
|
|
92c7fac640
|
[Perf] Restore zero-init of swizzled NVFP4 scale buffer to recover Blackwell decode throughput (#45739)
Signed-off-by: Albert Cheng <albertching0112@gmail.com>
Co-authored-by: Vadim Gimpelson <156319763+vadiklyutiy@users.noreply.github.com>
|
2026-06-30 22:56:56 +00:00 |
|
|
Ting SUNandGitHub
|
ac521f6237
|
[Bugfix][Structured Outputs] Reject degenerate structured_outputs that crash EngineCore (#45346)
Signed-off-by: Ting Sun <suntcrick@gmail.com>
|
2026-06-30 22:41:33 +00:00 |
|
|
|
28242824e0
|
[Bugfix][Frontend] Normalize constrained Harmony recipients (#45657)
Signed-off-by: shaojunjie <626650687@qq.com>
Co-authored-by: Ben Browning <bbrownin@redhat.com>
|
2026-06-30 17:33:10 -04:00 |
|
|
VectorPeakandGitHub
|
68294739d1
|
[Bugfix] Align OpenCV video metadata timeline (#47099)
Signed-off-by: VectorPeak <73048950+VectorPeak@users.noreply.github.com>
|
2026-06-30 20:43:42 +00:00 |
|
|
|
c8d2f3cb14
|
[Bugfix] compressed-tensors: allow int8 grouped WNA16 MoE on Marlin (#47154)
Signed-off-by: Joe Rowell <joerowell4@gmail.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
|
2026-06-30 12:50:46 -07:00 |
|
|
MattandGitHub
|
345b28ff2f
|
[Hardware][AMD][CI] Bump timeouts of various test groups on AMD CI (#47195)
Signed-off-by: Matthew Wong <Matthew.Wong2@amd.com>
|
2026-06-30 14:30:53 -05:00 |
|
|
|
248d1fbb71
|
[Feat][1/N] CuTeDSL warmup infrastructure, FA4 MLA (#46182)
Signed-off-by: LopezCastroRoberto <rocastro@redhat.com>
Signed-off-by: Roberto L. Castro <38211239+LopezCastroRoberto@users.noreply.github.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
|
2026-06-30 12:17:34 -07:00 |
|