 Nick Hill
|
064cd5aefe
|
Fix test_config.py
Signed-off-by: Nick Hill <nickhill123@gmail.com>
|
2026-07-02 17:19:01 +01:00 |
|
|
Nick Hill
|
d98288d6c9
|
Merge remote-tracking branch 'origin/main' into wentao-mrv2-enable-all-moe
Signed-off-by: Nick Hill <nickhill123@gmail.com>
# Conflicts:
# vllm/config/vllm.py
|
2026-07-02 15:44:28 +01:00 |
|
|
|
a2f713002d
|
[ModelRunner V2] Enable by default for all dense models (#44443)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
|
2026-07-02 18:48:57 +08:00 |
|
|
|
b0b8a286dd
|
[Model] Add LLaVA-OneVision-2 (LlavaOnevision2ForConditionalGeneration) (#44785)
Signed-off-by: chengzheng345 <209475443+chengzheng345@users.noreply.github.com>
Co-authored-by: chengzheng345 <209475443+chengzheng345@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-07-02 16:41:49 +08:00 |
|
|
|
3af8789559
|
[Feature] Universal speculative decoding for heterogeneous vocabularies (TLI) (#38174)
Signed-off-by: wan-danfeng <wandanfeng0802@gmail.com>
Signed-off-by: Wonderful <wandanfeng0802@gmail.com>
Co-authored-by: Wan_DF <wonderful199082@126.com>
Co-authored-by: Benjamin Chislett <chislett.ben@gmail.com>
Co-authored-by: Benjamin Chislett <bchislett@nvidia.com>
|
2026-07-02 01:34:20 -07:00 |
|
|
Nick HillandGitHub
|
7192e59902
|
Merge branch 'main' into wentao-mrv2-enable-all-moe
|
2026-07-02 09:02:57 +01:00 |
|
|
xaguilar-amdandGitHub
|
09663abde0
|
[ROCm][MLA] Fuse MLA q/kv RMSNorm + FP8 per-token quant in the FP8 attention path (#44977)
Signed-off-by: Xavier Aguilar <xavier.aguilarfruto@amd.com>
Signed-off-by: Xavier Aguilar <Xavier.AguilarFruto@amd.com>
|
2026-07-02 13:00:41 +08:00 |
|
|
|
7fe7fa9cda
|
[CI][Bugfix] Rerun test_engine_log_metrics_ray on Ray GCS startup timeout (#47208)
Signed-off-by: pei.zhang <pei.zhang@amd.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-07-01 21:32:09 -05:00 |
|
|
|
00eb7cefa3
|
[Bugfix] Prevent padding placeholders from reaching embeddings (#47029)
Signed-off-by: qianlihuang <91178480+qianlihuang@users.noreply.github.com>
Signed-off-by: Yiliu Dong <91178480+qianlihuang@users.noreply.github.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
|
2026-07-01 09:26:03 -07:00 |
|
|
Michał GanczarenkoandGitHub
|
c8bdcc0116
|
[Bench][BugFix] Fix empty decoder prompt for Cohere ASR in throughput benchmark (#47135)
Signed-off-by: Michal Ganczarenko <michal.ganczarenko@intel.com>
|
2026-07-01 15:42:27 +00:00 |
|
|
|
f5a8d73377
|
[Spec Decode] DSpark (#46995)
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
Signed-off-by: Giancarlo Delfin <gdelfin@inferact.ai>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Giancarlo Delfin <gdelfin@inferact.ai>
Co-authored-by: mgoin <mgoin64@gmail.com>
|
2026-07-01 08:30:24 -07:00 |
|
|
Nick HillandGitHub
|
f1cf6b0086
|
[CI] Fix segfault in tracing test (#47299)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
|
2026-07-01 14:00:37 +00:00 |
|
|
Harry MellorandGitHub
|
a78c15616f
|
Migrate GPTBigCode and Starcoder2 to the Transformers modeling backend (#30966)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-07-01 13:41:36 +00:00 |
|
|
Harry MellorandGitHub
|
a22e0dfc69
|
[Model] Remove AyaVision, MusicFlamingo (#47263)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-07-01 10:39:33 +00:00 |
|
|
Harry MellorandGitHub
|
e7d0fcbc09
|
[CI] Fix various failures on main (#47197)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-07-01 10:35:34 +01:00 |
|
|
Andy LoandGitHub
|
fa4bec9056
|
[Bugfix] Fix pooled Whisper sliding-window KV sizing (#47071)
Signed-off-by: Andy Lo <andy@mistral.ai>
|
2026-07-01 11:33:19 +02:00 |
|
|
|
dee5da1dec
|
[Test] Run SageMaker handler-override tests in-process via TestClient (#47250)
Signed-off-by: Jyothirmai Kottu <jkottu@amazon.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-07-01 09:14:00 +00:00 |
|
|
|
77a9c5ae28
|
Weight sync refactor + move sparse nccl engine (#44353)
Signed-off-by: hao-aaron <ahao@anyscale.com>
Signed-off-by: haoaaron <ahao@anyscale.com>
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
|
2026-07-01 01:25:19 -07:00 |
|
|
|
f651a8a9a4
|
[XPU][UT]Enable ut qk_norm_rope_fusion (#42486)
Signed-off-by: Lai, Yejing <yejing.lai@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-07-01 07:38:03 +00:00 |
|
|
Jee Jee LiandGitHub
|
8f82be5705
|
[CI/Build] Fix LoRA testing (#47242)
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
|
2026-07-01 15:36:13 +08:00 |
|
|
Nils MattesonandGitHub
|
a461070d1c
|
[Core] Make sleep-mode backend capability flags communicator-agnostic (#47243)
|
2026-07-01 07:17:44 +00:00 |
|
|
|
4470ae84de
|
Remove mantis (#46806)
Signed-off-by: Xianbao QIAN <xianbao.qian@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-07-01 07:13:58 +00:00 |
|
|
ChaunceyandGitHub
|
697c34b97b
|
[Bugfix] Fix beam search candidate indexing when logprobs count varies (#47126)
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
|
2026-07-01 07:07:06 +00:00 |
|
|
|
89e99202f2
|
[CPU][Perf]Added tanh AOR for faster gelu activations. (#44639)
Signed-off-by: Anna Mayne <anna.mayne@arm.com>
Signed-off-by: almayne <anna.mayne@arm.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
|
2026-06-30 23:24:40 -07:00 |
|
|
Micah WilliamsonandGitHub
|
c3b1f9e827
|
[ROCm][CI] Enable LoRA TP Distributed Test Group In AMD CI (#47193)
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
|
2026-06-30 23:24:32 -07:00 |
|
|
Nils MattesonandGitHub
|
93d8f834dd
|
[Core] Pluggable sleep-mode backend abstraction (RFC #34303) (#44074)
|
2026-06-30 22:00:53 -07:00 |
|
|
|
c5200d3565
|
[Attention][DSA] support dcp for FLASHINFER_MLA_SPARSE (#46076)
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Signed-off-by: Jingyi Yang <girasoleyang@gmail.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: GirasoleY <girasoleyang@gmail.com>
Co-authored-by: Jingyi Yang <girasoleyang@gmail.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-07-01 00:32:20 -04:00 |
|
|
MattandGitHub
|
3c1396bab6
|
[Hardware][AMD][CI] Toggle test coredumps on ROCm debug agent (#47222)
Signed-off-by: Matthew Wong <Matthew.Wong2@amd.com>
|
2026-06-30 23:30:10 -05:00 |
|
|
Benjamin ChislettandGitHub
|
9969466a59
|
[Spec Decode] Support SWA + DFlash for MiMo (#46104)
|
2026-06-30 20:34:47 -07:00 |
|
|
achyuthan.sandGitHub
|
3406e8f83d
|
[Bugfix][Frontend][gpt-oss] Return raw output when Harmony parser ends non-terminal (#47062)
Signed-off-by: Achyuthan Sivasankar <achyuthan.sivasankar@gmail.com>
|
2026-07-01 01:46:01 +00:00 |
|
|
Woosuk KwonandGitHub
|
f098ee70c7
|
[GLM5] Support FlashMLA FP8 KV cache (Hopper & Blackwell) (#47090)
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
|
2026-06-30 18:13:21 -07:00 |
|
|
yzong-rhandGitHub
|
b1190d03cc
|
[Refactor][GPT-OSS] Harmony Responses API Refactor to use HarmonyParser (#47185)
Signed-off-by: Yifan Zong <yzong@redhat.com>
|
2026-06-30 19:23:20 -04:00 |
|
|
Ting SUNandGitHub
|
ac521f6237
|
[Bugfix][Structured Outputs] Reject degenerate structured_outputs that crash EngineCore (#45346)
Signed-off-by: Ting Sun <suntcrick@gmail.com>
|
2026-06-30 22:41:33 +00:00 |
|
|
|
28242824e0
|
[Bugfix][Frontend] Normalize constrained Harmony recipients (#45657)
Signed-off-by: shaojunjie <626650687@qq.com>
Co-authored-by: Ben Browning <bbrownin@redhat.com>
|
2026-06-30 17:33:10 -04:00 |
|
|
VectorPeakandGitHub
|
68294739d1
|
[Bugfix] Align OpenCV video metadata timeline (#47099)
Signed-off-by: VectorPeak <73048950+VectorPeak@users.noreply.github.com>
|
2026-06-30 20:43:42 +00:00 |
|
|
|
11b26c5528
|
[Bugfix][Tool Parser] PoolsideV1: fix logprobs AttributeError on Responses API (#47138)
Signed-off-by: Joe Rowell <joerowell4@gmail.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
|
2026-06-30 19:14:09 +00:00 |
|
|
Andreas KaratzasandGitHub
|
c8f9c156a5
|
[ROCm][V1][MLA] Clone prefill backend state per metadata builder (#46993)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
|
2026-06-30 11:43:54 -07:00 |
|
|
|
953bba488d
|
[PERF] Extend NCCL symmetric memory to AllGather and ReduceScatter (#46703)
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
Co-authored-by: snordmann <snordmann@nvidia.com>
|
2026-06-30 11:38:18 -07:00 |
|
|
Wentao YeandGitHub
|
3a9784b82c
|
[Feature] DP supervisor using rust frontend (#47076)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
|
2026-06-30 14:34:05 -04:00 |
|
|
|
727971f1c1
|
Add Medusa speculative decoding e2e test (#41396)
Signed-off-by: Anshika Ojha <anshikao@nvidia.com>
Signed-off-by: Rishi Puri <riship@nvidia.com>
Signed-off-by: Rishi Puri <puririshi98@berkeley.edu>
Signed-off-by: Stefano Castagnetta <scastagnetta@nvidia.com>
Co-authored-by: Anshika Ojha <215760622+ojhaanshika@users.noreply.github.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Stefano Castagnetta <scastagnetta@nvidia.com>
|
2026-06-30 18:02:22 +00:00 |
|
|
|
25671cb520
|
[Parser][Bugfix] Ensure tool call or other special tokens don't leak in non-streaming tool parsing (#46875)
Signed-off-by: Ben Browning <bbrownin@redhat.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
|
2026-06-30 13:46:53 -04:00 |
|
|
|
27d5f78b63
|
[CI] Move distributed small LM eval to B200 (#47048)
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-06-30 13:34:25 -04:00 |
|
|
liuzhenweiandGitHub
|
7a341fa109
|
[XPU] Support ZE_AFFINITY_MASK passthrough in xpu_disagg_acc_test (#47105)
Signed-off-by: zhenwei-intel <zhenwei.liu@intel.com>
|
2026-06-30 17:06:12 +00:00 |
|
|
|
e840f0d3f5
|
[Platform] Replace torch.cuda.Event with torch.Event (#47140)
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-06-30 08:39:59 -07:00 |
|
|
|
fcaa84efa7
|
[BugFix] Gate MRV2 mixed sparse-MLA warmup on max_num_seqs > 1 (#47050)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: ziminghuang <ziminghuang@inferact.ai>
|
2026-06-30 16:31:27 +01:00 |
|
|
|
d8f483dc30
|
[Spec Decode] Fix hidden-state extraction block size for hybrid verifiers (#46301)
Signed-off-by: Igor Margulis <igor.margulis@intel.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
|
2026-06-30 08:19:51 -07:00 |
|
|
Nicolò LucchesiandGitHub
|
dc148dc4d7
|
[CI][Bugfix] Fix Hybrid SSM NixlConnector PD prefix cache test (2 GPUs) (#47157)
Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai>
|
2026-06-30 23:14:13 +08:00 |
|
|
|
c231d1f290
|
fix(security): bound tokenizer work when explicit truncation_side is set (#47007)
Signed-off-by: jperezde <jperezde@redhat.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-06-30 23:08:51 +08:00 |
|
|
Giancarlo DelfinandGitHub
|
db808b3961
|
[Model Runner V2][Spec Decode] Implement block verification for rejection sampling (#46781)
Signed-off-by: Giancarlo Delfin <gdelfin@inferact.ai>
|
2026-06-30 08:07:24 -07:00 |
|
|
|
ded6676458
|
[Bugfix] Seed RayExecutorV2 TCPStore port by DP rank to avoid collisions (#45960)
Signed-off-by: Seiji Eicher <seiji@anyscale.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-06-30 07:37:34 -07:00 |
|