 Andreas KaratzasandGitHub
|
16282a9c4e
|
[ROCm][CI] Moving MI300 tests to MI325 until cluster is stabilized (#45170)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
|
2026-06-10 20:26:17 +00:00 |
|
|
|
5b6b536fdc
|
[ROCm][Bugfix] Make intermediate_pad TP-aware in rocm_aiter_fused_experts (#44679)
Signed-off-by: Rohan138 <rohanpotdar138@gmail.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-06-10 15:10:50 -05:00 |
|
|
|
12f3f19c19
|
feat(qwen3-asr): support prompt parameter in v1/audio/transcriptions (#35415)
Signed-off-by: Nathan Price <nathan@abridge.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-06-10 19:54:59 +00:00 |
|
|
Ilya MarkovandGitHub
|
6471ec75bd
|
[EPLB] Reject NCCL-based EPLB communicators with async EPLB (#44978)
Signed-off-by: Markov Ilya <markovilya197@gmail.com>
|
2026-06-10 19:51:27 +00:00 |
|
|
|
3d300aecb1
|
[Doc] Switch K8S examples to default MP mode (#39400)
Signed-off-by: Peter Pan <Peter.Pan@daocloud.io>
Signed-off-by: Peter Pan <peter.pan@daocloud.io>
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Kyle Sayers <kylesayrs@gmail.com>
Co-authored-by: Flora Feng <4florafeng@gmail.com>
|
2026-06-10 18:17:11 +00:00 |
|
|
|
ffce72c041
|
[Model Runner V2] Fix v2 AttributeError: 'CohereASRDecoder' object has no attribute 'embed_input_ids' (#44568)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-06-10 11:06:01 -07:00 |
|
|
TJianandGitHub
|
bfe1001ab6
|
[Bugfix] [DSV4] [ROCm] Pin apache-tvm-ffi version to 0.1.10 (#45169)
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
|
2026-06-10 17:41:15 +00:00 |
|
|
|
fa8c868a3c
|
[Bugfix] Fix Llama4 weight loading (#45047)
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
|
2026-06-10 13:40:45 -04:00 |
|
|
Ben BrowningandGitHub
|
d1bcb4b44c
|
[Bugfix] Fix tool parsing crash with non-function tool types (e.g. WebSearchTool) (#45147)
Signed-off-by: Ben Browning <bbrownin@redhat.com>
|
2026-06-10 17:17:16 +00:00 |
|
|
bnellnmandGitHub
|
29026682cb
|
[Bugfix] Fix nemotron accuracy drop introduced by #41184 (#45037)
Signed-off-by: Bill Nell <bnell@redhat.com>
|
2026-06-10 13:16:25 -04:00 |
|
|
Stan WozniakandGitHub
|
dc66e01a70
|
[Hybrid] Marconi-style admission policy for hybrid cache (#37898)
Signed-off-by: Stanislaw Wozniak <stw@zurich.ibm.com>
|
2026-06-10 10:03:13 -07:00 |
|
|
Yongye ZhuandGitHub
|
2ba68d9bf7
|
[Test] Fix one-sided MNNVL alltoall test workspace under-reservation (#44946)
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
|
2026-06-11 00:43:12 +08:00 |
|
|
Julien DenizeandGitHub
|
2131b597b1
|
[CI] Ping Mistral team for ministral/voxtral/mixtral/pixtral changes (#45153)
Signed-off-by: juliendenize <julien.denize@mistral.ai>
|
2026-06-10 08:48:00 -07:00 |
|
|
|
0bae1d3848
|
[MRV2][Spec Decode] DFlash (#44586)
Signed-off-by: Giancarlo Delfin <gdelfin@inferact.ai>
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
Signed-off-by: Benjamin Chislett <chislett.ben@gmail.com>
Co-authored-by: Giancarlo Delfin <gdelfin@inferact.ai>
|
2026-06-10 08:47:46 -07:00 |
|
|
Yufeng HeandGitHub
|
4673ca1d78
|
fix: prefix DeepSeek V4 MTP projections (#44821)
Signed-off-by: Yufeng He <40085740+he-yufeng@users.noreply.github.com>
|
2026-06-10 08:47:04 -07:00 |
|
|
Angela YiandGitHub
|
de900fa7e5
|
fix: AOT compile cache collision for dataclass-based HF configs (#45059)
Signed-off-by: Angela Yi <yiangela7@gmail.com>
|
2026-06-10 08:05:29 -07:00 |
|
|
Divakar VermaandGitHub
|
166d14e9bf
|
[bugfix] skip conch kernel for g_idx reordering (#45072)
Signed-off-by: Divakar Verma <divakar.verma@amd.com>
|
2026-06-10 23:04:19 +08:00 |
|
|
|
af65e08fc5
|
KV-Cache multi-tier offloading async batched lookup (#44193)
Signed-off-by: Effi Ofer <effi.ofer@gmail.com>
Co-authored-by: Or Ozeri <oro@il.ibm.com>
|
2026-06-10 14:59:30 +00:00 |
|
|
Harry MellorandGitHub
|
3cc9fecd58
|
Deprecated 1st generation Qwen and QwenVL models (#45131)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-06-10 14:55:33 +00:00 |
|
|
|
ccc05de038
|
[Bugfix] Fix missing sequence_lengths in EXAONE-4.5 vision encoder (#45073)
Signed-off-by: Jongsu Liam Kim <jongsukim8@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-06-10 15:44:34 +01:00 |
|
|
|
6ec7dcd641
|
[Frontend][Metrics] Add vllm:tool_call_parser_invocations_total Prometheus metric (#44448)
Signed-off-by: Yifan Zong <yzong@redhat.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-06-10 10:29:11 -04:00 |
|
|
|
c9e5bf8135
|
[Bugfix] Fix layerwise reload dropping params after a composed weight loader (#44814)
Signed-off-by: hallerite <git@hallerite.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Co-authored-by: Kyle Sayers <kylesayrs@gmail.com>
|
2026-06-10 06:42:05 -07:00 |
|
|
Roberto L. CastroandGitHub
|
6850839c6f
|
[Perf] Fix dsv3_router_gemm heuristic (#44217)
Signed-off-by: LopezCastroRoberto <rocastro@redhat.com>
|
2026-06-10 06:08:41 -07:00 |
|
|
|
87c15d46e3
|
[Bugfix] Lazily import the humming quantization backend (#44921)
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-06-10 06:06:17 -07:00 |
|
|
|
4882fd7632
|
[Bugfix][Reasoning] Nemotron V3: surface reasoning as content when thinking is unterminated (#39091)
Signed-off-by: Andrii Skliar <askliar@nvidia.com>
Co-authored-by: Andrii Skliar <askliar@nvidia.com>
|
2026-06-10 05:58:19 -07:00 |
|
|
|
77f42d9725
|
[Model] Remove obsolete ERNIE models (#45127)
Signed-off-by: Xianbao QIAN <xianbao.qian@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-06-10 20:54:30 +08:00 |
|
|
|
9dfc313bdc
|
Feature/offloading manager stats (#35669)
Signed-off-by: Sriusa4414@gmail.com
Signed-off-by: srinivas_oo7 <Sriusa4414@gmail.com>
Signed-off-by: srinivas_oo7 <sklinkedin0120@gmail.com>
Signed-off-by: Srinivasoo7 <158864704+Srinivasoo7@users.noreply.github.com>
Signed-off-by: Or Ozeri <oro@il.ibm.com>
Co-authored-by: srinivas_oo7 <sklinkedin0120@gmail.com>
Co-authored-by: Srinivasoo7 <158864704+Srinivasoo7@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Or Ozeri <oro@il.ibm.com>
|
2026-06-10 12:44:55 +00:00 |
|
|
|
9ad08c4d15
|
[Bugfix][Rust Frontend] Fix missing added tokens in hf/fastokens tokenizer (#44683)
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
|
2026-06-10 03:52:41 -07:00 |
|
|
Shantipriya ParidaandGitHub
|
a1ec011a83
|
[Bugfix] Add deepseek_v32 to Quark dynamic MXFP4 model type check (#39498)
Signed-off-by: Shantipriya Parida <shantipriya.parida@amd.com>
|
2026-06-10 02:52:33 -07:00 |
|
|
Bugen ZhaoandGitHub
|
fdfb2566c0
|
[Rust Frontend] [CI] Unify Rust artifact builds with setuptools-rust (#44981)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-06-10 17:48:34 +08:00 |
|
|
Juan Pérez de AlgabaandGitHub
|
8a5cf1ccd6
|
[Security] Fix remote DoS via invalid recovered token reinjection (#44744)
Signed-off-by: jperezde <jperezde@redhat.com>
|
2026-06-10 02:31:43 -07:00 |
|
|
Kunshang JiandGitHub
|
fe1d923afc
|
[BUGFIX][XPU] fix xpu flash_attn_varlen_func interface (#45110)
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-06-10 17:07:40 +08:00 |
|
|
|
32daf56b42
|
[Refactor] Rename rocm_moe.py to rocm_moe_rdna.py (#45011)
Signed-off-by: JartX <sagformas@epdcenter.es>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-06-10 17:02:09 +08:00 |
|
|
Andreas KaratzasandGitHub
|
82a42234be
|
[ROCm][CI] Defer AITER sampler import and isolate server test PYTHONPATH (#44823)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
|
2026-06-10 08:56:11 +00:00 |
|
|
Harry MellorandGitHub
|
af9f583344
|
Revert "[Bugfix][CI] Gemma3 Transformers multimodal encoder profiling and build prompt-embedding fixtures" (#45029)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-06-10 01:37:03 -07:00 |
|
|
yihengandGitHub
|
bd2d83ff31
|
[SpecDecode] Reduce TP communication for large-vocab draft models speculative decoding (#39419)
Signed-off-by: EanWang211123 <wangyiheng@sangfor.com.cn>
|
2026-06-10 07:59:24 +00:00 |
|
|
xiaohuguo2023andGitHub
|
bb78168b21
|
[ROCm][gpt-oss] Hybrid CDNA4 swizzle gate for A8W4 MoE (#44804)
Signed-off-by: Xiaohu Guo <Xiaohu.Guo@amd.com>
|
2026-06-09 23:59:44 -07:00 |
|
|
|
89c6a41001
|
[Bench] Add BFCL dataset for vllm bench serve tool-calling workloads (#42457)
Signed-off-by: Li Zhang <lzhanga@amazon.com>
Co-authored-by: Li Zhang <lzhanga@amazon.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
|
2026-06-09 23:59:18 -07:00 |
|
|
|
7fdfa6441d
|
Model/colbert autoweightsloader (#44999)
Signed-off-by: Furkan Fidan <dev@yufufi.com>
Co-authored-by: wang.yuqi <yuqi.wang@daocloud.io>
|
2026-06-09 23:58:50 -07:00 |
|
|
Harry MellorandGitHub
|
e9b728de8a
|
Change from owning configs to owning config utils (#45058)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-06-10 06:40:25 +00:00 |
|
|
|
5828a205ef
|
Fix Harmony tool descriptions for optional fields (#44686)
Signed-off-by: Varun Shenoy <varun.vinayak.shenoy@oracle.com>
Co-authored-by: Codex <codex@openai.com>
|
2026-06-09 23:29:22 -07:00 |
|
|
Yaoming ZhanandGitHub
|
7a74f31d2e
|
[Rust Frontend] Add seed_oss and step3p5 reasoning parsers (#44552)
Signed-off-by: yzhan1 <zhanyaoming2014@gmail.com>
|
2026-06-09 23:01:33 -07:00 |
|
|
|
47930b59ca
|
[Bugfix] Handle HWC images in ImageProcessorItems.get_image_size (#45057)
Signed-off-by: YellowFoxH4XOR <yellowfoxh4xor@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-06-10 05:35:50 +00:00 |
|
|
Flora FengandGitHub
|
6aec99f030
|
[Refactor] Remove dead states from chat completion serving (#45081)
Signed-off-by: sfeng33 <4florafeng@gmail.com>
|
2026-06-09 22:20:15 -07:00 |
|
|
bnellnmandGitHub
|
f4966f8b3d
|
[Bugfix] Fix weight loading issues caused by #41184 (#45054)
Signed-off-by: Bill Nell <bnell@redhat.com>
|
2026-06-10 01:20:13 -04:00 |
|
|
Mohammad Miadh AngkadandGitHub
|
2c9c07c85e
|
[Bugfix][CI/Build] Fix Rust frontend build after chat conversion refactor (#45085)
Signed-off-by: Mohammad Miadh Angkad <176301910+mmangkad@users.noreply.github.com>
|
2026-06-09 20:04:41 -07:00 |
|
|
Change72andGitHub
|
320c52b134
|
[Bench] benchmark_serving_multi_turn: make non-standard conversation_id payload opt-in (#43756)
Signed-off-by: Change72 <cguo51@asu.edu>
|
2026-06-09 19:41:56 -07:00 |
|
|
|
6deb05e0e4
|
[Core][Model] Gemma4: Unified FA4 for all layers + FlashAttention mm_prefix support (#42175)
Signed-off-by: Luciano Martins <lucianommartins@users.noreply.github.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Luciano Martins <lucianommartins@users.noreply.github.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
|
2026-06-09 17:45:39 -07:00 |
|
|
Flora FengandGitHub
|
d82ac00923
|
[Refactor][Mistral] Extract parsing logic into MistralParser (#44596)
Signed-off-by: sfeng33 <4florafeng@gmail.com>
|
2026-06-10 00:12:23 +00:00 |
|
|
Bugen ZhaoandGitHub
|
dac9e9a640
|
[Rust Frontend] Extract shared options in route helper params (#44884)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-06-09 17:02:35 -07:00 |
|