 Bugen Zhao
|
a99bc9e6f9
|
remove default impl on id_to_token
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-06-30 15:14:45 +08:00 |
|
|
Bugen Zhao
|
ebc444a533
|
replace more
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-06-30 15:10:18 +08:00 |
|
|
Bugen Zhao
|
8fd4cfa611
|
non-ascii roundtrip
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-06-30 15:08:15 +08:00 |
|
|
Bugen Zhao
|
7ff1a4e47a
|
update callsite
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-06-30 14:53:50 +08:00 |
|
|
Bugen Zhao
|
82f53366f5
|
stronger invariant
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-06-30 14:39:05 +08:00 |
|
|
Bugen Zhao
|
777fa7cf20
|
introduce TestTokenizer
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-06-30 14:23:56 +08:00 |
|
|
|
97b5ce5c39
|
[Bugfix] Raise VLLMValidationError for non-integer logit_bias keys (#46612)
Signed-off-by: muhammadfawaz1 <135441198+muhammadfawaz1@users.noreply.github.com>
Co-authored-by: Mahad Durrani <114791389+mahadrehmann@users.noreply.github.com>
|
2026-06-30 06:18:59 +00:00 |
|
|
Andreas KaratzasandGitHub
|
4236514098
|
[ROCm][CI][Multimodal] Use ROCm-aware FA availability check for Unlimited-OCR (#47004)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
|
2026-06-30 14:03:13 +08:00 |
|
|
Blas Rodriguez IrizarandGitHub
|
e45c8a9f4b
|
[Rust Frontend] Start current wave for a stale DP FirstRequest (#46833)
Signed-off-by: Blas Rodriguez Irizar <rodrigblas@gmail.com>
|
2026-06-30 05:13:09 +00:00 |
|
|
Wei ZhaoandGitHub
|
b153dd3f28
|
[Bugfix] Use larger workspace size for Flashinfer MLA LSE (#47074)
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
|
2026-06-29 22:11:03 -07:00 |
|
|
ReidandGitHub
|
930f8dc0a1
|
[Bugfix][Rust Frontend] Reject prompt_logprobs for streaming generate (#46839)
Signed-off-by: reidliu41 <reid201711@gmail.com>
|
2026-06-30 05:10:07 +00:00 |
|
|
ReidandGitHub
|
a16dbd5b85
|
[Rust Frontend] Avoid LoRA registry scans without active LoRA requests (#47040)
Signed-off-by: reidliu41 <reid201711@gmail.com>
|
2026-06-30 04:58:19 +00:00 |
|
|
|
bec232a914
|
Secondary tier implementation for PD disaggregation (#42285)
Signed-off-by: Liran Schour <lirans@il.ibm.com>
Signed-off-by: liranschour <liranschour@users.noreply.github.com>
Co-authored-by: Or Ozeri <or@ozery.com>
Co-authored-by: Or Ozeri <oro@il.ibm.com>
|
2026-06-30 07:51:44 +03:00 |
|
|
|
b5c9e1ac33
|
[LoRA] Add language-backbone LoRA support for MiniCPM-V 4.6 (#46740)
Signed-off-by: linitra24 <Joy25810@foxmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
|
2026-06-30 04:19:31 +00:00 |
|
|
|
ae2c4f3db7
|
[XPU][UT]Fix xpu pass_config.fuse_norm_quant assert issue (#46804)
Signed-off-by: Lai, Yejing <yejing.lai@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-06-29 21:13:44 -07:00 |
|
|
ganeshandGitHub
|
fca432e60a
|
[Bugfix] Propagate default stop_token_ids to per-request SamplingParams (#35076)
Signed-off-by: sriganesh123 <arjulasriganesh@gmail.com>
|
2026-06-30 12:10:09 +08:00 |
|
|
|
af1ee8c475
|
fix(config): reject negative max_logprobs (except -1) and long_prefill_token_threshold (#44070)
Signed-off-by: Chenglun Hu <chenglunhu@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-06-30 04:02:36 +00:00 |
|
|
|
5b4cb69523
|
[Bugfix][MLA] Fix LSE log-base mismatch in DCP + FlashInfer MLA decode (#47079)
Signed-off-by: girasoley <girasoleyang@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-06-29 19:15:02 -07:00 |
|
|
|
9fc0c08026
|
[ROCm][CI] Make tests/v1/shutdown an importable package (#47085)
Signed-off-by: pei.zhang <pei.zhang@amd.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-06-29 21:01:27 -05:00 |
|
|
|
f2b5fabb23
|
[ROCm][CI] Move LM Eval Large Models (8 GPUs) to mi300 pool (#47094)
Signed-off-by: pei.zhang <pei.zhang@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-06-29 20:59:08 -05:00 |
|
|
|
b8cb75b149
|
[Rust Frontend] Add static HTTPS and mTLS support for HTTP and gRPC (#45890)
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Signed-off-by: Tahsin Tunan <tahsintunan@gmail.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-06-30 01:45:59 +00:00 |
|
|
Thien TranandGitHub
|
43916891b2
|
[GDN] Improve kkt kernel of CuteDSL prefill backend (#46346)
Signed-off-by: Thien Tran <gau.nernst@yahoo.com.sg>
|
2026-06-29 18:34:18 -07:00 |
|
|
|
cda05ee8c4
|
[Bugfix][Reasoning] Fix thinking_token_budget not enforced on re-entry after forced end (#43757)
Signed-off-by: Ashwin Giridharan <girida@amazon.com>
Signed-off-by: Cursor Agent <cursor-agent@cursor.com>
Co-authored-by: Cursor Agent <cursor-agent@cursor.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>
|
2026-06-30 01:04:25 +00:00 |
|
|
weishuandGitHub
|
77654d080c
|
[KVTransfer] MultiConnector: merge kv_transfer_params dicts across connectors (#46777)
Signed-off-by: deng451e <838677410@qq.com>
|
2026-06-30 00:25:05 +00:00 |
|
|
Wentao YeandGitHub
|
75698e60b3
|
[Bug] Fix sparse attention issue for GLM5.2 non-torch compile path (#47083)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
|
2026-06-29 15:45:53 -07:00 |
|
|
Andreas KaratzasandGitHub
|
8632c884dc
|
[ROCm][CI] Use spawn around the threaded OTLP test (#47003)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
|
2026-06-29 16:34:05 -05:00 |
|
|
|
c3734e8334
|
[CI][Bugfix] Add cohere_melody to ROCm test requirements (#47072)
Signed-off-by: pei.zhang <pei.zhang@amd.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-06-29 16:29:47 -05:00 |
|
|
|
53f7553f09
|
[ROCm][DeepEP] Stabilize high-throughput DBO for DP+EP (#46990)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
|
2026-06-29 14:28:02 -07:00 |
|
|
|
4eb227992a
|
[ROCm][CI] Make memory sampling less racy in tests and sleep mode (#45490)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Signed-off-by: Codex <codex@example.invalid>
Co-authored-by: Codex <codex@example.invalid>
|
2026-06-29 14:26:41 -07:00 |
|
|
Micah WilliamsonandGitHub
|
ebcf511ec3
|
[ROCm][CI] Soft Fail Spec Decode Ngram + Suffix and Entrypoints Integration (LLM) AMD Mirrors (#47067)
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
|
2026-06-29 16:24:08 -05:00 |
|
|
Matthew BonanniandGitHub
|
8fc1b2d046
|
Fix FA4 dynamic_causal for full attention layers (#46659)
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
|
2026-06-29 14:23:34 -07:00 |
|
|
Harry MellorandGitHub
|
5316638a5e
|
Fix transient dependency issues caused by requirements/common.txt (#47015)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-06-29 14:20:33 -07:00 |
|
|
zhrrrandGitHub
|
61ab70ec3b
|
[Model Runner V2] support mamba hybrid models align prefix cache (#42406)
Signed-off-by: zhuhaoran <zhuhaoran.zhr@alibaba-inc.com>
|
2026-06-29 14:09:16 -07:00 |
|
|
Woosuk KwonandGitHub
|
a309d4fe60
|
Support DCP with FlashInfer MLA (#43729)
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
|
2026-06-29 13:24:29 -07:00 |
|
|
|
72f639927f
|
[XPU] [RMSNorm] revert weightless change on xpu (#46987)
Signed-off-by: Zhu, Zufang <zufang.zhu@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-06-29 19:03:06 +00:00 |
|
|
Nick HillandGitHub
|
8ad4a01825
|
[ModelRunner V2] Simplify recent UnlimitedOCR-related changes (#46975)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
|
2026-06-29 09:56:17 -07:00 |
|
|
Jee Jee LiandGitHub
|
7be582697b
|
[Bugfix] Fix DeepseekV2Model hidden_size (#46986)
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
|
2026-06-29 16:44:05 +00:00 |
|
|
|
030c9523bd
|
[Perf][1/N] Expand Triton kernel warmup coverage, DSv4 (#46634)
Signed-off-by: LopezCastroRoberto <rocastro@redhat.com>
Signed-off-by: Roberto L. Castro <38211239+LopezCastroRoberto@users.noreply.github.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
|
2026-06-29 16:40:34 +00:00 |
|
|
|
4708292d48
|
Bump flashinfer version to 0.6.13 (#46683)
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
|
2026-06-29 09:30:57 -07:00 |
|
|
|
debec6440b
|
Add MiniMax-M3 modelopt nvfp4 support (#46756)
Signed-off-by: Xin Li <xinli@nvidia.com>
Signed-off-by: jasonlizhengjian <jasonlizhengjian@gmail.com>
Co-authored-by: Xin Li <xinli@nvidia.com>
|
2026-06-29 09:29:39 -07:00 |
|
|
|
c8fb2963bd
|
[FS-Offloading] Batch Lookup in C (#46713)
Signed-off-by: <>
Co-authored-by: Varun Sundar Rabindranath <varun-sundar-rabindranath@h100-01.nemg-001.lab.rdu2.dc.redhat.com>
|
2026-06-29 09:28:32 -07:00 |
|
|
HDCharlesandGitHub
|
379acd4e4f
|
[Bugfix][Quantization] Fix W8A8 int-quantized scheme selection regression (#46860)
Signed-off-by: HDCharles <charlesdavidhernandez@gmail.com>
|
2026-06-29 15:55:42 +00:00 |
|
|
Martin HickeyandGitHub
|
07d33e575b
|
[MyPy] Fix mypy incompatible assignment errors in LRUCacheLoRAModelManager (#44657)
Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com>
|
2026-06-29 16:42:35 +01:00 |
|
|
|
36bbecd643
|
[BugFix] Revert "[KV Offload] Use background thread for mmap / cpu_tensors pinning" (#46958)
Signed-off-by: <>
Co-authored-by: Varun Sundar Rabindranath <varun-sundar-rabindranath@h100-01.nemg-001.lab.rdu2.dc.redhat.com>
|
2026-06-29 07:54:34 -07:00 |
|
|
Nicolò LucchesiandGitHub
|
6149187a4c
|
[Kernel] Triton MLA logits workspace (#46819)
Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai>
|
2026-06-29 07:54:29 -07:00 |
|
|
Xiaohong (Sean) ChenandGitHub
|
49e28e8e91
|
[Kernel][Helion][1/N] Add Helion kernel for fused_qk_norm_rope (#44010)
Signed-off-by: Sean Chen <seachen@redhat.com>
|
2026-06-29 22:54:15 +08:00 |
|
|
|
0ca39c4f1f
|
[Bugfix] Capture final-layer aux hidden state in deepseek_v2 backbone (#46973)
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-06-29 10:00:31 -04:00 |
|
|
Blas Rodriguez IrizarandGitHub
|
6185d73882
|
[Rust Frontend] Keep literal "null" string for string-typed tool params (#46827)
Signed-off-by: Blas Rodriguez Irizar <rodrigblas@gmail.com>
|
2026-06-29 13:46:33 +00:00 |
|
|
|
bc8481af09
|
[MoE Refactor] Standardize Humming MoE experts + utilities (#43373)
Signed-off-by: Bill Nell <bnell@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
|
2026-06-29 06:19:29 -07:00 |
|
|
|
59575da46d
|
[XPU] exclude unsupported models for test_tensor_sechma.py (#47008)
Signed-off-by: Yan Ma <yan.ma@intel.com>
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
|
2026-06-29 12:30:28 +00:00 |
|