karylab_agents/vllm
1
0
Fork 0
forked from Karylab-cklius/vllm
Code Pull Requests 2 Actions 1 Packages Activity
18,574 Commits 354 Branches 175 Tags
0d2f4e7c9c88d27fdfbb46dc4e2458d615102cb5
Commit Graph
18574 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Thien TranandGitHub 0d2f4e7c9c Allow FlashInfer A2A backends for TRTLLM FP8 MoE Modular (#46661) 
Signed-off-by: Thien Tran <gau.nernst@yahoo.com.sg>
 2026-07-08 14:58:39 -07:00
djramicandGitHub 49abadaedb [ROCm][Bugfix] Fix empty-tensor .max() crash in AITER FA (#47894) 
Signed-off-by: Djordje Ramic <djoramic@amd.com>
 2026-07-08 16:58:36 -05:00
Kaihang JiangandGitHub 089e412878 [Perf] Integrate TRTLLM BF16 MoE Modular Kernel (#45182) 
Signed-off-by: Kaihang Jiang <kaihangj@login-lyris02.lyris.clusters.nvidia.com>
 2026-07-09 01:36:14 +04:00
Nick HillandGitHub a5d19cbb95 [Core] Move MRV1 late_interaction_runner.py out of MRV2 subtree (#48014) 
Signed-off-by: Nick Hill <nickhill123@gmail.com>
 2026-07-08 18:30:11 +00:00
Chris LeonardandGitHub 8347c6e6e1 updated flash_attn GIT_TAG to point to torch Stable ABI FA3 commit (#47995) 
Signed-off-by: Chris Leonard <chleonar@redhat.com>
 2026-07-08 10:56:29 -07:00
Ilya MarkovGitHubMarkov Ilya
 		b2cf70ea3a [CI] BugFix Eval Small Models Distributed test for DiffusionGemma (#47980) 
Signed-off-by: Markov Ilya <markovilya19@gmail.com>
Co-authored-by: Markov Ilya <markovilya19@gmail.com>
 2026-07-08 17:00:56 +00:00
almayneandGitHub d1f1d86797 [Bugfix] Re-enable benchmarking of librispeech dataset. (#47033) 
Signed-off-by: Anna Mayne <anna.mayne@arm.com>
 2026-07-08 16:19:26 +00:00
shawnandGitHub f05603fa28 [Bugfix][DCP] Cast LSE to fp32 in a2a combine to fix bf16 bitcast crash (#47801) 
Signed-off-by: Shawn Tsai <shawnyht@gmail.com>
 2026-07-08 11:41:26 -04:00
Martin VitGitHubMatthew Bonanni
 		c2ecd0f888 Fix FlashAttention MLA prefill V unpadding (#42642) 
Signed-off-by: Martin Vit <martin@voipmonitor.org>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
 2026-07-08 15:22:20 +00:00
Michael GoinGitHubClaude Opus 4.8
 		0d12618e98 [Spec Decode] Support hybrid (SWA + full attention) DFlash drafters (#47914) 
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
 2026-07-08 11:12:45 -04:00
Tyler Michael SmithandGitHub 68b4a1d582 Fix NVML capability lookup for visible devices (#47892) 
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
 2026-07-08 09:07:44 -04:00
Robert ShawGitHubRobert ShawClaude
 		572b25b03e [Bug] Fix Batched DeepGEMM (#47884) 
Signed-off-by: Robert Shaw <robertgshaw2-redhat@dgx-b200-02.mgmt.accl-001.lab.rdu2.dc.redhat.com>
Co-authored-by: Robert Shaw <robertgshaw2-redhat@dgx-b200-02.mgmt.accl-001.lab.rdu2.dc.redhat.com>
Co-authored-by: Claude <noreply@anthropic.com>
 2026-07-08 09:05:03 -04:00
Vivek SharmaGitHubvivek sharmaPuneet Sharmadepthfirst-app[bot] <184448029+depthfirst-app[bot]@users.noreply.github.com>
 		9f2b3b093c Improvement of Docker image build for IBM Power using prebuilt wheels from IBM published devpi index (#46017) 
Signed-off-by: vivek sharma <vivsharm@redhat.com>
Signed-off-by: puneetsharma21 <puneet.sharma21@ibm.com>
Signed-off-by: Puneet Sharma <puneet.sharma21@ibm.com>
Co-authored-by: vivek sharma <vivsharm@redhat.com>
Co-authored-by: Puneet Sharma <puneet.sharma21@ibm.com>
Co-authored-by: depthfirst-app[bot] <184448029+depthfirst-app[bot]@users.noreply.github.com>
 2026-07-08 13:01:14 +00:00
SaddssGitHubYifan QiaoSaddssNick Hill
 		cd0de48d08 [Bugfix][V1] Free out-of-window blocks on the processed-token basis under async scheduling (#47728) 
Signed-off-by: Saddss <28726669061@qq.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Signed-off-by: Yifan Qiao <yifanqiao@inferact.ai>
Co-authored-by: Yifan Qiao <yifanqiao@inferact.ai>
Co-authored-by: Saddss <28726669061@qq.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
 2026-07-08 13:34:19 +01:00
rasmithandGitHub 934eeaecfb [CI/Build][BugFix][The Rock] Fix get_ssm_device_name to return sanitized, usable filename (#47781) 
Signed-off-by: Randall Smith <Randall.Smith@amd.com>
 2026-07-08 12:12:54 +00:00
Bugen ZhaoandGitHub 2cae98dfa5 [Rust Frontend] Handle continue_final_message with renderer sentinel (#47844) 
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
 2026-07-08 12:57:04 +01:00
vanshbhatia-amdGitHubvanshbhatia-amd
 		db39d60010 Add tuned selective_state_update float32 config for AMD Instinct MI355 (#47943) 
Signed-off-by: vanshbhatia-amd <210711135+vanshbhatia-amd@users.noreply.github.com>
Co-authored-by: vanshbhatia-amd <210711135+vanshbhatia-amd@users.noreply.github.com>
 2026-07-08 11:41:26 +00:00
aorightGitHub辰言Jee Jee LiJee Jee Li
 		a1ab51afb6 [Bugfix] Allocate HY V3 expert_bias in float32 to prevent silent downcasting (#47797) 
Signed-off-by: 辰言 <oncwnuIWp30GguOyJ615Fqj8H-yc@git.weixin.qq.com>
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
Co-authored-by: 辰言 <oncwnuIWp30GguOyJ615Fqj8H-yc@git.weixin.qq.com>
Co-authored-by: Jee Jee Li <jeejeelee@inferact.ai>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
 2026-07-08 11:25:53 +00:00
Thien TranandGitHub e7b3853bac Remove router weight upcast for DSv2-related models (#47970) 
Signed-off-by: Thien Tran <gau.nernst@yahoo.com.sg>
 2026-07-08 11:19:10 +00:00
vanshbhatia-amdGitHubvanshbhatia-amd
 		eeaf23107f [ROCm] Add tuned selective_state_update float32 config for AMD Instinct MI300X (#47947) 
Signed-off-by: vanshbhatia-amd <210711135+vanshbhatia-amd@users.noreply.github.com>
Co-authored-by: vanshbhatia-amd <210711135+vanshbhatia-amd@users.noreply.github.com>
 2026-07-08 11:09:02 +00:00
Canlin GuoandGitHub 285c08c036 [Model] Support MOSS-Transcribe-Diarize (#47729) 
Signed-off-by: gcanlin <canlinguosdu@gmail.com>
 2026-07-08 04:05:45 -07:00
vanshbhatia-amdGitHubvanshbhatia-amd
 		1f4ad059d1 [ROCm] Add tuned selective_state_update float16 config for AMD Instinct MI300X (#47945) 
Signed-off-by: vanshbhatia-amd <210711135+vanshbhatia-amd@users.noreply.github.com>
Co-authored-by: vanshbhatia-amd <210711135+vanshbhatia-amd@users.noreply.github.com>
 2026-07-08 11:03:58 +00:00
sungbin1015GitHubClaude
 		04a703e397 [Frontend] Support bad_words in the /v1/completions endpoint (#46793) 
Signed-off-by: sungbin1015 <sbin@solbox.com>
Co-authored-by: Claude <noreply@anthropic.com>
 2026-07-08 09:51:17 +00:00
Nicolò LucchesiandGitHub bd3bb4eb26 [Misc][Docs] Add human-readable integer support for more cli-args (#47608) 
Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai>
 2026-07-08 09:43:34 +00:00
Chaojun ZhangandGitHub 440002552e [XPU] [Fusion passes] Disable fuse_rope_kvcache_cat_mla & qk_norm_rope_ fusion on XPU (#47962) 
Signed-off-by: Chaojun Zhang <chaojun.zhang@intel.com>
 2026-07-08 09:23:06 +00:00
Tyler Michael SmithGitHubClaude
 		99a85617bf [Test] Skip DeepEP MoE layer tests without P2P access (#47946) 
Signed-off-by: Tyler Michael Smith <tyler@tylermsmith.com>
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
 2026-07-08 09:46:03 +01:00
Nicolò LucchesiandGitHub 7c67da967f Remove unused _get_kv_cache_config_deepseek_v4 alias (#47969) 
Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai>
 2026-07-08 01:18:03 -07:00
Nicolò LucchesiandGitHub d79855eaac [Docs] kv_sharing_fast_prefill correction (#47044) 
Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai>
 2026-07-08 01:17:46 -07:00
manayangGitHubmanayang
 		51e5372f3d [Model][HunyuanVL] Use native transformers processor and adapt to transformers 5.13 (#47872) 
Co-authored-by: manayang <manayang@tencent.com>
 2026-07-08 07:58:23 +00:00
Ace EldeibandGitHub 7cc2e8e74f fix: hash speculative draft model config (#47911) 
Signed-off-by: Ace Eldeib <aeldeib@coreweave.com>
Signed-off-by: Ace Eldeib <alexeldeib@gmail.com>
 2026-07-08 08:36:30 +01:00
Hongxia YangandGitHub 2c64b4c1cc [ROCm] fixed aiter master flag and expert parallelism compatibility on minimax-m3-mxfp8 (#47158) 
Signed-off-by: Hongxia Yang <hongxia.yang@amd.com>
 2026-07-08 15:26:17 +08:00
Muhammad FawazGitHubMahad Durrani
 		d35eba302f [Bugfix] Avoid leaking Pydantic repr in tool_choice error message (#47028) 
Signed-off-by: muhammadfawaz1 <135441198+muhammadfawaz1@users.noreply.github.com>
Co-authored-by: Mahad Durrani <114791389+mahadrehmann@users.noreply.github.com>
 2026-07-08 15:00:59 +08:00
Nicklas FrahmandGitHub c0e8e1f12a [Bugfix] Register VLLM_BUILD_* and VLLM_IMAGE_TAG provenance env vars (#45313) 
Signed-off-by: Nicklas Frahm <nicklas.frahm@gmail.com>
 2026-07-08 06:21:12 +00:00
Zach ZhuandGitHub 5d5fab0061 [Bugfix][Frontend] Fix http_requests_total metric recording some 4xx errors as 5xx (#44303) 
Signed-off-by: Zach Zhu <zzqshu@126.com>
 2026-07-08 05:33:21 +00:00
Wei ZhaoGitHubYongye Zhu
 		2afa3f7e95 [Perf] Minimax M3 - Support cross-layer allreduce-norm fusion (#47631) 
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
Co-authored-by: Yongye Zhu <zyy1102000@gmail.com>
 2026-07-07 21:16:32 -07:00
Jeff (Junze) MaGitHubLucas Wilkinson
 		80eb01e93d [Bugfix] DSV4 TP16 garbage output (#47493) 
Signed-off-by: Jeff Ma <jeffjma@umich.edu>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
 2026-07-07 21:04:33 -07:00
Ethan YangGitHubamd-ethany
 		d9e57ea82e [ROCm][Perf] MXFP8 dense-linear + grouped-MoE GEMM optimizations for MiniMax-M3 (#46117) 
Signed-off-by: amd-ethany <amd-ethany@users.noreply.github.com>
Co-authored-by: amd-ethany <amd-ethany@users.noreply.github.com>
 2026-07-08 04:03:34 +00:00
Yongye ZhuGitHubClaude Opus 4.8
 		9021589498 [Minimax-M3] Using tok_sparse_select from MSA instead of triton kernels (#47502) 
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
 2026-07-07 21:01:12 -07:00
Ting SUNandGitHub 0303f37a54 [Bugfix][Pooling] Align CrossEncoder token type ids after truncation (#47772) 
Signed-off-by: Ting Sun <suntcrick@gmail.com>
 2026-07-08 03:59:22 +00:00
Walter Beller-MoralesandGitHub dd127d82ed [Core][Engine] only materialize tokens when thinking budget is in req (#47053) 
Signed-off-by: walterbm <walter.beller.morales@gmail.com>
 2026-07-07 21:02:38 -06:00
Posedge_LinGitHubOr Ozeri
 		0ca6eee743 [Core] Pass request context to CPU offload cache policy touch (#47744) 
Signed-off-by: jacklin78911-collab <jacklin78911@gmail.com>
Co-authored-by: Or Ozeri <oro@il.ibm.com>
 2026-07-08 05:56:25 +03:00
Isotr0pyandGitHub 5e975eae1a [Bugfix] Avoid blocking model launching when no system ffmpeg available for TorchCodec (#47888) 
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
 2026-07-08 10:52:25 +08:00
Martin HickeyandGitHub f7fc0ca993 [Frontend] Add endpoint plugins framework (#47454) 
Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com>
 2026-07-08 10:00:41 +08:00
Rahul VishwakarmaandGitHub f7efab58ec [CPU][Bugfix] Fix flaky ShortConv prefill test on ARM (uninitialized weights) (#47848) 
Signed-off-by: Rahul Vishwakarma <Rahul.Vishwakarma2@ibm.com>
 2026-07-07 18:20:09 -07:00
Nils MattesonGitHubNils Mattesonmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 		e97c3cb303 [Core] Persist and reuse the memory-profiling result across boots (opt-in) (#47388) 
Signed-off-by: Nils Matteson <nils@thaw.sh>
Signed-off-by: Nils Matteson <nilsmatteson@icloud.com>
Co-authored-by: Nils Matteson <nils@thaw.sh>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-07-08 00:53:02 +00:00
Rohan PotdarGitHubClaude Opus 4.8
 		4aceabf8c1 [ROCm][Bugfix] Key sparse-MLA persistent metadata on per-request context lengths (#47766) 
Signed-off-by: Rohan Potdar <rohan.potdar@amd.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
 2026-07-07 19:22:34 -05:00
stefankoncarevicandGitHub 6e35c5e5af [ROCm][CI] Minimize comment in RocmAttention q_scale check (#47731) 
Signed-off-by: stefankoncarevic <stefan.koncarevic@amd.com>
 2026-07-07 19:16:08 -05:00
Ameen PatelGitHubAmeenPClaude
 		aad0fb741b [CI/Build] Accept ready-run-all-tests label in pre-commit gate (#47897) 
Signed-off-by: AmeenP <ameen@primeintellect.ai>
Co-authored-by: AmeenP <ameen@primeintellect.ai>
Co-authored-by: Claude <noreply@anthropic.com>
 2026-07-07 23:18:59 +00:00
yzong-rhandGitHub 7d2ce5750e [Bugfix] Patch Hopper MXFP4 OOB scales reads leading to NaN (#47910) 
Signed-off-by: Yifan Zong <yzong@redhat.com>
 2026-07-07 22:51:22 +00:00
Juan Pérez de AlgabaandGitHub 675f4295cd fix(security): bound completion prompt list to prevent unbounded engine fan-out (#47845) 
Signed-off-by: jperezde <jperezde@redhat.com>
 2026-07-07 22:48:20 +00:00