karylab_agents/vllm
1
0
Fork 0
forked from Karylab-cklius/vllm
Code Pull Requests 2 Actions 1 Packages Activity
16,065 Commits 354 Branches 175 Tags
01acf96c6f57914479e6bfe79d7bd5777a2fc49f
Commit Graph
16065 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
xiangdongandGitHub 01acf96c6f [XPU][CI] Fix Docker cleanup races on Intel CI runners (#40761) 
Signed-off-by: zengxian <xiangdong.zeng@intel.com>
 2026-04-24 14:08:45 +08:00
Jackmin801GitHubClaude
 		079a4cf399 [MoE] Move cutlass moe to fused_moe/experts/ (#40574) 
Signed-off-by: Jackmin801 <ongjackm@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
 2026-04-24 06:05:49 +00:00
wang.yuqiGitHubgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>Cyrus Leung
 		9744b699ba [Deprecate] Deprecate LLM.reward offline api, use LLM.encode instead. (#40688) 
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
 2026-04-24 05:37:50 +00:00
Bugen ZhaoGitHubgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 		c662b4359e [Bugfix] Avoid mutating chat_template_kwargs in HYV3ReasoningParser initialization (#40713) 
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-04-24 13:08:58 +08:00
lyd1992andGitHub 100c7b65e7 [Platform] Fix RISC-V platform detection (lscpu parsing + non-NUMA meminfo) (#40427) 
Signed-off-by: liuyudong <liuyudong@iscas.ac.cn>
 2026-04-24 04:33:05 +00:00
Neil SchemenauerandGitHub 56bdf85e10 [Feature] Avoid eager import of the "mistral_common" package. (#40043) 
Signed-off-by: Neil Schemenauer <nas@arctrix.com>
 2026-04-24 02:49:16 +00:00
Vinayak KumarandGitHub eba73068ea [Doc] fix capitalization consistency in README (vLLM, Hugging Face) (#40729) 
Signed-off-by: Vinayak Mishra <vinayakmishra448@gmail.com>
 2026-04-24 02:23:54 +00:00
Nick HillandGitHub e9f331d72e [MRV2] Ensure warmup covers prefill path (#40746) 
Signed-off-by: Nick Hill <nickhill123@gmail.com>
 2026-04-24 01:33:26 +00:00
yzong-rhGitHubtimon0305sfeng33
 		c9bf77df92 [BUG]: fix HF tokenizer concurrent borrow in tool parsers (#40059) 
Signed-off-by: Yifan <yzong@redhat.com>
Co-authored-by: timon0305 <timon0305@outlook.com>
Co-authored-by: sfeng33 <4florafeng@gmail.com>
 2026-04-23 18:20:30 -07:00
Dmitry TokarevGitHubgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 		3041344287 [Misc] Added curl retries in install_python_libraries.sh (#36700) 
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-04-24 01:19:30 +00:00
Doug CamposandGitHub 92762edc53 [Bugfix] Treat <tool_call> as implicit reasoning end in Qwen3 parser (#35687) 
Signed-off-by: Doug Campos <qmx@qmx.me>
 2026-04-24 09:10:04 +08:00
Benjamin ChislettGitHubgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 		626daa2076 [Feat] Unified Synthetic Acceptance Rate for V1 and V2 (#40662) 
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
Signed-off-by: Benjamin Chislett <chislett.ben@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-04-24 00:48:08 +00:00
Nick HillandGitHub fe85a92e86 [Core] Avoid seq_lens_cpu GPU->CPU sync (#40654) 
Signed-off-by: Nick Hill <nickhill123@gmail.com>
 2026-04-24 00:35:55 +00:00
Sage MooreandGitHub 62b1bbe470 [EPLB] Remove asyncio infrastructure from Async EPLB (#40730) 
Signed-off-by: Sage Moore <sage@neuralmagic.com>
 2026-04-24 00:21:15 +00:00
Hemanth AcharyaandGitHub fa4b70555b [ROCm] Cast score correction bias tensor during model construction for DeepSeek/Kimi-K2 (#39999) 
Signed-off-by: Hemanth Acharya <heachary@amd.com>
 2026-04-24 09:02:12 +09:00
Jackmin801GitHubRobert Shaw
 		447c372ac5 [MoE] Move remaining PrepareAndFinalize to prepare finalize folder (#39009) 
Signed-off-by: Robert Shaw <robertgshaw2@gmail.com>
Signed-off-by: Jackmin801 <ongjackm@gmail.com>
Co-authored-by: Robert Shaw <robertgshaw2@gmail.com>
 2026-04-23 20:00:53 -04:00
Sophie du CouédicGitHubgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 		ff2c2bd80a [Docs]Add documentation for bench serve visualization arguments (#40539) 
Signed-off-by: Sophie du Couédic <sop@zurich.ibm.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-04-23 15:48:29 -07:00
Matthew BonanniandGitHub cde8d24710 [Spec Decode] Move SpecDecodeBaseProposer out of eagle.py (#40732) 
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
 2026-04-23 22:28:27 +00:00
bnellnmandGitHub 4a6dd1c3cc [Bugfix] Fix DeepSeek V2-Lite Accuracy drop (#40673) 
Signed-off-by: Bill Nell <bnell@redhat.com>
 2026-04-23 18:11:37 -04:00
czhu-cohereGitHubmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 		7ff65b1900 [Bugfix] Fix workspace resize leaking reserved GPU memory (#39226) 
Signed-off-by: root <conway.zhu@cohere.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-04-23 20:50:05 +00:00
JohnnyandGitHub 7f95a66cbf [NVIDIA] Add sm_110 (Jetson Thor) to CUDA 13.0 build targets (#39233) 2026-04-23 15:42:14 -04:00
Jackmin801GitHubClaudeKunshang Ji
 		1b1c01de39 [MoE] Move xpu moe to fused_moe/experts/ (#40568) 
Signed-off-by: Jackmin801 <ongjackm@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
 2026-04-23 13:38:10 -04:00
shaharmor98GitHubRobert Shawmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 		e9ba519f45 [DP][Ray] Pin DP control bundle to same node as first GPU bundle (#39167) 
Signed-off-by: Shahar Mor <smor@nvidia.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-04-23 17:21:13 +00:00
Or OzeriandGitHub 5ef33ab250 [kv_offload+HMA][10/N]: Support load with multiple KV groups (#39402) 
Signed-off-by: Or Ozeri <oro@il.ibm.com>
 2026-04-23 20:00:45 +03:00
bnellnmandGitHub 1c2c1eb8b9 [MoE Refactor] Rename FusedMoE.make_expert_params_mapping to fused_moe_make_expert_params_mapping (#40671) 
Signed-off-by: Bill Nell <bnell@redhat.com>
 2026-04-23 11:22:34 -04:00
Nicolò LucchesiandGitHub 8824f50f1f [CI] Split disaggregated tests into own test-area (#40623) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2026-04-23 23:20:12 +08:00
pschlan-amdGitHubTJian
 		0098db9ec1 [ROCm] Implement GPU-to-NUMA-node detection (#40015) 
Signed-off-by: Patrick Schlangen <pschlan@amd.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
 2026-04-23 10:08:48 -05:00
Kunshang JiandGitHub 53ecc807c0 [XPU] Upgrade torch 2.11 for xpu (#37947) 
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
 2026-04-23 10:07:35 -05:00
Srreyansh SethiGitHubMatthew Bonannimergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 		b7a2605020 [Bugfix] Make Attention Backend Auto-Selection Batch-Invariance-Aware (#40193) 
Signed-off-by: Srreyansh Sethi <srreyansh.sethi@gmail.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-04-23 14:57:03 +00:00
stevenkuangGitHubJee Jee Li
 		d0009ddb0b [Model] Support Hy3 preview (#40681) 
Signed-off-by: stevenkuang <stevenkuang@tencent.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
 2026-04-23 22:08:26 +08:00
Richard ZouandGitHub 424033f4fc [Bugfix] Include inductor and functorch configs in compilation cache key (#40627) 
Signed-off-by: Richard Zou <zou3519@gmail.com>
 2026-04-23 09:52:59 -04:00
Isotr0pyandGitHub da1e7311ca [Misc] use model arch converter for bidi models identification (#40701) 
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
 2026-04-23 13:42:52 +00:00
xiangdongandGitHub 01cb41dcf5 [XPU][CI]Temporary disable 3 cases on Intel GPU in CI (#40683) 
Signed-off-by: zengxian <xiangdong.zeng@intel.com>
 2026-04-23 21:42:22 +08:00
almayneGitHubFadi ArafehLi, Jiang <jiang1.li@intel.com>
 		2f314bc5e6 [CPU] Added faster exp routine for lower precision data types. (#38112) 
Signed-off-by: Anna Mayne <anna.mayne@arm.com>
Co-authored-by: Fadi Arafeh <fadi.arafeh@arm.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
 2026-04-23 13:14:44 +00:00
BadrBasowidandGitHub 2196bac135 [Compilation] Refactor SiluMul activation+quant Fusion Pass (#39684) 
Signed-off-by: BadrBasowid <badr.basowid@gmail.com>
 2026-04-23 09:10:36 -04:00
Matthias GehreandGitHub 4b7869d6bc [ROCm] Add gfx1102/gfx1103 support (#40037) 
Signed-off-by: Matthias Gehre <matthias.gehre@amd.com>
 2026-04-23 01:32:04 -07:00
liuzhenweiandGitHub 4a79262e0f [UT][Hardware] let torchrun example tests use the default backend (#39879) 
Signed-off-by: zhenwei-intel <zhenwei.liu@intel.com>
 2026-04-23 16:22:28 +08:00
Shengqi ChenGitHubClaude Opus 4.6
 		3ed5231c6a [Build] Switch default CUDA to 13.0, update CUDA architecture lists, clean up stale build-args (#39878) 
Signed-off-by: Shengqi Chen <harry-chen@outlook.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
 2026-04-23 15:51:28 +08:00
Nicolò LucchesiandGitHub 9c2492e501 [Misc] Support Human-readable (k/K/m/M..) json cli arg (#40473) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2026-04-23 09:42:23 +02:00
Shanshan ShenandGitHub fe57be7809 [MM][CG] Support --enable-vit-cuda-graph option for VLM examples (#40580) 
Signed-off-by: shen-shanshan <467638484@qq.com>
 2026-04-22 22:46:14 -07:00
Flora FengGitHubmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 		8317cedc77 [Responses] Add tool_choice/tools validation to match OpenAI behavior (#40399) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-04-22 22:46:10 -07:00
Zhengxu ChenandGitHub 98a242ff61 [compile] Skip FX graph deserialiaztion on loading, further reducing warm compile time. (#40151) 
Signed-off-by: zhxchen17 <zhxchen17@fb.com>
 2026-04-23 13:43:18 +08:00
Kunshang JiGitHubRobert ShawRobert Shaw
 		e4ee48da2d [MoE refactor] refactor GPTQMarlinMoEMethod with MK (#37990) 
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Signed-off-by: Robert Shaw <robertgshaw2@gmail.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Robert Shaw <robertgshaw2@gmail.com>
 2026-04-23 05:21:47 +00:00
Kunshang JiandGitHub 342c58bc54 [BugFix]fix Qwen3 MoE call gate twice (#40664) 
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
 2026-04-23 05:04:41 +00:00
Julian HuangGitHub墨楼Claude Opus 4.6Codex
 		fe9c3d6c5f [TurboQuant] enable FA3/FA4 for prefill paths (#40092) 
Signed-off-by: 墨楼 <huangzhilin.hzl@antgroup.com>
Co-authored-by: 墨楼 <huangzhilin.hzl@antgroup.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Co-authored-by: Codex <codex@openai.com>
 2026-04-23 07:35:24 +03:00
Chaojun ZhangGitHubKunshang Ji
 		ccaf5ffaa3 [XPU] disable fusion pattern support on XPU platform (#39789) 
Signed-off-by: Chaojun Zhang <chaojun.zhang@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
 2026-04-23 10:07:45 +08:00
Lucas KabelaandGitHub 0283f303d8 [BE] Fix compile time message to be consistent (use monitoring) (#40641) 
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
 2026-04-23 00:12:08 +00:00
Simon DanielssonGitHubMatvei Pashkovskii
 		ac58e2a170 [Fix][MoRI] Align MoRI-IO message format with P2pNcclConnector and vllm-router (#39565) 
Signed-off-by: simondanielsson <simon.danielsson99@hotmail.com>
Co-authored-by: Matvei Pashkovskii <mpashkov@amd.com>
 2026-04-23 08:06:31 +09:00
Lucas KabelaandGitHub b8401a9bf4 [Bugfix] Fix RMS norm + quant fusion on DeepGEMM UE8M0 path for B200 (#40552) 
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
 2026-04-22 22:04:42 +00:00
Honglin CaoandGitHub 9c271f9403 [gRPC] Add standard gRPC health checking (grpc.health.v1) for Kubernetes native probes (#38016) 
Signed-off-by: Honglin Cao <Caohonglin317@hotmail.com>
 2026-04-22 21:31:00 +00:00