karylab_agents/vllm
1
0
Fork 0
forked from Karylab-cklius/vllm
Code Pull Requests 2 Actions 2 Packages Activity
19,261 Commits 354 Branches 175 Tags
54ab69b14eeafd5c8dcf818cfcc0eeb26d2ebddb
Commit Graph
19261 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Kevin H. LuuandGitHub 54ab69b14e [CI] Allow comment-triggered builds past pipeline filters (#50197) 
Signed-off-by: khluu <khluu000@gmail.com>
 2026-07-28 19:11:04 -07:00
Kevin H. LuuGitHubOpenAI Codex
 		7f4c52f2ba [CI] Add comment-based Buildkite triggers (#50132) 
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
 2026-07-28 18:41:48 -07:00
Nick HillGitHubJeff Ma
 		6fbbcf2151 [BugFix] Stop dummy runs from writing mamba state through stale block-table rows (#49757) 
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Signed-off-by: Jeff Ma <jeffjma@umich.edu>
Co-authored-by: Jeff Ma <jeffjma@umich.edu>
 2026-07-29 01:09:41 +00:00
Kevin GlynnandGitHub 56f31af62a [Bugfix] Fix /wake_up crash on hybrid models (Mamba/DeltaNet) (#41602) 
Signed-off-by: Kevin Glynn <kevglynn@gmail.com>
 2026-07-29 00:17:35 +00:00
Divakar VermaandGitHub fe65aa6a97 [CI][NIXL] Fix flaky DP+EP test port conflict (#50171) 
Signed-off-by: Divakar Verma <divakar.verma@amd.com>
 2026-07-29 00:12:50 +00:00
Andreas KaratzasandGitHub 176256b962 [ROCm][CI] Stabilize ROCm audio streaming test (#50163) 
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
 2026-07-29 07:58:10 +08:00
fxmarty-amdandGitHub 5369f7b7b8 [MXFP8][ROCm] Fix MXFP8 MoE backend selection (#49747) 
Signed-off-by: Felix Marty <Felix.Marty@amd.com>
 2026-07-29 07:57:20 +08:00
liuzhenweiandGitHub e7f6a39db8 [Test] Make EPD correctness tests configurable for XPU (#50110) 
Signed-off-by: zhenwei-intel <zhenwei.liu@intel.com>
 2026-07-29 07:47:48 +08:00
Ruinan MaGitHubNick Hill
 		a07fac758f [Perf] Zero-copy torch.Tensor pickling in shm_broadcast MessageQueue (#48442) 
Signed-off-by: Ruinan Ma <r7ma3088@gmail.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
 2026-07-28 16:28:28 -07:00
Julien DebacheandGitHub bb3b61f2fd perf: dispatch non-grouped bias-less topk routing methods to fused path (#49618) 
Signed-off-by: jdebache <jdebache@nvidia.com>
 2026-07-28 14:57:22 -07:00
Bugen ZhaoandGitHub 2899dca843 [Model] Add Kimi K3 support: Rust frontend [1/2] (#50104) 
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
 2026-07-28 14:31:13 -07:00
Siddhant BhartiGitHubClaude Fable 5
 		0b6aa3c47c [Bugfix][Spec Decode] Size DFlash query buffers for cudagraph-padded batches (#50065) 
Signed-off-by: siddhant-bharti <sbharti@together.ai>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-07-28 19:34:22 +00:00
Bugen ZhaoandGitHub d552a68645 [Rust Frontend] Extract shared tracing setup logic into vllm-tracing (#50129) 
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
 2026-07-28 19:31:15 +00:00
johnnyychiuandGitHub 118bcde449 [BugFix] Fix clang spinloop mwaitx include (#45532) 
Signed-off-by: johnny <johnnyychiu@gmail.com>
 2026-07-28 19:00:06 +00:00
Shanshan ShenandGitHub 6c7e679f04 [ROCm][Bugfix] Sanitize AITER paged-MQA logits before sparse top-k for DeepSeek-V4 (#49714) 
Signed-off-by: shen-shanshan <467638484@qq.com>
 2026-07-28 11:08:50 -07:00
labAxiaomingandGitHub 1db989bbf1 [Bugfix][Multimodal] Fix video temporal padding estimates (#49030) 
Signed-off-by: xiaoming <1259730330@qq.com>
 2026-07-29 01:57:31 +08:00
Brian DellabettaandGitHub 8a7b3c2990 [compressed-tensors] update find_matched_target order to prioritize fused name matches over class match (#49483) 
Signed-off-by: Brian Dellabetta <bdellabe@redhat.com>
 2026-07-28 17:03:08 +00:00
Andreas KaratzasandGitHub 05a0814863 [ROCm] Fix and optimize GPT-J-style MRoPE (#49906) 
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
 2026-07-28 10:50:10 -06:00
jiacao-amdGitHubTJian
 		4f56321d7e [ROCm] Cache fp32 upcast of static e8m0 weight scale in AITER scaled_mm (#47773) 
Signed-off-by: jiacao-amd <jiahui.cao@amd.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
 2026-07-28 11:34:16 -05:00
Bugen ZhaoandGitHub 01661cc57f [Rust][Benchmark] Make vllm bench serve Rust delegation opt-in (#50081) 
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
 2026-07-28 16:21:12 +00:00
Yiliu DongGitHubOpenAI Codex
 		ba702e978e [Attention] Skip sparse indexer scoring for dense short prefills (#48407) 
Signed-off-by: Yiliu Dong <91178480+qianlihuang@users.noreply.github.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
 2026-07-28 16:17:22 +00:00
Nick HillGitHubAndreas Karatzas
 		6453fc0b8c [Bugfix] Don't reuse engine core payload buffer while zmq is sending it (#50053) 
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
 2026-07-28 16:09:28 +00:00
IBRAHIM IBRAHIMGitHubibrahimibrahimClaude Opus 4.8
 		4fb483ca86 [Docs] Expand llm-d integration page (#45432) 
Signed-off-by: ibrahimibrahim <ibib2595@gmail.com>
Co-authored-by: ibrahimibrahim <ibib2595@gmail.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
 2026-07-28 15:47:56 +00:00
Itay EtelisGitHubItay EtelisItay Etelis
 		30217b0e80 [Bugfix][KV Offload][P2P] Scope serve state to fetch rounds (#49877) 
Signed-off-by: Itay Etelis <itay.etelis@ibm.com>
Co-authored-by: Itay Etelis <itay.etelis@ibm.com>
Co-authored-by: Itay Etelis <Itay.etelis@gmail.com>
 2026-07-28 18:01:55 +03:00
Nick HillandGitHub 0d0504b54c [Core] Warm up runner-owned Triton kernels before the first request (#49903) 2026-07-28 07:58:02 -07:00
Jonguk CheongGitHubOpenAI Codex
 		1e81853afc [Bugfix][KV Offload] Keep Mamba block span unscaled under DCP (#49964) 
Signed-off-by: Jonguk Cheong <jdal3031@snu.ac.kr>
Co-authored-by: OpenAI Codex <codex@openai.com>
 2026-07-28 17:41:55 +03:00
oops-oomGitHuboops-oomClaude Opus 4.8Wentao YeShengqi Chen
 		b6cbba8bc8 [Bugfix][Kernel] Fix batch invariance in RMSNorm kernels by pinning block size (#48391) 
Signed-off-by: oops-oom <73481342@qq.com>
Signed-off-by: oops-oom <liubin8905@vip.qq.com>
Co-authored-by: oops-oom <73481342@qq.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Shengqi Chen <harry-chen@outlook.com>
 2026-07-28 22:24:02 +08:00
Nick HillGitHubClaude Opus 4.8
 		94100b5915 [CI] Wire untethered test files into CI jobs (#49340) 
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
 2026-07-28 14:02:31 +00:00
Harry MellorandGitHub 62d8db7c05 [Bugfix] Add missing vllm/models/kimi_k3/__init__.py (#50131) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-07-28 13:47:04 +00:00
Nick HillGitHubClaude Fable 5
 		601fa9a74e [KV Connector] Support NIXL heterogeneous P/D block sizes for hybrid models (#49612) 
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-07-28 06:45:02 -07:00
liangel-02GitHubmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>Matthew BonanniMichael Goin
 		9b9fc4039c add epilogue hook to flex attention (#45841) 
Signed-off-by: Angel Li <liangel@meta.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
 2026-07-28 06:26:55 -07:00
Nicolò LucchesiandGitHub 98e91a9600 [PD][NixlPush] Skip extra add_remote_agent step in D->P handshake (#49345) 
Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai>
 2026-07-28 14:57:12 +02:00
Xin HeGitHubKunshang Ji
 		948107acf7 [Bugfix] Enhance extra_config handling for layer name suffix matching (#48589) 
Signed-off-by: Xin He <xin3.he@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
 2026-07-28 20:37:55 +08:00
Itay AlroyandGitHub 35efdf6b34 [Elastic EP] Async preparation (#47288) 
Signed-off-by: Itay Alroy <ialroy@nvidia.com>
 2026-07-28 05:19:13 -07:00
Kevin H. LuuGitHubOpenAI Codex
 		d2bfc6fe20 [Build] Fix DeepEP CUDA driver stub linking (#50103) 
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
 2026-07-28 12:09:19 +00:00
ReidandGitHub 912d6b619d [Rust Frontend] Align sampling validation with Python (#47494) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
 2026-07-28 12:02:00 +00:00
ReidandGitHub bf9f23003c [Rust Frontend] Fix finish reason for named tool choices (#49496) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
 2026-07-28 10:53:18 +00:00
Jiangyun ZhuGitHubOpenAI Codexmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 		25ace8fe5d [CI] Increase Qwen3.5 MTP GSM8K generation length (#49881) 
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-07-28 18:04:36 +08:00
Chris LeonardGitHubShengqi Chen
 		247470f23a [CI] Add PyTorch stable ABI audit check (#48164) 
Signed-off-by: Chris Leonard <chleonar@redhat.com>
Co-authored-by: Shengqi Chen <harry-chen@outlook.com>
 2026-07-28 02:37:01 -07:00
Liangliang MaGitHubmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 		88402a41c4 [Test] Skip ROCm AITER MLA prefill tests on non-ROCm platforms (#49945) 
Signed-off-by: Liangliang-Ma <liangliang.ma@intel.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-07-28 16:26:49 +08:00
Bugen ZhaoGitHubOpenAI Codex
 		5ed3faa43d [Rust Frontend] Add ordinary-text tokenizer encoding (#49992) 
Co-authored-by: OpenAI Codex <noreply@openai.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
 2026-07-28 15:46:51 +08:00
Thien TranandGitHub 61ac368021 [Kimi-K3] Add AttnRes kernels (#50090) 
Signed-off-by: Thien Tran <gau.nernst@yahoo.com.sg>
 2026-07-28 00:22:09 -07:00
Andreas KaratzasGitHubOpenAI Codex
 		99b57a4823 [CI][ROCm] Soft fail LoRA mirror (#50086) 
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
 2026-07-28 00:18:04 -07:00
aoshen02GitHubaoshen02vx120Claude Opus 5Roger Wang
 		b09688a6e7 [Bugfix][Spec Decode] Preserve draft buffers across level-2 sleep (#49774) 
Signed-off-by: aoshen02 <aoshen02@users.noreply.github.com>
Signed-off-by: vx120 <893600387@qq.com>
Co-authored-by: aoshen02 <aoshen02@users.noreply.github.com>
Co-authored-by: vx120 <893600387@qq.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
 2026-07-28 00:16:21 -07:00
ChaunceyGitHubAndreas Karatzas
 		03a2d03367 [Bugfix] Respect cgroup memory limits on all platforms (#49966) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
 2026-07-28 14:38:20 +08:00
Shuolei WangandGitHub 9069a57139 [Core][Frontend] Add weight version tagging for RL rollouts (#49040) 
Signed-off-by: Shuolei Wang <shuoleiwang123@gmail.com>
Signed-off-by: Shuolei Wang <948904026@qq.com>
 2026-07-28 14:35:29 +08:00
Li, JiangandGitHub 90245f4190 [Bugfix] Fix multi-modal support on CPU MRV2 (#50073) 
Signed-off-by: jiang1.li <jiang1.li@intel.com>
 2026-07-28 06:09:48 +00:00
afriedriandGitHub f472ab0a4c Remove triton per group quant [ROCm] [Bugfix] (#49621) 
Signed-off-by: Andy Friedrich <afriedri@amd.com>
 2026-07-28 05:53:46 +00:00
Ayushman SinghandGitHub 74587939b1 [Build] Fix CUDA arch detection producing kernel-less builds on SM121 (#49904) 2026-07-27 22:01:56 -07:00
Nick HillandGitHub d223c900d8 [Bugfix] Only pad transformers backend value when it is narrower (#50060) 
Signed-off-by: Nick Hill <nickhill123@gmail.com>
 2026-07-27 23:36:45 -05:00