karylab_agents/vllm
1
0
Fork 0
forked from Karylab-cklius/vllm
Code Pull Requests 2 Actions 1 Packages Activity
19,297 Commits 354 Branches 175 Tags
main
Commit Graph
1119 Commits
Author SHA1 Message Date
sungsoo haGitHubClaude Opus 4.8Jiangyun Zhu
 		f51193b9ae [Kernel][Mamba] Fused-kernel support for align-mode DS-conv state migration with num_accepted_tokens > 1 (#49291) 
Signed-off-by: Sungsoo Ha <sungsooh@nvidia.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Co-authored-by: Jiangyun Zhu <riverclouds.zhu@qq.com>
 2026-07-29 18:54:52 +08:00
fxmarty-amdandGitHub 5b14019576 [CI] Fix MXFP8 MOE backend selection tests on gfx942 (#50222) 
Signed-off-by: Felix Marty <Felix.Marty@amd.com>
 2026-07-29 17:17:11 +08:00
Tianmu LiGitHubCodexLi, Jiang <jiang1.li@intel.com>
 		65a1a16594 [CPU] Fix FP8 attention scratchpad sizing (#50194) 
Signed-off-by: Li, Tianmu <tianmu.li@intel.com>
Co-authored-by: Codex <noreply@openai.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
 2026-07-29 15:34:37 +08:00
+13
Jiangyun ZhuGitHubIsotr0pyThien TranBugen ZhaoYongye ZhuZiming HuangRoger WangIsotr0pyaoshen02Woosuk KwonJee Jee Liaoshen02Summer YangKevin H. LuuBowen WanggnovackNick HillYifan QiaoxiaozhoupyRoy WangJeff MaCodex
 		7c6729b769 [Model] Add Kimi K3 support: model files and kernels [1/N] (#50089) 
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: Thien Tran <gau.nernst@yahoo.com.sg>
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Ziming Huang <zelda.huanghuang@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Isotr0py <mozf@inferact.ai>
Co-authored-by: aoshen02 <aoshen02@users.noreply.github.com>
Co-authored-by: Woosuk Kwon <woosuk@inferact.ai>
Co-authored-by: Jee Jee Li <jeejeelee@inferact.ai>
Co-authored-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: Summer Yang <girasoleyang@gmail.com>
Co-authored-by: Kevin H. Luu <khluu000@gmail.com>
Co-authored-by: Bowen Wang <abmfy@icloud.com>
Co-authored-by: gnovack <novackgm@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Yifan Qiao <yifanqiao@inferact.ai>
Co-authored-by: xiaozhoupy <peiyuanzhou1994@gmail.com>
Co-authored-by: Roy Wang <yasong.wang@inferact.ai>
Co-authored-by: Jeff (Junze) Ma <93145857+majunze2001@users.noreply.github.com>
Co-authored-by: Codex <codex@openai.com>
 2026-07-29 14:10:58 +08:00
Artur FierkaGitHubClaudeLena Onyshchenko
 		6f00a1ae3b fused_moe: add VLLM_TRITON_USE_TD tensor-descriptor path (#42436) 
Signed-off-by: Artur Fierka <artur.fierka@intel.com>
Signed-off-by: Lena Onyshchenko <162571002+oonyshch@users.noreply.github.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Lena Onyshchenko <162571002+oonyshch@users.noreply.github.com>
 2026-07-29 13:15:10 +08:00
danielafrimiGitHubOpenAI CodexMichael Goin
 		32a423ac0a Integrate CuTeDSL MoE for ReLU2 NVFP4 (#49580) 
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
 2026-07-28 19:46:38 -07:00
fxmarty-amdandGitHub 5369f7b7b8 [MXFP8][ROCm] Fix MXFP8 MoE backend selection (#49747) 
Signed-off-by: Felix Marty <Felix.Marty@amd.com>
 2026-07-29 07:57:20 +08:00
Julien DebacheandGitHub bb3b61f2fd perf: dispatch non-grouped bias-less topk routing methods to fused path (#49618) 
Signed-off-by: jdebache <jdebache@nvidia.com>
 2026-07-28 14:57:22 -07:00
Shanshan ShenandGitHub 6c7e679f04 [ROCm][Bugfix] Sanitize AITER paged-MQA logits before sparse top-k for DeepSeek-V4 (#49714) 
Signed-off-by: shen-shanshan <467638484@qq.com>
 2026-07-28 11:08:50 -07:00
Andreas KaratzasandGitHub 05a0814863 [ROCm] Fix and optimize GPT-J-style MRoPE (#49906) 
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
 2026-07-28 10:50:10 -06:00
Nick HillGitHubClaude Opus 4.8
 		94100b5915 [CI] Wire untethered test files into CI jobs (#49340) 
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
 2026-07-28 14:02:31 +00:00
fxmartyGitHubFelix MartyAndreas Karatzas
 		33fe71a4d3 [AMD] Revert Mxfp4MoeBackend.TRITON_UNFUSED fallback (#46491) 
Signed-off-by: Felix Marty <Felix.Marty@amd.com>
Co-authored-by: Felix Marty <Felix.Marty@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
 2026-07-27 22:31:23 -05:00
fxmarty-amdGitHubAndreas Karatzas
 		7aea73d83d [ROCm][Quark][6/N] Use MXFP4 linear kernel abstraction for aiter backend (#49348) 
Signed-off-by: Felix Marty <Felix.Marty@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
 2026-07-27 21:35:57 -05:00
Netanel HaberandGitHub 1e34a13539 Fix Humming non-gated MoE (#49096) 2026-07-27 22:56:44 +00:00
Colin ZGitHubTJianfanxingran
 		28158b2fc3 [ROCm] [BugFix] Fix Quark GLM-5.2 Checkpoint inference: indexer wk per-channel FP8 dequant + missing sparse-MLA metadata fields (#48886) 
Signed-off-by: Colin Zeng <Colin.Zeng@amd.com>
Signed-off-by: ColinZ22 <Colin.Zeng@amd.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
Co-authored-by: fanxingran <xingran.fan@amd.com>
 2026-07-27 22:38:22 +00:00
Andreas KaratzasandGitHub 99115fcdcd [CI] Initialize DeepEP FP8 test weights (#49912) 
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
 2026-07-28 05:29:08 +08:00
Wentao YeandGitHub b2f9e4caa4 [DSv4 Perf] Adaptive topk width, 1.0% E2E throughput improvement (#50004) 
Signed-off-by: yewentao256 <zhyanwentao@126.com>
 2026-07-27 15:56:52 -04:00
Li, JiangGitHubClaude Sonnet 5
 		eb290ab673 [Bugfix][CPU] Zero-pad MoE intermediate size for grouped-gemm TP alignment (#49591) 
Signed-off-by: jiang1.li <jiang1.li@intel.com>
Co-authored-by: Claude Sonnet 5 <noreply@anthropic.com>
 2026-07-27 16:32:23 +08:00
Andreas KaratzasandGitHub e09900436c [CI][ROCm] Reduce kernel test runtime (#49915) 
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
 2026-07-27 06:44:21 +00:00
Tianmu LiGitHubCodexLi, Jiang <jiang1.li@intel.com>
 		544cb724c8 [CPU][Spec Decode] Optimize GDN conv path for speculative decoding (#48577) 
Signed-off-by: Li, Tianmu <tianmu.li@intel.com>
Co-authored-by: Codex <codex@openai.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
 2026-07-27 06:20:14 +00:00
Fadi ArafehGitHubLi, Jiang <jiang1.li@intel.com>
 		c314af1abf [CPU][Perf] INT8 Fused MoE Kernel for Arm CPUs (#48637) 
Signed-off-by: Fadi Arafeh <fadi.arafeh@arm.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
 2026-07-27 05:53:09 +00:00
Andreas KaratzasandGitHub 49f31d7cee [ROCm] Make vllm_c RMSNorm output contiguous (#49913) 
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
 2026-07-26 23:59:14 -05:00
Nick IusiumbeliGitHubClaude Opus 4.8Kunshang Ji
 		f0553889c0 [Bugfix] Prevent NaN poisoning in xpu_mla_sparse for fully-masked index chunks (#48366) 
Signed-off-by: Nick Iusiumbeli <nickuspro@gmail.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
 2026-07-27 09:06:07 +08:00
Lena OnyshchenkoGitHubKunshang Ji
 		0111002323 [Kernel] TD operand loads for batched MoE GEMM (moe_mmk) on XPU (#46340) 
Signed-off-by: oonyshch <xonyshch@gmail.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
 2026-07-26 08:50:07 +08:00
Harry MellorGitHubAndreas Karatzas
 		ca0defa343 Make bare hugging_face imports forbidden (#49726) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
 2026-07-25 04:18:39 -07:00
Woosuk KwonandGitHub 213f681f81 Revert "[Perf][GLM-5.2] Blackwell decode optimizations" (#49768) 2026-07-24 16:04:59 -07:00
Tyler Michael SmithGitHubClaudeIlya MarkovOpenAI CodexCodex
 		5d8e90a966 [WideEP] Update NCCL to 2.30.7 to enable DeepEPv2 in the vllm/vllm-openai image (#45321) 
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Signed-off-by: Tyler Michael Smith <tyler@vllm.ai>
Signed-off-by: Tyler Michael Smith <tyler@tylermsmith.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Ilya Markov <ilmarkov@users.noreply.github.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Codex <noreply@openai.com>
 2026-07-24 13:00:02 -07:00
Johnny-LiouGitHubClaude Opus 4.8mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>tomeras91Cyrus Leung
 		866fea2b99 [Kernel] ReplaySSM: cache SSM inputs for faster Mamba2 standard decode (#48018) 
Signed-off-by: Johnny-Liou <a897111@gmail.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: tomeras91 <57313761+tomeras91@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
 2026-07-24 09:39:49 -07:00
xiaozhoupyGitHubClaudeGiancarlo DelfinThien TranOpenAI Codexzhoustefankoncarevic
 		dd72658e7d [Perf][GLM-5.2] Blackwell decode optimizations (#48597) 
Signed-off-by: Peiyuan Zhou <peiyuanzhou1994@gmail.com>
Signed-off-by: zhou <zhou@zhoudeMacBook-Pro.local>
Signed-off-by: Stefan Koncarevic <stefan.koncarevic@amd.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Giancarlo Delfin <32987265+TheEpicDolphin@users.noreply.github.com>
Co-authored-by: Thien Tran <gau.nernst@yahoo.com.sg>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: zhou <zhou@zhoudeMacBook-Pro.local>
Co-authored-by: stefankoncarevic <Stefan.Koncarevic@amd.com>
 2026-07-23 21:36:27 -07:00
Andreas KaratzasandGitHub 2ac125123a [CI] Use explicit devices in IR tests (#49513) 
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
 2026-07-23 20:08:14 -07:00
Nick HillGitHubClaude Opus 4.8
 		46f01a50ac [CI][Bugfix] Fix test isolation in block_int8/ptpc_fp8 MoE kernel tests (#49609) 
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
 2026-07-23 12:26:02 -05:00
Andreas KaratzasandGitHub 0e36e3bbd1 [CI] Use explicit devices in quantization tests (#49512) 
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
 2026-07-23 10:54:26 -06:00
Nick HillandGitHub 910cc8543a [Bugfix] Restore gather_and_maybe_dequant_cache OOB guard (#49427) 
Signed-off-by: Nick Hill <nickhill123@gmail.com>
 2026-07-22 13:47:37 -07:00
Nick HillandGitHub 431934522b [CI] Fix stale/fragile untethered kernels-root tests (#49423) 
Signed-off-by: Nick Hill <nickhill123@gmail.com>
 2026-07-22 14:43:07 -06:00
Thien TranGitHubCodex
 		b44311b6ef [CI] stabilize GDN prefill CuTeDSL test (#49388) 
Signed-off-by: Thien Tran <gau.nernst@yahoo.com.sg>
Co-authored-by: Codex <noreply@openai.com>
 2026-07-22 09:03:46 -07:00
Wentao YeandGitHub 37e370fe93 [DSv4 Perf] Skip empty c128 kernel launch, around 2x kernel performance improvement. (#48957) 
Signed-off-by: yewentao256 <zhyanwentao@126.com>
 2026-07-22 10:55:20 -04:00
Lucas WilkinsonGitHubOpenAI Codex
 		060b5f61dc [Bugfix][Attention] Ignore empty MLA context chunks during merge (#49294) 
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
 2026-07-22 02:23:48 +00:00
stefankoncarevicandGitHub 05781e21dd [ROCm][CI] Fix order-dependent failure in test_flash_attn_accepts_handled_fp8_variants (MI355) (#49329) 
Signed-off-by: Stefan Koncarevic <Stefan.Koncarevic@amd.com>
 2026-07-21 18:54:33 -05:00
gnovackandGitHub 85f638a2b8 skip cudagraph/DP padding in topk (#48979) 
Signed-off-by: gnovack <novackgm@gmail.com>
 2026-07-21 15:20:30 -07:00
stefankoncarevicandGitHub 61e10f0116 [ROCm][CI] Fix AITER MLA fp8 decode metadata regression test (#48845) 
Signed-off-by: Stefan Koncarevic <Stefan.Koncarevic@amd.com>
 2026-07-21 12:19:45 -05:00
Xuanyu ZhangGitHubClaudeaoshen02OpenAI Codex
 		97a668152b [RL Infra][FlashInfer] Enable router replay output from FlashInfer monolithic MoE kernel (#44214) 
Signed-off-by: Xuanyu Zhang <xuanyu.zhang@mistral.ai>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: OpenAI Codex <noreply@openai.com>
 2026-07-20 16:45:10 -07:00
Akash kaothalkarGitHubAkash KaothalkarAkash KaothalkarAkash KaothalkarAkash kaothalkarLi, Jiang <jiang1.li@intel.com>
 		5c9f6557d7 [Hardware][CPU] Enable granite-4 model on cpu (#47641) 
Signed-off-by: Akash Kaothalkar <akashkaothalkar@akashs-mbp.bl1-in.ibm.com>
Signed-off-by: Akash Kaothalkar <akashkaothalkar@dhcp-9-123-5-76.bl1-in.ibm.com>
Signed-off-by: Akash Kaothalkar <akashkaothalkar@Akashs-MBP.lan>
Signed-off-by: Akash kaothalkar <akash.kaothalkar@ibm.com>
Co-authored-by: Akash Kaothalkar <akashkaothalkar@dhcp-9-123-5-76.bl1-in.ibm.com>
Co-authored-by: Akash Kaothalkar <akashkaothalkar@Akashs-MBP.lan>
Co-authored-by: Akash Kaothalkar <akashkaothalkar@akashs-mbp.bl1-in.ibm.com>
Co-authored-by: Akash kaothalkar <akash.kaothalkar@ibm.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
 2026-07-20 06:15:16 +00:00
Andreas KaratzasGitHubOpenAI Codex
 		752bd10647 [ROCm][CI] Fix sparse MLA metadata sync fixture (#49128) 
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
 2026-07-19 23:02:03 -05:00
Kevin H. LuuGitHubSimon MoOpenAI CodexOpenAI Codex
 		1dcbbd9cac [CI] Move compatible 1xL4 jobs to H200 35GB MIG (#43024) 
Signed-off-by: Simon Mo <simon@inferact.ai>
Co-authored-by: Simon Mo <simon@inferact.ai>
Co-authored-by: OpenAI Codex <noreply@openai.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
 2026-07-19 19:21:25 -07:00
xuebwang-amdandGitHub f12b80c6ef [ROCm][Bugfix] Fix GPT-OSS Quark MXFP4 MoE loading - emulation buffer not block-aligned (#43979) 
Signed-off-by: xuebwang-amd <xuebwang@amd.com>
 2026-07-18 03:49:41 +00:00
Wentao YeandGitHub b5433b6f50 [Perf] Optimize dsv4 routing using specialized kernel, 2.94% E2E TPOT improvement (#48660) 
Signed-off-by: yewentao256 <zhyanwentao@126.com>
 2026-07-17 13:35:06 -07:00
Thien TranandGitHub fe784ff22e [M3] Improve indexer for long-context decode (sm100) (#48582) 
Signed-off-by: Thien Tran <gau.nernst@yahoo.com.sg>
 2026-07-16 18:12:15 -07:00
Matthew BonanniGitHubOpenAI Codexmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 		67f9046e4a [Bugfix] Sparse MLA: enable fp8_ds_mla dense prefill (#48642) 
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-07-16 22:44:04 +00:00
Wentao YeandGitHub 626c90b2d5 [Refactor] Move fla to third party (#48500) 
Signed-off-by: yewentao256 <zhyanwentao@126.com>
 2026-07-16 19:22:36 +01:00
Tuukka SarviGitHubmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 		b8168e33e0 [ROCm][Perf][DSV4] Enable split sparse decode on gfx942 (#46275) 
Signed-off-by: Tuukka Sarvi <tuukka.sarvi@amd.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-07-16 12:28:20 +00:00