karylab_agents/vllm
1
0
Fork 0
forked from Karylab-cklius/vllm
Code Pull Requests 2 Actions 1 Packages Activity
17,191 Commits 354 Branches 175 Tags
dependabot/github_actions/actions/setup-python-6.2.0
Commit Graph
54 Commits
Author SHA1 Message Date
Yongye ZhuandGitHub 03d9cc2fe2 [misc] Bump cutedsl version to 4.5.2 (#43745) 
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
 2026-05-27 08:25:36 -07:00
Mohammad Miadh AngkadandGitHub a970fb5a1a Fix CuPy runtime deps and restore humming (#43530) 
Signed-off-by: Mohammad Miadh Angkad <176301910+mmangkad@users.noreply.github.com>
 2026-05-26 05:59:40 -07:00
Michael GoinandGitHub 10d264a2b9 Revert "[Misc] add humming to dependencies" (#43492) 2026-05-23 14:21:13 -07:00
Jiangyun ZhuandGitHub 6dc0a71843 [Misc] downgrade nvidia-cutlass-dsl to 4.5.0 (#43230) 
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
 2026-05-20 14:19:50 -07:00
Jinzhen LinandGitHub 8200fbe1ac [Misc] add humming to dependencies (#42540) 
Signed-off-by: Jinzhen Lin <jinzhen.ljz@antgroup.com>
 2026-05-19 08:36:47 -07:00
Artem PerevedentsevandGitHub f85c76d701 [CI/Build] Bump nvidia-cutlass-dsl to 4.5.1 (#42991) 
Signed-off-by: Artem Perevedentsev <aperevedents@nvidia.com>
 2026-05-18 16:58:15 -07:00
Artem PerevedentsevGitHubVadim Gimpelson
 		0867497368 [CI/Build] Bump flashinfer to v0.6.11.post2 (#41711) 
Signed-off-by: Artem Perevedentsev <aperevedents@nvidia.com>
Co-authored-by: Vadim Gimpelson <156319763+vadiklyutiy@users.noreply.github.com>
 2026-05-16 14:55:12 -07:00
Wentao YeGitHubRoger Wang
 		23c85343fb [Bug] Fix DeepSeek V4 AttributeError: module 'cutlass.cute.nvgpu' has no attribute 'LoadCacheMode' (#42342) 
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
 2026-05-14 02:00:20 -07:00
Yongye ZhuGitHubRoger Wang
 		0d2732dd91 [MLA Attention Backend] Add TOKENSPEED_MLA backend for DSR1/Kimi K25 prefill + decode on Blackwell (#41778) 
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.io>
 2026-05-13 23:48:02 -07:00
Jiangyun ZhuandGitHub 140dc2ec30 [Bugfix] Install nvidia-cutlass-dsl[cu13] extra on CUDA 13 platforms (#42438) 
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
 2026-05-13 01:57:21 -07:00
+8
Yifan QiaoGitHubYongye ZhuYongye ZhuSimon MoBugen ZhaoGiancarlo DelfinJee Jee LiNick HillRoger WangRoy WangWoosuk KwonyoukaichaoZhewen LiZijing LiukhluuqizixiZhewen Li
 		4d51588e23 [Feat] DeepSeek V4 Rebased (#40860) 
Signed-off-by: Yifan Qiao <yifanqiao@inferact.ai>
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
Signed-off-by: qizixi <zixi@inferact.ai>
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Yongye Zhu <yongye@inferact.ai>
Co-authored-by: Simon Mo <simon@inferact.ai>
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Giancarlo Delfin <gdelfin@inferact.ai>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roy Wang <yasong.wang@inferact.ai>
Co-authored-by: Woosuk Kwon <woosuk@inferact.ai>
Co-authored-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: Zhewen Li <jerven.vllm@gmail.com>
Co-authored-by: Zijing Liu <liuzijing2014@gmail.com>
Co-authored-by: khluu <khluu000@gmail.com>
Co-authored-by: qizixi <zixi@inferact.ai>
Co-authored-by: Zhewen Li <zhewenli@inferact.ai>
 2026-04-26 18:31:08 -07:00
Neil SchemenauerGitHubSimon Mo
 		21792520e7 [Build] Add Python 3.14 to supported version list. (#34770) 
Signed-off-by: Neil Schemenauer <nas@arctrix.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>
 2026-04-24 10:24:05 -07:00
baiandGitHub 191e3fdaa1 Update flashinfer to 0.6.8 (#39959) 
Signed-off-by: bai <v@gor.io>
 2026-04-20 10:37:23 -07:00
Zhewen LiandGitHub 9e78555743 [Docker] Add fastsafetensors to NVIDIA Dockerfile (#38950) 2026-04-08 22:21:37 -07:00
Andrey TalmanandGitHub 2111997f96 [release 2.11] Update to torch 2.11 (#34644) 2026-04-07 18:55:48 -07:00
Lucas WilkinsonandGitHub cb3935a8fc [FA4] Update flash-attention to latest upstream FA4 (#38690) 
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
 2026-04-02 17:02:37 +00:00
JohnnyandGitHub b4a2f3ac36 [NVIDIA] Bugfix NVFP4 DGX Spark and RTX50 (#38423) 
Signed-off-by: johnnynunez <johnnynuca14@gmail.com>
Signed-off-by: Johnny <johnnynuca14@gmail.com>
 2026-03-30 09:36:18 -07:00
Michael GoinandGitHub 0f0e03890e [UX] Add flashinfer-cubin as CUDA default dep (#37233) 
Signed-off-by: mgoin <mgoin64@gmail.com>
 2026-03-24 14:13:08 -07:00
Dimitrios BariamisGitHubDimitrios Bariamis
 		cc16b24b17 Update Flashinfer to 0.6.6 (#36768) 
Signed-off-by: Dimitrios Bariamis <12195802+dbari@users.noreply.github.com>
Co-authored-by: Dimitrios Bariamis <12195802+dbari@users.noreply.github.com>
 2026-03-12 13:19:19 -04:00
Kevin H. LuuandGitHub 82b110d50e [ci] Bound nvidia-cudnn-frontend version (#36719) 
Signed-off-by: khluu <khluu000@gmail.com>
 2026-03-11 12:17:35 +08:00
Wentao YeGitHubgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 		384425f84e [Dependency] Remove default ray dependency (#36170) 
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-03-08 20:06:22 -07:00
Lucas WilkinsonGitHubMatthew BonanniTyler Michael Smith
 		8b5014d3dd [Attention] FA4 integration (#32974) 
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
 2026-03-01 23:44:57 +00:00
Wei ZhaoGitHubCyrus Leung
 		ea5f903f80 Bump Flashinfer Version and Re-enable DeepSeek NVFP4 AR+Norm Fusion (#34899) 
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
 2026-02-20 13:37:31 -08:00
Andrey TalmanandGitHub f97ca67176 [Release 2.10] Update to Torch 2.10 - final release (#30525) 2026-02-08 13:51:09 -08:00
Dimitrios BariamisGitHubDimitrios Bariamismgoin
 		207c3a0c20 Fix RoutingMethodType logic (#33919) 
Signed-off-by: Dimitrios Bariamis <12195802+dbari@users.noreply.github.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Dimitrios Bariamis <12195802+dbari@users.noreply.github.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
 2026-02-06 14:03:34 -08:00
Wentao YeandGitHub 655efb3e69 [Dependency] Remove comments of ray in dependency files (#33351) 
Signed-off-by: yewentao256 <zhyanwentao@126.com>
 2026-02-03 15:30:47 -08:00
Dimitrios BariamisGitHubDimitrios BariamisCyrus Leung
 		f0bca83ee4 Add support for Mistral Large 3 inference with Flashinfer MoE (#33174) 
Signed-off-by: Dimitrios Bariamis <12195802+dbari@users.noreply.github.com>
Co-authored-by: Dimitrios Bariamis <12195802+dbari@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
 2026-01-30 22:48:27 -08:00
elvischenvandGitHub 808d6fd7b9 Bump Flashinfer to v0.6.1 (#30993) 
Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
 2026-01-21 08:49:50 -08:00
Andrey TalmanandGitHub e06d0bf0aa 2.9.1 PyTorch release update (#28495) 2025-12-17 12:20:22 -08:00
Andrii SkliarGitHubAndrii Skliar
 		a5345bf49d [BugFix] Fix plan API Mismatch when using latest FlashInfer (#29426) 
Signed-off-by: Andrii Skliar <askliar@askliar-mlt.client.nvidia.com>
Co-authored-by: Andrii Skliar <askliar@askliar-mlt.client.nvidia.com>
 2025-11-27 11:34:59 -08:00
Roger WangandGitHub 0ff70821c9 [Core] Deprecate xformers (#29262) 
Signed-off-by: Roger Wang <hey@rogerw.io>
 2025-11-24 04:18:55 +00:00
Roger WangandGitHub 0aecd9138f [Misc] Update xformers to 0.33.0.post1 (#28678) 
Signed-off-by: Roger Wang <hey@rogerw.io>
 2025-11-13 21:52:53 -08:00
Huy DoGitHubRoger Wang
 		c33b87e777 Use official xformers-0.0.33 built for PT 2.9 (#28600) 
Signed-off-by: Huy Do <huydhn@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
 2025-11-12 22:48:53 -08:00
Harry MellorandGitHub 811df41ee9 Update Flashinfer from v0.4.1 to v0.5.2 (#27952) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-11-07 16:24:42 -08:00
Huy DoandGitHub ba33e8830d Reapply "Install pre-built xformers-0.0.32.post2 built with pt-2.9.0" (#27768) 
Signed-off-by: Huy Do <huydhn@gmail.com>
 2025-10-30 10:22:30 -07:00
Varun Sundar RabindranathandGitHub f6d5f5888c [Build] Revert triton_kernels requirements (#27659) 2025-10-28 21:07:09 -07:00
Simon MoandGitHub 9007bf57e6 Revert "Install pre-built xformers-0.0.32.post2 built with pt-2.9.0" (#27714) 2025-10-28 20:58:01 -07:00
Huy DoGitHubRoger Wang
 		f257544709 Install pre-built xformers-0.0.32.post2 built with pt-2.9.0 (#27598) 
Signed-off-by: Huy Do <huydhn@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
 2025-10-28 19:39:15 -07:00
Varun Sundar RabindranathGitHubVarun Sundar Rabindranath
 		a9f55dc588 [Misc] Add triton_kernels dependency (#27370) 
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
 2025-10-23 12:04:14 -07:00
Huy DoGitHubLuka Govedič
 		becb7de40b Update PyTorch to 2.9.0+cu129 (#24994) 
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
 2025-10-21 17:20:18 -04:00
jiahancGitHubMichael Goin
 		41d3071918 [NVIDIA] [Perf] Update to leverage flashinfer trtllm FP4 MOE throughput kernel (#26714) 
Signed-off-by: jiahanc <173873397+jiahanc@users.noreply.github.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
 2025-10-16 16:20:25 -07:00
Michael GoinGitHubWentao Ye
 		c9d33c60dc [UX] Add FlashInfer as default CUDA dependency (#26443) 
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
 2025-10-09 14:10:02 -07:00
Harry MellorandGitHub e09d1753ec Remove Python 3.9 support ahead of PyTorch 2.9 in v0.11.1 (#26416) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-10-08 10:40:42 -07:00
Huy DoGitHubMichael Goin
 		67c14906aa Update PyTorch to 2.8.0 (#20358) 
Signed-off-by: Huy Do <huydhn@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
 2025-08-29 18:57:35 +08:00
Rui QiaoandGitHub 2ff46b8826 [Misc] Bump ray to 2.48.0 (#22123) 
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
 2025-08-02 19:42:00 -07:00
Michael GoinandGitHub 0bd409cf01 Move flashinfer-python to optional extra vllm[flashinfer] (#21959) 
Signed-off-by: mgoin <mgoin64@gmail.com>
 2025-07-31 18:02:11 -07:00
Michael GoinandGitHub a33ea28b1b Add flashinfer_python to CUDA wheel requirements (#21389) 
Signed-off-by: mgoin <mgoin64@gmail.com>
 2025-07-29 12:51:58 -07:00
Michael GoinandGitHub 4e7dfbe7b4 Update PyTorch to torch==2.7.1 for CUDA (#21011) 
Signed-off-by: mgoin <mgoin64@gmail.com>
 2025-07-17 02:30:44 +00:00
Huy DoandGitHub 2c4f59afc3 Update PyTorch to 2.7.0 (#16859) 2025-04-29 19:08:04 -07:00
cyyeverandGitHub ec1f9c8c91 Update Numba to 0.61.2 (#16376) 
Signed-off-by: cyy <cyyever@outlook.com>
 2025-04-10 07:59:37 +00:00