karylab_agents/vllm
1
0
Fork 0
forked from Karylab-cklius/vllm
Code Pull Requests 2 Actions 1 Packages Activity
18,238 Commits 354 Branches 175 Tags
aa3f2efe425ac51e2967e9fbbec4edebaa62f685
Commit Graph
159 Commits
Author SHA1 Message Date
Shengqi ChenandCodex a32d1bff95 [Doc] Document CUDA wheel architecture coverage 
Explain that pre-built CUDA wheels use the architecture lists selected by the release and build pipelines, which may be narrower than the full set vLLM can build from source.

Call out CUDA 12.9 architecture-specific wheel coverage, CUDA 13 family-specific targets, and the no-kernel-image error users may see when a wheel does not cover their GPU.

Co-authored-by: Codex <codex@openai.com>

Signed-off-by: Shengqi Chen <harry-chen@outlook.com>
 2026-06-30 19:27:42 +08:00
Michael GoinGitHubClaude Opus 4.8
 		c6554f321c [CPU] Fix macOS/Apple Silicon hang by enabling OpenMP in the build (#46769) 
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
 2026-06-26 14:32:21 -04:00
Kunshang JiandGitHub ec67d7ae61 [xpu] bump up vllm-xpu-kernels v0.1.10 and upgrade 2618 umd (#40367) 
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
 2026-06-19 15:37:20 +08:00
Lalithnarayan CGitHubTyler Michael SmithClaudeTyler Michael Smith
 		405c7cf283 [ZenCPU] Add zencpu Platform Runtime Logging and Docs (#42726) 
Signed-off-by: Lalithnarayan C <Lalithnarayan.C@amd.com>
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
 2026-06-16 08:23:12 -04:00
vllmellmandGitHub 25c53d1293 [ROCm][Doc] Add installation notes about python version requirement (#45671) 
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
 2026-06-15 17:22:55 +08:00
midasandGitHub 0d29612292 [Doc] Fix uv dependency resolution failure for setuptools during CPU source builds (x86 & ARM) (#45412) 
Signed-off-by: midas <the.anon.github@gmail.com>
 2026-06-13 06:18:58 +00:00
Richard BarnesGitHubShengqi Chen
 		05d9848267 [Build] Upgrade CUDA Dockerfiles from GCC 10 to GCC 12 for C++20 compatibility (#44923) 
Signed-off-by: Richard Barnes <rbarnes@meta.com>
Co-authored-by: Shengqi Chen <harry-chen@outlook.com>
 2026-06-11 12:26:52 +00:00
Kunshang JiandGitHub b4c6dc6454 [WIP][XPU] upgrade torch-xpu to 2.12 (#42262) 
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
 2026-06-09 15:51:39 +00:00
Kunshang JiandGitHub 30c6289b8e [XPU] fix xpu install document triton-xpu version (#43947) 
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
 2026-05-29 02:05:12 -07:00
Aditya SinghGitHubClaudemergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 		ad464e16c0 [Doc] Add Ascend NPU tab to the quickstart installation guide (#43550) 
Signed-off-by: Aditya Singh <adisin650@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-05-27 08:41:29 +00:00
Nick HillGitHubBugen Zhao
 		f2ace1d57d [Frontend][RFC] Rust front-end integration (#40848) 
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
 2026-05-21 12:24:48 +08:00
Fadi ArafehandGitHub be16785998 [CPU][DOC] Fix installation commands for Arm CPUs (#43115) 
Signed-off-by: Fadi Arafeh <fadi.arafeh@arm.com>
 2026-05-19 23:31:15 +00:00
wang.yuqiGitHubgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>Cyrus LeungHarry Mellor
 		257af77bc2 [Docs] Reorganize online serving docs. (#41907) 
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-05-19 14:43:18 +08:00
Alexa GriffithGitHubClaude Sonnet 4.5
 		cf0d279142 [Docs] Add Apple Silicon documentation for vLLM-Metal GPU support (#41987) 
Signed-off-by: alexagriffith <agriffith96@gmail.com>
Co-authored-by: Claude Sonnet 4.5 <noreply@anthropic.com>
 2026-05-11 11:34:25 -07:00
wang.yuqiGitHubgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 		1d694e78c9 [Examples][last/6] Resettle examples. (#41084) 
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-05-07 19:42:12 -07:00
Dmitry TokarevandGitHub 6dec49f27e [Build] Bump CUDA to 13.0.2 to match PyTorch 2.11.0 (#40669) 
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
 2026-04-24 10:27:11 +00:00
Kunshang JiandGitHub 53ecc807c0 [XPU] Upgrade torch 2.11 for xpu (#37947) 
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
 2026-04-23 10:07:35 -05:00
R3hankhanandGitHub 4b7ca37bd4 [CPU][IBM Z][Dockefile][Docs] Fix s390x builds for torch 2.11 and update docs for s390x (#39910) 
Signed-off-by: Rehan Khan <Rehan.Khan7@ibm.com>
 2026-04-15 22:26:21 -07:00
Harry MellorGitHubkhluuCyrus Leungjiang1.li
 		03f8d3a548 Update to transformers v5 (#30566) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: khluu <khluu000@gmail.com>
Signed-off-by: Kevin H. Luu <khluu000@gmail.com>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: khluu <khluu000@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: jiang1.li <jiang1.li@intel.com>
 2026-04-15 16:29:15 -07:00
Yuyi AoGitHubgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>Harry Mellor
 		610a3efcaf [Doc] Fix Python-only build 404 fallback guidance (#38052) 
Signed-off-by: George-ao <yuyiao772@gmail.com>
Signed-off-by: Yuyi Ao <yuyiao772@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-04-13 12:09:31 -07:00
Michael GoinandGitHub 7f0b8f2020 [Docs] Use --torch-backend=auto for editable install docs (#39511) 
Signed-off-by: Michael Goin <mgoin64@gmail.com>
 2026-04-10 15:27:02 -07:00
Harry MellorGitHubRobert Shaw
 		fc645f1acc Add structure to requirements/ directory (#39024) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
 2026-04-10 13:46:41 -07:00
TJianandGitHub 03ac6ca895 [ROCm] [DOC] Update the Documentation to include ROCm Nightly Wheel support (#38457) 
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
 2026-03-30 02:25:46 -07:00
Hongxia YangGitHubHongxia Yang
 		83a4df049d [ROCm][Documentation] update quickstart and installation to include rocm nightly docker tips (#38367) 
Signed-off-by: Hongxia Yang <hongxiay.yang@amd.com>
Co-authored-by: Hongxia Yang <hongxiay.yang@amd.com>
 2026-03-27 23:20:19 +00:00
Harry MellorandGitHub 9b005edc48 [Docs] Make the link to hardware plugins clearer (#37174) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-03-16 04:12:58 -07:00
Li, JiangGitHubgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 		092ace9e3a [UX] Improve UX of CPU backend (#36968) 
Signed-off-by: jiang1.li <jiang1.li@intel.com>
Signed-off-by: Li, Jiang <bigpyj64@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-03-14 09:27:29 +08:00
Kunshang JiGitHubcopilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
 		513949f95f [XPU][Doc] Remove manual OneAPI install step, now handled by torch-xpu (#36831) 
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
 2026-03-12 01:46:02 +00:00
Harry MellorandGitHub 35db669f1d Correct link to supported hardware on vllm.ai (#36798) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-03-11 08:43:28 -07:00
wang.yuqiGitHubgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>Harry Mellor
 		dcf8862fd4 [Examples][1/n] Resettle basic examples. (#35579) 
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-03-08 20:22:53 -07:00
Harry MellorandGitHub a0f44bb616 Allow markdownlint to run locally (#36398) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-03-08 20:05:24 -07:00
Kunshang JiGitHubcopilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
 		fde4771bbd [XPU][Doc] update xpu document about triton dependency/conflict issue. (#36301) 
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
 2026-03-09 02:09:22 +00:00
Maxime GrenuGitHubgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>Harry Mellor
 		32224f568a docs: update CPU Docker images to reference Docker Hub instead of AWS ECR (#34882) 
Signed-off-by: Maxime Grenu <69890511+cluster2600@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-03-04 10:31:35 -08:00
SageandGitHub d25c1ec3c9 docs(cpu): Clarify pre-built wheels requirement for CPU Python-only build (#35090) 
Signed-off-by: Sage Ahrac <sagiahrak@gmail.com>
 2026-03-04 17:45:35 +00:00
Seungmin KimGitHub88plugMichael Goin
 		160424a937 [Bugfix] Fix CUDA compatibility path setting for both datacenter and consumer NVIDIA GPUs (#33992) 
Signed-off-by: Seungmin Kim <8457324+ehfd@users.noreply.github.com>
Signed-off-by: Andrew Mello <19512127+88plug@users.noreply.github.com>
Co-authored-by: 88plug <19512127+88plug@users.noreply.github.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
 2026-02-25 18:15:51 -08:00
Yanwen LinandGitHub 80e60a6133 [Doc] Suggest "--managed-python" flag when installing python using uv (#33069) 
Signed-off-by: Yanwen Lin <lyw1124278064@gmail.com>
 2026-02-25 08:19:43 +00:00
Maryam TahhanGitHubLi, Jiang <jiang1.li@intel.com>
 		f07a128413 [CPU][ARM] Add ARM BF16 cross-compilation support and improve documen… (#33079) 
Signed-off-by: Maryam Tahhan <mtahhan@redhat.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
 2026-02-15 06:33:08 -08:00
Louie TsaiandGitHub 55a1a9563a Vllm CPU benchmark suite improvement (#34128) 
Signed-off-by: louie-tsai <louie.tsai@intel.com>
 2026-02-12 16:04:44 +08:00
Kunshang JiandGitHub cb9574eb85 [XPU][9/N] clean up existing ipex code/doc (#34111) 
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
 2026-02-11 00:27:15 -08:00
vllmellmGitHubTJianHarry Mellor
 		aaa2efbe98 [DOC] [ROCm] Update docker deployment doc (#33971) 
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-02-06 10:05:35 -08:00
rinbaroandGitHub 007b183d74 [docs] fix unintentional misspellings (#33863) 
Signed-off-by: rinbaro <ilgomishra@gmail.com>
 2026-02-04 20:50:59 -08:00
Nathan WeinbergandGitHub 58cb55e4de [Doc] Enhance documentation around CPU container images (#32286) 
Signed-off-by: Nathan Weinberg <nweinber@redhat.com>
 2026-01-30 13:36:20 +00:00
vllmellmandGitHub 174f16700b [Doc] [ROCm] Update Documentation to reflect v0.15.0 release (#33388) 
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
 2026-01-30 19:06:08 +08:00
Maryam TahhanandGitHub 2dd359f953 [Docs] Simplify CPU x86 Docker build documentation (#33071) 
Signed-off-by: Maryam Tahhan <mtahhan@redhat.com>
 2026-01-28 06:37:09 +00:00
7. SunandGitHub ff6c1da4e6 [Docs] Fix Apple silicon include path in CPU installation docs (#32977) 
Signed-off-by: 7. Sun <jhao.sun@gmail.com>
 2026-01-25 01:51:49 +00:00
TJianandGitHub 1ebdff412a [DOC] [ROCm] Update doc for v0.14.1 (#32998) 
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
 2026-01-25 09:13:21 +08:00
Maryam TahhanGitHubLi, Jiang <jiang1.li@intel.com>
 		203d0bc0c2 [CPU] Improve CPU Docker build (#30953) 
Signed-off-by: Maryam Tahhan <mtahhan@redhat.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
 2026-01-24 17:08:24 +00:00
Michael GoinGitHubShengqi Chen
 		d0cbac5827 [Dev UX] Add auto-detection for VLLM_PRECOMPILED_WHEEL_VARIANT during install (#32948) 
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Shengqi Chen <i@harrychen.xyz>
 2026-01-23 19:15:17 -08:00
TJianGitHubHongxia YangDarkLight1337
 		c025263ddd [Doc] [ROCm] Update ROCm getting started doc (#32580) 
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: Hongxia Yang <hongxia.yang@amd.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2026-01-20 09:20:08 -08:00
Dmitry TokarevandGitHub 46f8c6b725 Fix CUDA 13 wheel installation doc (#32276) 
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
 2026-01-13 10:48:37 -08:00
Andrew BennettandGitHub f243abc92d Fix various typos found in docs (#32212) 
Signed-off-by: Andrew Bennett <potatosaladx@meta.com>
 2026-01-13 03:41:47 +00:00