karylab_agents/vllm
1
0
Fork 0
forked from Karylab-cklius/vllm
Code Pull Requests 2 Actions 2 Packages Activity
17,864 Commits 354 Branches 175 Tags
2a09d50034c19ef4ab8564cdb53ddf4bed29a323
Commit Graph
38 Commits
Author SHA1 Message Date
Flora FengandGitHub e3e3cd5458 [Bugfix][CI] Update Dockerfile dependency graph PNG (#45602) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-06-15 10:35:24 +08:00
Isotr0pyandGitHub a2c72d4388 [Bugfix] Fix Dockerfile dependency graph pre-commit error (#45374) 
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
 2026-06-12 07:10:18 +00:00
Flora FengandGitHub b038a2f73b [CI][Bugfix] Update Dockerfile dependency graph PNG (#45209) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-06-10 19:40:25 -07:00
Nguyễn Thế DuyGitHubClaude
 		3df1c7c43e [Docker] Non-root support for vllm-openai; add opt-in vllm-openai-nonroot target (#40275) 
Signed-off-by: TheDuyIT <nduy250299@gmail.com>
Signed-off-by: dtnguyen <dtnguyen@nvidia.com>
Co-authored-by: Claude <noreply@anthropic.com>
 2026-05-25 13:45:31 +08:00
Isotr0pyandGitHub ba369b7eb5 [CI] Fix dockerfile dependency graph failure for pre-commit (#43378) 
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
 2026-05-22 10:26:05 +08:00
wang.yuqiGitHubgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>Cyrus LeungHarry Mellor
 		257af77bc2 [Docs] Reorganize online serving docs. (#41907) 
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-05-19 14:43:18 +08:00
Gracie Guo (UX)GitHubGracie Guowang.yuqi
 		9fd8487d2f [Docs] Add SVG images for pooling models. (#42626) 
Signed-off-by: Gracie Guo <gracieguo@Gracies-MacBook-Pro.local>
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Co-authored-by: Gracie Guo <gracieguo@Gracies-MacBook-Pro.local>
Co-authored-by: wang.yuqi <yuqi.wang@daocloud.io>
 2026-05-18 22:50:38 -07:00
Kyle SayersGitHubFlora Feng
 		a085b5257d [Docs] [QeRL] Layerwise Reloading Documentation (#40317) 
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
Co-authored-by: Flora Feng <4florafeng@gmail.com>
 2026-04-28 21:06:38 -07:00
Dmitry TokarevandGitHub 6dec49f27e [Build] Bump CUDA to 13.0.2 to match PyTorch 2.11.0 (#40669) 
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
 2026-04-24 10:27:11 +00:00
Sophie du CouédicGitHubgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 		ff2c2bd80a [Docs]Add documentation for bench serve visualization arguments (#40539) 
Signed-off-by: Sophie du Couédic <sop@zurich.ibm.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-04-23 15:48:29 -07:00
Michael GoinGitHubClaude
 		eb4205fee5 [UX] Integrate DeepGEMM into vLLM wheel via CMake (#37980) 
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
 2026-04-08 18:56:32 -07:00
Andrey TalmanandGitHub 2111997f96 [release 2.11] Update to torch 2.11 (#34644) 2026-04-07 18:55:48 -07:00
Woosuk KwonandGitHub 4f85bae9d6 [Docs][Model Runner V2] Add Design Docs (#35819) 
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
 2026-03-02 19:58:14 -08:00
Kyle SayersandGitHub 64ac1395e8 [Docs] Clean up speculators docs (#34065) 
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
 2026-02-18 13:48:11 -08:00
Michael GoinandGitHub c39ee9ee2b [Docs] Add sections on process architecture and minimum CPU resources (#33940) 
It seems users can be confused about vLLM's performance when running
with very small amounts of CPU cores available. We are missing a clear
overview of what vLLM's process architecture is, so I added this along with
some diagrams in arch_overview.md, and included a section on CPU resource
recommendations in optimization.md

Signed-off-by: mgoin <mgoin64@gmail.com>
 2026-02-06 15:26:43 +00:00
Orion Reblitz-RichardsonGitHubKevin H. Luu
 		68b0a6c1ba [CI][torch nightlies] Use main Dockerfile with flags for nightly torch tests (#30443) 
Signed-off-by: Orion Reblitz-Richardson <orionr@meta.com>
Signed-off-by: Orion Reblitz-Richardson <orionr@gmail.com>
Co-authored-by: Kevin H. Luu <khluu000@gmail.com>
 2026-01-23 10:22:56 -08:00
Michael GoinandGitHub 6b2a672e47 [Doc] Add Claude code usage example (#31188) 
Signed-off-by: mgoin <mgoin64@gmail.com>
 2026-01-08 13:50:23 +08:00
Amr MahdiandGitHub ff21a0fc85 [docker] Restructure Dockerfile for more efficient and cache-friendly builds (#30626) 
Signed-off-by: Amr Mahdi <amrmahdi@meta.com>
 2025-12-15 18:52:19 -08:00
Amr MahdiandGitHub f5d3d93c40 [docker] Build CUDA kernels in separate Docker stage for faster rebuilds (#29452) 
Signed-off-by: Amr Mahdi <amrmahdi@meta.com>
 2025-12-03 11:41:53 +00:00
Benjamin BartelsandGitHub 4d6afcaddc [CI/Build] Moves to cuda-base runtime image while retaining minimal JIT dependencies (#29270) 
Signed-off-by: bbartels <benjamin@bartels.dev>
Signed-off-by: Benjamin Bartels <benjamin@bartels.dev>
 2025-11-24 11:40:54 -08:00
Benjamin BartelsandGitHub eb5352a770 [CI/build] Removes source compilation from runtime image (#26966) 
Signed-off-by: bbartels <benjamin@bartels.dev>
 2025-11-22 10:23:09 -08:00
Chenguang ZhengGitHubn00909098knlnguyen1802herotai214gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>Khuong LeKhuong Le
 		4ccffe561f [Core] Encoder separation for Encode-Prefill-Decode Disaggregation (#25233) 
Signed-off-by: n00909098 <nguyen.kha.long@huawei.com>
Signed-off-by: knlnguyen1802 <knlnguyen1802@gmail.com>
Signed-off-by: herotai214 <herotai214@gmail.com>
Signed-off-by: Khuong Le <khuong.le.manh@huawei.com>
Signed-off-by: Khuong Le <lemanhkhuong2611@gmail.com>
Co-authored-by: n00909098 <nguyen.kha.long@huawei.com>
Co-authored-by: knlnguyen1802 <knlnguyen1802@gmail.com>
Co-authored-by: herotai214 <herotai214@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Khuong Le <khuong.le.manh@huawei.com>
Co-authored-by: Khuong Le <lemanhkhuong2611@gmail.com>
 2025-11-11 18:58:33 -08:00
Richard ZouandGitHub 65ac8d8dc4 [Docs] Add guide to debugging vLLM-torch.compile integration (#28094) 
Signed-off-by: Richard Zou <zou3519@gmail.com>
 2025-11-05 21:31:46 +00:00
Matvei PashkovskiiGitHubHarry Mellor
 		130aa8cbcf Add load pattern configuration guide to benchmarks (#26886) 
Signed-off-by: Matvei Pashkovskii <mpashkov@amd.com>
Signed-off-by: Matvei Pashkovskii <matvei.pashkovskii@amd.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-10-28 10:49:15 -07:00
Huy DoGitHubLuka Govedič
 		becb7de40b Update PyTorch to 2.9.0+cu129 (#24994) 
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
 2025-10-21 17:20:18 -04:00
fhl2000GitHubHarry MellorLuka Govedič
 		63773a6200 [Docs] add docs for cuda graph v1 (#24374) 
Signed-off-by: fhl <2410591650@qq.com>
Signed-off-by: fhl2000 <63384265+fhl2000@users.noreply.github.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
 2025-10-07 05:25:05 -07:00
Tyler Michael SmithGitHubSimon Mo
 		27edd2aeb4 [Build/CI] Revert back to Ubuntu 20.04, install python 3.12 with uv (#26103) 
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>
 2025-10-02 22:21:01 -07:00
Huy DoandGitHub d4e7a1152d Update base image to 22.04 (jammy) (#26065) 
Signed-off-by: Huy Do <huydhn@gmail.com>
 2025-10-02 05:48:04 -07:00
Sergio Paniego BlancoGitHubHarry Mellor
 		099aaee536 Add Hugging Face Inference Endpoints guide to Deployment docs (#25886) 
Signed-off-by: sergiopaniego <sergiopaniegoblanco@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-09-30 14:35:06 +00:00
Chen ZhangGitHubHarry Mellor
 		d696f86e7b [doc] Hybrid KV Cache Manager design doc (#22688) 
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-08-26 20:19:05 +00:00
WeiQing ChenandGitHub 289b18e670 [Docs] Update features/disagg_prefill, add v1 examples and development (#22165) 
Signed-off-by: David Chen <530634352@qq.com>
 2025-08-07 00:59:23 -07:00
Cyrus LeungandGitHub fcfd1eb9c5 [Doc] Remove vLLM prefix and add citation for PagedAttention (#21910) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-07-30 06:36:34 -07:00
Chen ZhangGitHubgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 		76080cff79 [DOC] Fix path of v1 related figures (#21868) 
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2025-07-29 19:45:18 -07:00
Varun Sundar RabindranathGitHubVarun Sundar Rabindranath
 		f03e9cf2bb [Doc] Add FusedMoE Modular Kernel Documentation (#21623) 
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
 2025-07-29 10:32:30 -07:00
BrittanyGitHubgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>Harry Mellor
 		759b87ef3e [TPU] Add an optimization doc on TPU (#21155) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-07-29 07:23:19 -07:00
Michael YaoandGitHub 260127ea54 [Docs] Add intro and fix 1-2-3 list in frameworks/open-webui.md (#19199) 
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
 2025-07-16 06:11:38 -07:00
Nick HillandGitHub 9907fc4494 [Docs] Data Parallel deployment documentation (#20768) 
Signed-off-by: Nick Hill <nhill@redhat.com>
 2025-07-11 09:42:10 -07:00
Harry MellorandGitHub a1fe24d961 Migrate docs from Sphinx to MkDocs (#18145) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-05-23 02:09:53 -07:00