karylab_agents/vllm
1
0
Fork 0
forked from Karylab-cklius/vllm
Code Pull Requests 2 Actions 1 Packages Activity
16,133 Commits 354 Branches 175 Tags
releases/v0.20.1-python-from-source
Commit Graph
279 Commits
Author SHA1 Message Date
khluuandClaude Opus 4.6 7c36acf7fd Fix Python version regex quoting in Dockerfile 
The grep -oP pattern with escaped double quotes was getting mangled
by Dockerfile shell escaping, causing the resolved version to include
a trailing quote character (e.g. "3.12.13\""), resulting in a 404
when downloading the source tarball. Switch to grep -oE matching
just the version number directly.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

Signed-off-by: khluu <khluu000@gmail.com>
 2026-05-01 18:41:43 -07:00
khluuandClaude Opus 4.6 9f876610de Build Python from source instead of using deadsnakes PPA 
Replace the slow/flaky add-apt-repository deadsnakes PPA with building
Python from source. This avoids the long wait times and retry loops
when Launchpad PPA servers are slow or unresponsive.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

Signed-off-by: khluu <khluu000@gmail.com>
 2026-05-01 18:31:44 -07:00
khluu 747e379546 retry 10 times 
Signed-off-by: khluu <khluu000@gmail.com>
 2026-05-01 15:54:13 -07:00
Zhewen Liandkhluu 88d34c6409 [Docker] Install numactl CLI in CUDA runtime image (#41032) 
Signed-off-by: Zhewen Li <zhewenli@inferact.ai>
Co-authored-by: Zhewen Li <zhewenli@inferact.ai>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
(cherry picked from commit 6232fb4b66)
 2026-04-27 12:04:32 -07:00
Andreas KaratzasandGitHub 95995bbef8 [ROCm][Engine] Fix GPU memory leaks in engine shutdown and test workaround for async KV prefix cache reset (#38503) 
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
 2026-04-25 05:25:20 +00:00
Neil SchemenauerGitHubSimon Mo
 		21792520e7 [Build] Add Python 3.14 to supported version list. (#34770) 
Signed-off-by: Neil Schemenauer <nas@arctrix.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>
 2026-04-24 10:24:05 -07:00
Dmitry TokarevandGitHub 6dec49f27e [Build] Bump CUDA to 13.0.2 to match PyTorch 2.11.0 (#40669) 
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
 2026-04-24 10:27:11 +00:00
JohnnyandGitHub 7f95a66cbf [NVIDIA] Add sm_110 (Jetson Thor) to CUDA 13.0 build targets (#39233) 2026-04-23 15:42:14 -04:00
Kunshang JiandGitHub 53ecc807c0 [XPU] Upgrade torch 2.11 for xpu (#37947) 
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
 2026-04-23 10:07:35 -05:00
Shengqi ChenGitHubClaude Opus 4.6
 		3ed5231c6a [Build] Switch default CUDA to 13.0, update CUDA architecture lists, clean up stale build-args (#39878) 
Signed-off-by: Shengqi Chen <harry-chen@outlook.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
 2026-04-23 15:51:28 +08:00
TJianandGitHub 583e6f2226 [ROCm] [Wheel] [Bugfix] [Critical] Remove any packages installed from github from rocm.txt e.g fastsafetensors as it is incompatible with uv pip (#40461) 
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
 2026-04-22 00:18:07 +00:00
Theresa ShanGitHubTheresa ShanTJian
 		2390caf157 Enable building MoRI with AMD AINIC stack (#38371) 
Signed-off-by: Theresa Shan <thshan@smci355-ccs-aus-n08-21.prov.aus.ccs.cpe.ice.amd.com>
Signed-off-by: Theresa Shan <theresa.shan@amd.com>
Co-authored-by: Theresa Shan <thshan@smci355-ccs-aus-n08-21.prov.aus.ccs.cpe.ice.amd.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
 2026-04-20 11:17:59 -07:00
baiandGitHub 191e3fdaa1 Update flashinfer to 0.6.8 (#39959) 
Signed-off-by: bai <v@gor.io>
 2026-04-20 10:37:23 -07:00
Ryan RockandGitHub 58da4ee047 [AMD][CI] Update DeepEP branch (#38396) 
Signed-off-by: Ryan Rock <ryan.rock@amd.com>
 2026-04-17 14:30:20 -05:00
Andreas KaratzasandGitHub 1ae11e2bfc [ROCm][CI] Build fastsafetensors from source so it links against libamdhip64 (#39978) 
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
 2026-04-17 14:30:08 -05:00
Li, JiangandGitHub d02421a7db [CPU] Refactor CPU affinity and memory management (#39781) 
Signed-off-by: jiang1.li <jiang1.li@intel.com>
 2026-04-17 21:01:08 +08:00
R3hankhanandGitHub 4b7ca37bd4 [CPU][IBM Z][Dockefile][Docs] Fix s390x builds for torch 2.11 and update docs for s390x (#39910) 
Signed-off-by: Rehan Khan <Rehan.Khan7@ibm.com>
 2026-04-15 22:26:21 -07:00
Harry MellorGitHubkhluuCyrus Leungjiang1.li
 		03f8d3a548 Update to transformers v5 (#30566) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: khluu <khluu000@gmail.com>
Signed-off-by: Kevin H. Luu <khluu000@gmail.com>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: khluu <khluu000@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: jiang1.li <jiang1.li@intel.com>
 2026-04-15 16:29:15 -07:00
Li, JiangandGitHub eb92ba740a [CI/Build] Fix sentence-transformers version in CPU test (#39557) 
Signed-off-by: jiang1.li <jiang1.li@intel.com>
 2026-04-11 07:04:25 +00:00
Harry MellorGitHubRobert Shaw
 		fc645f1acc Add structure to requirements/ directory (#39024) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
 2026-04-10 13:46:41 -07:00
TJianandGitHub 42c6bb4b75 [ROCm] [AITER] Revert AITER version to v0.1.10.post3 (#39509) 
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
 2026-04-10 16:25:52 +00:00
Andreas KaratzasandGitHub 9036d4c464 [ROCm][CI] Resolved nvidia package deps issue (#39421) 
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
 2026-04-10 00:06:06 +08:00
Zhewen LiandGitHub 9e78555743 [Docker] Add fastsafetensors to NVIDIA Dockerfile (#38950) 2026-04-08 22:21:37 -07:00
Michael GoinGitHubClaude
 		eb4205fee5 [UX] Integrate DeepGEMM into vLLM wheel via CMake (#37980) 
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
 2026-04-08 18:56:32 -07:00
Gregory ShtrasbergandGitHub 0e9f0a516c [ROCm][CI-Build] Cherry pick triton BUFFER_OPS fix and update AITER (#38580) 
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
 2026-04-08 10:38:03 -05:00
Andrey TalmanandGitHub 2111997f96 [release 2.11] Update to torch 2.11 (#34644) 2026-04-07 18:55:48 -07:00
Andreas KaratzasandGitHub 06fd9ffcc4 [ROCm][CI] Fix ROCm Dockerfile conftest generation for older Docker parsers (#38959) 
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
 2026-04-04 10:41:41 +08:00
Andreas KaratzasandGitHub 4b506ff90a [ROCm][CI] Minor missing import patch (#38951) 
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
 2026-04-03 23:01:20 +00:00
Gregory ShtrasbergandGitHub a7d79fa133 [ROCm][CI/Build] Fix the pytest hook to properly print out the summary (#38585) 
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
 2026-04-03 17:24:26 +08:00
Li, JiangandGitHub 21d7ecc5b0 [CI/Build] Add audio deps in Dockerfile.cpu (#38876) 
Signed-off-by: jiang1.li <jiang1.li@intel.com>
 2026-04-03 05:05:14 +00:00
sihao_liGitHubKunshang Ji
 		d71a15041f [XPU]move testing dependencies from Dockerfile to xpu-test.in (#38596) 
Signed-off-by: sihao.li <sihao.li@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
 2026-03-31 12:49:43 +00:00
JohnnyandGitHub b4a2f3ac36 [NVIDIA] Bugfix NVFP4 DGX Spark and RTX50 (#38423) 
Signed-off-by: johnnynunez <johnnynuca14@gmail.com>
Signed-off-by: Johnny <johnnynuca14@gmail.com>
 2026-03-30 09:36:18 -07:00
Andreas KaratzasandGitHub af89140efc [ROCm][CI] Fix UV install in Dockerfile.rocm to detect curl failures and retry (#38415) 
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
 2026-03-29 00:47:42 +08:00
Michael GoinandGitHub 2bf5b70ae8 [CI Bugfix] Pre-download missing FlashInfer headers in Docker build (#38391) 
Signed-off-by: mgoin <mgoin64@gmail.com>
 2026-03-28 06:09:00 -07:00
Gregory ShtrasbergandGitHub 731285c939 [ROCm][CI/Build] ROCm 7.2.1 release version; torch 2.10; triton 3.6 (#38252) 
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
 2026-03-27 18:03:12 -05:00
Andreas KaratzasandGitHub db01535e2b [ROCm][CI] Add uv pip compile workflow for rocm-test.txt lockfile (#37930) 
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
 2026-03-26 12:44:01 -05:00
Michael GoinandGitHub 0f0e03890e [UX] Add flashinfer-cubin as CUDA default dep (#37233) 
Signed-off-by: mgoin <mgoin64@gmail.com>
 2026-03-24 14:13:08 -07:00
amey asgaonkarandGitHub 0c1809c806 Add Ubuntu 24.04 support for Docker builds (#35386) 
Signed-off-by: aasgaonkar <aasgaonkar@nvidia.com>
 2026-03-24 13:34:44 -07:00
Li, JiangandGitHub 352b90c4a4 [Bugfix] Add replacement of _compute_slot_mapping_kernel on CPU (#37987) 
Signed-off-by: jiang1.li <jiang1.li@intel.com>
 2026-03-24 07:00:20 -07:00
Chaitanya Sri Krishna LollaGitHubTej Kiran
 		3982bc2cd0 [ROCm] Enable DeepEP ROCm as all2allbackend for AMD GPUs. (#34692) 
Signed-off-by: Tej Kiran <vpolamre@amd.com>
Co-authored-by: Tej Kiran <vpolamre@amd.com>
 2026-03-21 00:32:31 -07:00
sihao_liandGitHub 9dade5da3a [XPU]Unify xpu test dependencies in dockerfile.xpu (#36477) 
Signed-off-by: sihao.li <sihao.li@intel.com>
 2026-03-19 08:12:07 +08:00
Lalithnarayan CGitHubChinmay-Kulkarni-AMDTyler Michael SmithTyler Michael SmithClaude Sonnet 4.6
 		7acaea634c In-Tree AMD Zen CPU Backend via zentorch [1/N] (#35970) 
Signed-off-by: Lalithnarayan C <Lalithnarayan.C@amd.com>
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Chinmay-Kulkarni-AMD <Chinmay.Kulkarni@amd.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
 2026-03-15 23:35:35 +00:00
HariandGitHub a3e2e250f0 [Feature] Add Azure Blob Storage support for RunAI Model Streamer (#34614) 
Signed-off-by: hasethuraman <hsethuraman@microsoft.com>
 2026-03-15 19:38:21 +08:00
arloandGitHub 8c29042bb9 [Feature] Add InstantTensor weight loader (#36139) 2026-03-14 18:05:23 +01:00
Li, JiangGitHubgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 		092ace9e3a [UX] Improve UX of CPU backend (#36968) 
Signed-off-by: jiang1.li <jiang1.li@intel.com>
Signed-off-by: Li, Jiang <bigpyj64@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-03-14 09:27:29 +08:00
Ryan RockandGitHub a79c1c2c80 [AMD][Build] Add DeepEP to ROCm Dockerfile (#36086) 
Signed-off-by: Ryan Rock <ryan.rock@amd.com>
 2026-03-12 21:33:32 +00:00
Dimitrios BariamisGitHubDimitrios Bariamis
 		cc16b24b17 Update Flashinfer to 0.6.6 (#36768) 
Signed-off-by: Dimitrios Bariamis <12195802+dbari@users.noreply.github.com>
Co-authored-by: Dimitrios Bariamis <12195802+dbari@users.noreply.github.com>
 2026-03-12 13:19:19 -04:00
Amr MahdiandGitHub 12b38c0f45 [CI/Build] Allow mounting AWS credentials for sccache S3 auth (#35912) 
Signed-off-by: Amr Mahdi <amrmahdi@meta.com>
 2026-03-03 14:30:47 -08:00
liuzhenweiGitHubKunshang Ji
 		9dd656f0ea [XPU][NIXL] Add GPUDirect RDMA support for XPU (#35270) 
Signed-off-by: zhenwei-intel <zhenwei.liu@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
 2026-03-03 08:42:49 +08:00
Tyler Michael SmithGitHubClaude Opus 4.6
 		eb19955c37 [WideEP] Remove pplx all2all backend (#33724) 
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
 2026-02-26 14:30:10 -08:00