karylab_agents/vllm
1
0
Fork 0
forked from Karylab-cklius/vllm
Code Pull Requests 2 Actions 1 Packages Activity
15,372 Commits 354 Branches 175 Tags
39602ebf8a6dbc6366b4e32e66211c5b8876a422
Commit Graph
250 Commits
Author SHA1 Message Date
khluu 39602ebf8a [Bugfix] Fix CPU Dockerfile path after cherry-pick 
Cherry-pick 7bd3f40dda (#39557) used the upstream requirements/test/
nested layout, but this branch still has the flat requirements/
layout (cpu-test.in not test/cpu.in). Revert the path rename while
keeping the torch==2.11.0 and sentence-transformers==5.3.0 fixes.

Signed-off-by: khluu <khluu000@gmail.com>
 2026-04-16 17:46:27 -07:00
Li, Jiangandkhluu 7bd3f40dda [CI/Build] Fix sentence-transformers version in CPU test (#39557) 
Signed-off-by: jiang1.li <jiang1.li@intel.com>
(cherry picked from commit eb92ba740a)

Signed-off-by: khluu <khluu000@gmail.com>
 2026-04-16 17:05:39 -07:00
Harry Mellorandkhluu 459d9b38d3 Update to transformers v5 (#30566) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: khluu <khluu000@gmail.com>
Signed-off-by: Kevin H. Luu <khluu000@gmail.com>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: khluu <khluu000@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: jiang1.li <jiang1.li@intel.com>
(cherry picked from commit 03f8d3a548)
 2026-04-16 15:47:49 -07:00
Andreas KaratzasandGitHub af89140efc [ROCm][CI] Fix UV install in Dockerfile.rocm to detect curl failures and retry (#38415) 
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
 2026-03-29 00:47:42 +08:00
Michael GoinandGitHub 2bf5b70ae8 [CI Bugfix] Pre-download missing FlashInfer headers in Docker build (#38391) 
Signed-off-by: mgoin <mgoin64@gmail.com>
 2026-03-28 06:09:00 -07:00
Gregory ShtrasbergandGitHub 731285c939 [ROCm][CI/Build] ROCm 7.2.1 release version; torch 2.10; triton 3.6 (#38252) 
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
 2026-03-27 18:03:12 -05:00
Andreas KaratzasandGitHub db01535e2b [ROCm][CI] Add uv pip compile workflow for rocm-test.txt lockfile (#37930) 
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
 2026-03-26 12:44:01 -05:00
Michael GoinandGitHub 0f0e03890e [UX] Add flashinfer-cubin as CUDA default dep (#37233) 
Signed-off-by: mgoin <mgoin64@gmail.com>
 2026-03-24 14:13:08 -07:00
amey asgaonkarandGitHub 0c1809c806 Add Ubuntu 24.04 support for Docker builds (#35386) 
Signed-off-by: aasgaonkar <aasgaonkar@nvidia.com>
 2026-03-24 13:34:44 -07:00
Li, JiangandGitHub 352b90c4a4 [Bugfix] Add replacement of _compute_slot_mapping_kernel on CPU (#37987) 
Signed-off-by: jiang1.li <jiang1.li@intel.com>
 2026-03-24 07:00:20 -07:00
Chaitanya Sri Krishna LollaGitHubTej Kiran
 		3982bc2cd0 [ROCm] Enable DeepEP ROCm as all2allbackend for AMD GPUs. (#34692) 
Signed-off-by: Tej Kiran <vpolamre@amd.com>
Co-authored-by: Tej Kiran <vpolamre@amd.com>
 2026-03-21 00:32:31 -07:00
sihao_liandGitHub 9dade5da3a [XPU]Unify xpu test dependencies in dockerfile.xpu (#36477) 
Signed-off-by: sihao.li <sihao.li@intel.com>
 2026-03-19 08:12:07 +08:00
Lalithnarayan CGitHubChinmay-Kulkarni-AMDTyler Michael SmithTyler Michael SmithClaude Sonnet 4.6
 		7acaea634c In-Tree AMD Zen CPU Backend via zentorch [1/N] (#35970) 
Signed-off-by: Lalithnarayan C <Lalithnarayan.C@amd.com>
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Chinmay-Kulkarni-AMD <Chinmay.Kulkarni@amd.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
 2026-03-15 23:35:35 +00:00
HariandGitHub a3e2e250f0 [Feature] Add Azure Blob Storage support for RunAI Model Streamer (#34614) 
Signed-off-by: hasethuraman <hsethuraman@microsoft.com>
 2026-03-15 19:38:21 +08:00
arloandGitHub 8c29042bb9 [Feature] Add InstantTensor weight loader (#36139) 2026-03-14 18:05:23 +01:00
Li, JiangGitHubgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 		092ace9e3a [UX] Improve UX of CPU backend (#36968) 
Signed-off-by: jiang1.li <jiang1.li@intel.com>
Signed-off-by: Li, Jiang <bigpyj64@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-03-14 09:27:29 +08:00
Ryan RockandGitHub a79c1c2c80 [AMD][Build] Add DeepEP to ROCm Dockerfile (#36086) 
Signed-off-by: Ryan Rock <ryan.rock@amd.com>
 2026-03-12 21:33:32 +00:00
Dimitrios BariamisGitHubDimitrios Bariamis
 		cc16b24b17 Update Flashinfer to 0.6.6 (#36768) 
Signed-off-by: Dimitrios Bariamis <12195802+dbari@users.noreply.github.com>
Co-authored-by: Dimitrios Bariamis <12195802+dbari@users.noreply.github.com>
 2026-03-12 13:19:19 -04:00
Amr MahdiandGitHub 12b38c0f45 [CI/Build] Allow mounting AWS credentials for sccache S3 auth (#35912) 
Signed-off-by: Amr Mahdi <amrmahdi@meta.com>
 2026-03-03 14:30:47 -08:00
liuzhenweiGitHubKunshang Ji
 		9dd656f0ea [XPU][NIXL] Add GPUDirect RDMA support for XPU (#35270) 
Signed-off-by: zhenwei-intel <zhenwei.liu@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
 2026-03-03 08:42:49 +08:00
Tyler Michael SmithGitHubClaude Opus 4.6
 		eb19955c37 [WideEP] Remove pplx all2all backend (#33724) 
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
 2026-02-26 14:30:10 -08:00
Kunshang JiandGitHub 5281713e11 [XPU] use fixed UMD version in dockerfile.xpu (#35392) 
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
 2026-02-26 18:54:55 +08:00
Seungmin KimGitHub88plugMichael Goin
 		160424a937 [Bugfix] Fix CUDA compatibility path setting for both datacenter and consumer NVIDIA GPUs (#33992) 
Signed-off-by: Seungmin Kim <8457324+ehfd@users.noreply.github.com>
Signed-off-by: Andrew Mello <19512127+88plug@users.noreply.github.com>
Co-authored-by: 88plug <19512127+88plug@users.noreply.github.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
 2026-02-25 18:15:51 -08:00
Andreas KaratzasandGitHub 067c5d9ad1 [ROCm][CI] Added MI325 mirrors (#34923) 
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
 2026-02-24 13:37:15 -08:00
Wei ZhaoGitHubCyrus Leung
 		ea5f903f80 Bump Flashinfer Version and Re-enable DeepSeek NVFP4 AR+Norm Fusion (#34899) 
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
 2026-02-20 13:37:31 -08:00
Maryam TahhanGitHubLi, Jiang <jiang1.li@intel.com>
 		f07a128413 [CPU][ARM] Add ARM BF16 cross-compilation support and improve documen… (#33079) 
Signed-off-by: Maryam Tahhan <mtahhan@redhat.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
 2026-02-15 06:33:08 -08:00
Douglas LehrGitHubDoug LehrGregory Shtrasbergtjtanaavllm
 		8a798be929 [ROCm] Enable MXFP4 MoE weight pre-shuffling on gfx950 and update aiter (#34192) 
Signed-off-by: Doug Lehr <douglehr@amd.com>
Co-authored-by: Doug Lehr <douglehr@amd.com>
Co-authored-by: Gregory Shtrasberg <156009573+gshtras@users.noreply.github.com>
Co-authored-by: tjtanaavllm <tunjian.tan@amd.com>
 2026-02-12 05:06:33 -08:00
Kunshang JiandGitHub cb9574eb85 [XPU][9/N] clean up existing ipex code/doc (#34111) 
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
 2026-02-11 00:27:15 -08:00
Hongxia YangandGitHub 4d39650961 [ROCm] update triton branch to support gpt-oss models for gfx11xx devices (#34032) 
Signed-off-by: Hongxia Yang <hongxia.yang@amd.com>
 2026-02-09 19:36:30 +00:00
zifeitongGitHubWentao Ye
 		52181baaea Update DeepGEMM version pin in Dockerfile to match #32479 (#33935) 
Signed-off-by: Zifei Tong <zifeitong@gmail.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
 2026-02-07 05:30:22 -08:00
Dimitrios BariamisGitHubDimitrios Bariamismgoin
 		207c3a0c20 Fix RoutingMethodType logic (#33919) 
Signed-off-by: Dimitrios Bariamis <12195802+dbari@users.noreply.github.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Dimitrios Bariamis <12195802+dbari@users.noreply.github.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
 2026-02-06 14:03:34 -08:00
sihao_liandGitHub 6550815c3a [XPU]Replace pip in docker.xpu with uv pip (#31112) 
Signed-off-by: sihao.li <sihao.li@intel.com>
 2026-02-06 14:02:33 +08:00
kourosh hakhamaneshiandGitHub 2f6d17cb2f [rocm][ray] Fix: Unify Ray device visibility handling across CUDA and ROCm (#33308) 
Signed-off-by: Kourosh Hakhamaneshi <kourosh@anyscale.com>
 2026-02-04 10:09:14 -08:00
Kunshang JiandGitHub e10604480b [XPU][1/N] Deprecate ipex and switch to vllm-xpu-kernels for xpu platform (#33379) 
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
 2026-02-02 22:46:10 -08:00
杨朱 · KikiGitHubClaude Opus 4.5
 		a0a984ac2e [CI/Build] Remove hardcoded America/Los_Angeles timezone from Dockerfiles (#33553) 
Signed-off-by: carlory <baofa.fan@daocloud.io>
Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
 2026-02-02 22:32:39 -08:00
R3hankhanandGitHub ab374786c7 [CPU][IBM Z][Dockerfile] Fix IBM Z builds (#33243) 
Signed-off-by: Rehan Khan <Rehan.Khan7@ibm.com>
 2026-02-01 23:41:29 -08:00
Dimitrios BariamisGitHubDimitrios BariamisCyrus Leung
 		f0bca83ee4 Add support for Mistral Large 3 inference with Flashinfer MoE (#33174) 
Signed-off-by: Dimitrios Bariamis <12195802+dbari@users.noreply.github.com>
Co-authored-by: Dimitrios Bariamis <12195802+dbari@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
 2026-01-30 22:48:27 -08:00
Pengchao WangGitHubYe Qi
 		2515bbd027 [CI/Build][BugFix] fix cuda/compat loading order issue in docker build (#33116) 
Signed-off-by: Pengchao Wang <wpc@fb.com>
Co-authored-by: Ye (Charlotte) Qi <yeq@meta.com>
 2026-01-29 00:19:05 -08:00
TJianandGitHub f9d03599ef [Release] [CI] Optim release pipeline (#33156) 
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
 2026-01-28 22:45:42 -08:00
Xinan MiaoGitHubSouthWest7
 		604e3b87e8 [Feature]: Container image WORKDIR consistency (#33159) 
Signed-off-by: SouthWest7 <am1ao@qq.com>
Co-authored-by: SouthWest7 <am1ao@qq.com>
 2026-01-28 11:06:48 +08:00
Maryam TahhanGitHubLi, Jiang <jiang1.li@intel.com>
 		203d0bc0c2 [CPU] Improve CPU Docker build (#30953) 
Signed-off-by: Maryam Tahhan <mtahhan@redhat.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
 2026-01-24 17:08:24 +00:00
Orion Reblitz-RichardsonGitHubKevin H. Luu
 		68b0a6c1ba [CI][torch nightlies] Use main Dockerfile with flags for nightly torch tests (#30443) 
Signed-off-by: Orion Reblitz-Richardson <orionr@meta.com>
Signed-off-by: Orion Reblitz-Richardson <orionr@gmail.com>
Co-authored-by: Kevin H. Luu <khluu000@gmail.com>
 2026-01-23 10:22:56 -08:00
Fadi ArafehGitHubLi, Jiang <jiang1.li@intel.com>
 		10e94c84f6 [CPU][Feat] Update PyTorch to v2.10 for CPU Backend (#32869) 
Signed-off-by: Fadi Arafeh <fadi.arafeh@arm.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
 2026-01-23 21:13:06 +08:00
elvischenvandGitHub 808d6fd7b9 Bump Flashinfer to v0.6.1 (#30993) 
Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
 2026-01-21 08:49:50 -08:00
qli88andGitHub a0490be8f1 [CI][amd] Revert NIXL connector change to avoid crash (#32570) 
Signed-off-by: Qiang Li <qiang.li2@amd.com>
Signed-off-by: Matthew Wong <Matthew.Wong2@amd.com>
 2026-01-19 18:39:16 +00:00
Mritunjay Kumar SharmaandGitHub 9e078d0582 [CI/Build][Docker] Add centralized version manifest for Docker builds (#31492) 
Signed-off-by: Mritunjay Sharma <mritunjay.sharma@chainguard.dev>
 2026-01-17 13:45:30 +00:00
TJianandGitHub 41c544f78a [ROCm] [CI] [Release] Rocm wheel pipeline with sccache (#32264) 
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
 2026-01-16 02:56:18 +08:00
smit kadvaniGitHubSmit Shaileshbhai KadvaniLu Fang
 		74e4bb1c5a fixing podman build issue (#32131) 
Signed-off-by: Smit Kadvani <smit.kadvani@gmail.com>
Co-authored-by: Smit Shaileshbhai Kadvani <kadvani@meta.com>
Co-authored-by: Lu Fang <30275821+houseroad@users.noreply.github.com>
 2026-01-15 11:07:08 -06:00
Douglas LehrGitHubDoug Lehr
 		c5891b5430 [ROCM] Add ROCm image build to release pipeline (#31995) 
Signed-off-by: Doug Lehr <douglehr@amd.com>
Co-authored-by: Doug Lehr <douglehr@amd.com>
 2026-01-15 19:01:40 +08:00
qli88andGitHub 3a612322eb [CI] Move rixl/ucx from Dockerfile.rocm_base to Dockerfile.rocm (#32295) 
Signed-off-by: Qiang Li <qiang.li2@amd.com>
 2026-01-14 16:53:36 +00:00