karylab_agents/vllm

forked from Karylab-cklius/vllm

Files

T

History

Shengqi ChenandCodex a32d1bff95 [Doc] Document CUDA wheel architecture coverage

Explain that pre-built CUDA wheels use the architecture lists selected by the release and build pipelines, which may be narrower than the full set vLLM can build from source.

Call out CUDA 12.9 architecture-specific wheel coverage, CUDA 13 family-specific targets, and the no-kernel-image error users may see when a wheel does not cover their GPU.

Co-authored-by: Codex <codex@openai.com>

Signed-off-by: Shengqi Chen <harry-chen@outlook.com>

2026-06-30 19:27:42 +08:00

..

.nav.yml

Docs update tpu install instructions (#27824 )

2025-10-31 10:29:55 -07:00

cpu.apple.inc.md

[CPU] Fix macOS/Apple Silicon hang by enabling OpenMP in the build (#46769 )

2026-06-26 14:32:21 -04:00

cpu.arm.inc.md

[Doc] Fix uv dependency resolution failure for setuptools during CPU source builds (x86 & ARM) (#45412 )

2026-06-13 06:18:58 +00:00

cpu.md

[ZenCPU] Add zencpu Platform Runtime Logging and Docs (#42726 )

2026-06-16 08:23:12 -04:00

cpu.s390x.inc.md

[CPU][IBM Z][Dockefile][Docs] Fix s390x builds for torch 2.11 and update docs for s390x (#39910 )

2026-04-15 22:26:21 -07:00

cpu.x86.inc.md

[ZenCPU] Add zencpu Platform Runtime Logging and Docs (#42726 )

2026-06-16 08:23:12 -04:00

device.template.md

Migrate docs from Sphinx to MkDocs (#18145 )

2025-05-23 02:09:53 -07:00

gpu.apple.inc.md

[Docs] Reorganize online serving docs. (#41907 )

2026-05-19 14:43:18 +08:00

gpu.cuda.inc.md

[Doc] Document CUDA wheel architecture coverage

2026-06-30 19:27:42 +08:00

gpu.md

[Docs] Add Apple Silicon documentation for vLLM-Metal GPU support (#41987 )

2026-05-11 11:34:25 -07:00

gpu.rocm.inc.md

[ROCm][Doc] Add installation notes about python version requirement (#45671 )

2026-06-15 17:22:55 +08:00

gpu.xpu.inc.md

[xpu] bump up vllm-xpu-kernels v0.1.10 and upgrade 2618 umd (#40367 )

2026-06-19 15:37:20 +08:00

python_env_setup.inc.md

Allow markdownlint to run locally (#36398 )

2026-03-08 20:05:24 -07:00

README.md

[Docs] Add Apple Silicon documentation for vLLM-Metal GPU support (#41987 )

2026-05-11 11:34:25 -07:00

README.md

Installation

vLLM supports the following hardware platforms:

GPU
- NVIDIA CUDA
- AMD ROCm
- Intel XPU
- Apple Silicon (via vLLM-Metal)
CPU

Hardware Plugins

vLLM supports third-party hardware plugins that live outside the main vllm repository. These follow the Hardware-Pluggable RFC.

A list of all supported hardware can be found on the vLLM website, see Universal Compatibility - Hardware.

If you want to add new hardware, please contact us on Slack or Email.