karylab_agents/vllm

forked from Karylab-cklius/vllm

Files

T

History

257af77bc2 [Docs] Reorganize online serving docs. (#41907 )

Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

2026-05-19 14:43:18 +08:00

..

.nav.yml

Docs update tpu install instructions (#27824 )

2025-10-31 10:29:55 -07:00

cpu.apple.inc.md

Allow markdownlint to run locally (#36398 )

2026-03-08 20:05:24 -07:00

cpu.arm.inc.md

Add structure to requirements/ directory (#39024 )

2026-04-10 13:46:41 -07:00

cpu.md

[Examples][1/n] Resettle basic examples. (#35579 )

2026-03-08 20:22:53 -07:00

cpu.s390x.inc.md

[CPU][IBM Z][Dockefile][Docs] Fix s390x builds for torch 2.11 and update docs for s390x (#39910 )

2026-04-15 22:26:21 -07:00

cpu.x86.inc.md

Add structure to requirements/ directory (#39024 )

2026-04-10 13:46:41 -07:00

device.template.md

Migrate docs from Sphinx to MkDocs (#18145 )

2025-05-23 02:09:53 -07:00

gpu.apple.inc.md

[Docs] Reorganize online serving docs. (#41907 )

2026-05-19 14:43:18 +08:00

gpu.cuda.inc.md

[Build] Bump CUDA to 13.0.2 to match PyTorch 2.11.0 (#40669 )

2026-04-24 10:27:11 +00:00

gpu.md

[Docs] Add Apple Silicon documentation for vLLM-Metal GPU support (#41987 )

2026-05-11 11:34:25 -07:00

gpu.rocm.inc.md

Update to transformers v5 (#30566 )

2026-04-15 16:29:15 -07:00

gpu.xpu.inc.md

[Examples][last/6] Resettle examples. (#41084 )

2026-05-07 19:42:12 -07:00

python_env_setup.inc.md

Allow markdownlint to run locally (#36398 )

2026-03-08 20:05:24 -07:00

README.md

[Docs] Add Apple Silicon documentation for vLLM-Metal GPU support (#41987 )

2026-05-11 11:34:25 -07:00

README.md

Installation

vLLM supports the following hardware platforms:

GPU
- NVIDIA CUDA
- AMD ROCm
- Intel XPU
- Apple Silicon (via vLLM-Metal)
CPU

Hardware Plugins

vLLM supports third-party hardware plugins that live outside the main vllm repository. These follow the Hardware-Pluggable RFC.

A list of all supported hardware can be found on the vLLM website, see Universal Compatibility - Hardware.

If you want to add new hardware, please contact us on Slack or Email.