karylab_agents/vllm

Fork 0

forked from Karylab-cklius/vllm

Files

T

History

f2ace1d57d [Frontend][RFC] Rust front-end integration (#40848 )

Signed-off-by: Nick Hill <nickhill123@gmail.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Bugen Zhao <i@bugenzhao.com>

2026-05-21 12:24:48 +08:00

.nav.yml

Docs update tpu install instructions (#27824 )

2025-10-31 10:29:55 -07:00

cpu.apple.inc.md

Allow markdownlint to run locally (#36398 )

2026-03-08 20:05:24 -07:00

cpu.arm.inc.md

[CPU][DOC] Fix installation commands for Arm CPUs (#43115 )

2026-05-19 23:31:15 +00:00

cpu.md

[Examples][1/n] Resettle basic examples. (#35579 )

2026-03-08 20:22:53 -07:00

cpu.s390x.inc.md

[CPU][IBM Z][Dockefile][Docs] Fix s390x builds for torch 2.11 and update docs for s390x (#39910 )

2026-04-15 22:26:21 -07:00

cpu.x86.inc.md

Add structure to requirements/ directory (#39024 )

2026-04-10 13:46:41 -07:00

device.template.md

Migrate docs from Sphinx to MkDocs (#18145 )

2025-05-23 02:09:53 -07:00

gpu.apple.inc.md

[Docs] Reorganize online serving docs. (#41907 )

2026-05-19 14:43:18 +08:00

gpu.cuda.inc.md

[Frontend][RFC] Rust front-end integration (#40848 )

2026-05-21 12:24:48 +08:00

gpu.md

[Docs] Add Apple Silicon documentation for vLLM-Metal GPU support (#41987 )

2026-05-11 11:34:25 -07:00

gpu.rocm.inc.md

Update to transformers v5 (#30566 )

2026-04-15 16:29:15 -07:00

gpu.xpu.inc.md

[Examples][last/6] Resettle examples. (#41084 )

2026-05-07 19:42:12 -07:00

python_env_setup.inc.md

Allow markdownlint to run locally (#36398 )

2026-03-08 20:05:24 -07:00

README.md

[Docs] Add Apple Silicon documentation for vLLM-Metal GPU support (#41987 )

2026-05-11 11:34:25 -07:00

README.md

Installation

vLLM supports the following hardware platforms:

GPU
- NVIDIA CUDA
- AMD ROCm
- Intel XPU
- Apple Silicon (via vLLM-Metal)
CPU

Hardware Plugins

vLLM supports third-party hardware plugins that live outside the main vllm repository. These follow the Hardware-Pluggable RFC.

A list of all supported hardware can be found on the vLLM website, see Universal Compatibility - Hardware.

If you want to add new hardware, please contact us on Slack or Email.