karylab_agents/vllm

Fork 0

forked from Karylab-cklius/vllm

Files

T

History

dd0d74cd92 [Doc] Surface the --kv-cache-memory suggestion at INFO and document fast-startup knobs (#47374 )

Signed-off-by: Nils Matteson <nils@thaw.sh>
Signed-off-by: Nils Matteson <nilsmatteson@icloud.com>
Co-authored-by: Nils Matteson <nils@thaw.sh>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>

2026-07-07 15:05:07 -07:00

conserving_memory.md

[Examples] Resettle features examples. (#40995 )

2026-04-28 00:33:41 -07:00

engine_args.md

[Docs] Reorganize online serving docs. (#41907 )

2026-05-19 14:43:18 +08:00

env_vars.md

[Docs] Take env var definition out of folded admonition (#29005 )

2025-11-19 03:32:04 -08:00

model_resolution.md

[Misc] unify variable for LLM instance (#20996 )

2025-07-21 12:18:33 +01:00

optimization.md

[Doc] Surface the --kv-cache-memory suggestion at INFO and document fast-startup knobs (#47374 )

2026-07-07 15:05:07 -07:00

README.md

[Docs] Reorganize online serving docs. (#41907 )

2026-05-19 14:43:18 +08:00

serve_args.md

[Doc] Fix failing doc build (#28772 )

2025-11-15 05:33:27 -08:00

README.md

Configuration Options

This section lists the most common options for running vLLM.

There are three main levels of configuration, from highest priority to lowest priority: