Files

T

History

Signed-off-by: simondanielsson <simon.danielsson99@hotmail.com>
Co-authored-by: Matvei Pashkovskii <mpashkov@amd.com>

2026-04-23 08:06:31 +09:00

2026-02-17 12:22:56 +00:00

disagg_proxy_demo.py

2026-02-17 10:06:53 +00:00

example_mm_serve.py

2026-04-17 20:31:56 -07:00

kv_events.sh

2026-02-17 12:22:56 +00:00

moriio_toy_proxy_server.py

2026-04-23 08:06:31 +09:00

README.md

2026-02-03 08:08:25 -08:00

Disaggregated Serving

This example contains scripts that demonstrate the disaggregated serving features of vLLM.

Files

disagg_proxy_demo.py - Demonstrates XpYd (X prefill instances, Y decode instances).
kv_events.sh - Demonstrates KV cache event publishing.
mooncake_connector - A proxy demo for MooncakeConnector.