Files

T

History

Signed-off-by: zixi-qi <zixi@inferact.ai>
Co-authored-by: Nick Hill <nickhill123@gmail.com>

2026-07-08 16:49:23 -07:00

disagg_proxy_demo.py

2026-05-06 01:20:38 -07:00

disagg_proxy_multiturn.py

2026-06-09 19:41:56 -07:00

disagg_proxy_pushconnector_demo.py

2026-07-08 16:49:23 -07:00

kv_events.sh

2026-05-06 01:20:38 -07:00

moriio_toy_proxy_server.py

2026-07-01 19:17:05 +00:00

README.md

2026-05-06 01:20:38 -07:00

Disaggregated Serving

This example contains scripts that demonstrate the disaggregated serving features of vLLM.

Files

disagg_proxy_demo.py - Demonstrates XpYd (X prefill instances, Y decode instances).
kv_events.sh - Demonstrates KV cache event publishing.
mooncake_connector - A proxy demo for MooncakeConnector.