Cursor AgentandSimon Mo 89f6318db2 docs: Add Usage Stats V2 PRD and initial design sketch (VLLM-94) ...

- Add comprehensive PRD with current state analysis, gaps, competitive research
- Add design sketch with architecture, component design, code sketches
- Document hardware topology, model metadata, anonymized workload requirements
- Update usage_stats.md with links to V2 design docs

Co-authored-by: Simon Mo <simon@inferact.ai>

2026-03-08 18:22:01 +00:00

..

arch_overview.md

[Doc] Fix GPU Worker count in Process Count Summary (#36000)

2026-03-04 17:03:14 +00:00

attention_backends.md

[Perf] Support FP8 KV cache for Flashinfer MLA Sparse (#35891)

2026-03-07 13:51:54 -08:00

cuda_graphs.md

[Bugfix][CI] fix typos (#34934)

2026-03-05 17:05:46 +00:00

custom_op.md

[PluggableLayer][MM] Add PluggableLayer for RelPosAttention (#33753)

2026-03-03 19:41:27 -08:00

dbo.md

[MoE Refactor] Create MK for TRTLLM Kernels (#32564)

2026-03-03 10:39:50 -08:00

debug_vllm_compile.md

[torch.compile] Document the workaround to standalone_compile failing (#33571)

2026-02-03 07:16:55 +00:00

fused_moe_modular_kernel.md

[Bugfix][CI] fix typos (#34934)

2026-03-05 17:05:46 +00:00

fusions.md

[docs][torch.compile] Add fusions.md — kernel/operator fusion reference page (#35538)

2026-03-06 23:55:06 +00:00

huggingface_integration.md

[Misc] Update TokenizerLike interface and move get_cached_tokenizer (#29730)

2025-11-30 14:59:47 +08:00

hybrid_kv_cache_manager.md

[doc] Hybrid KV Cache Manager design doc (#22688)

2025-08-26 20:19:05 +00:00

io_processor_plugins.md

add io_process_plugin for sparse embedding (#34214)

2026-02-28 09:16:37 +00:00

logits_processors.md

[Bugfix][CI] fix typos (#34934)

2026-03-05 17:05:46 +00:00

lora_resolver_plugins.md

[Misc] HF Hub LoRA Resolver (#20320)

2026-01-26 13:56:32 +00:00

metrics.md

[V0 Deprecation] Remove unused swap_space parameter (#36216)

2026-03-07 22:09:55 +08:00

mm_processing.md

[1/N] Reorganize multimodal processing code (#32327)

2026-01-14 15:25:31 +00:00

model_runner_v2.md

[Hardware] Replace torch.cuda.synchronize() api with torch.accelerator.synchronize (#36085)

2026-03-05 10:36:39 +00:00

moe_kernel_features.md

[MoE Refactor] Create MK for TRTLLM Kernels (#32564)

2026-03-03 10:39:50 -08:00

multiprocessing.md

[Docs] Update design/multiprocessing.md (#30677)

2026-03-04 17:58:59 +00:00

optimization_levels.md

[docs][torch.compile] Add fusions.md — kernel/operator fusion reference page (#35538)

2026-03-06 23:55:06 +00:00

p2p_nccl_connector.md

[V0 Deprecation] Remove VLLM_USE_V1 from docs and scripts (#26336)

2025-10-07 16:46:44 +08:00

paged_attention.md

[doc] fix broken links (#32158)

2026-01-12 10:18:38 +00:00

plugin_system.md

[Bugfix][CI] fix typos (#34934)

2026-03-05 17:05:46 +00:00

prefix_caching.md

docs: prefix caching seems quite outdated (#28784)

2026-01-19 11:49:52 -08:00

torch_compile_multimodal.md

[Documentation] Fix typo in docs/design/torch_compile_multimodal.md (#32741)

2026-01-20 23:54:20 -08:00

torch_compile.md

[Frontend] Remap -O to -cc commandline flag (#29557)

2025-11-28 21:51:12 +00:00

usage_stats_v2_design.md

docs: Add Usage Stats V2 PRD and initial design sketch (VLLM-94)

2026-03-08 18:22:01 +00:00

usage_stats_v2_prd.md

docs: Add Usage Stats V2 PRD and initial design sketch (VLLM-94)

2026-03-08 18:22:01 +00:00