Martin HickeyandGitHub f7fc0ca993 [Frontend] Add endpoint plugins framework (#47454) ...

Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com>

2026-07-08 10:00:41 +08:00

..

arch_overview.md

[Misc] Move the legacy api_server.py to the examples directory. (#46783)

2026-06-26 07:43:29 +00:00

attention_backends.md

[ROCm][CI] Refresh ROCm base images when docker rocm_base changes (#46904)

2026-07-07 03:10:50 -07:00

cuda_graphs_multimodal.md

[MM][CG] Gemma3 Encoder CUDA Graph (#43591)

2026-06-29 04:52:00 +00:00

cuda_graphs.md

[Doc] Fix typos, grammar, and broken commands across docs (#46398)

2026-06-23 02:01:22 +00:00

custom_op.md

[MoE] Move various experts classes to fused_moe/experts/ (#41979)

2026-05-11 07:54:33 +08:00

dbo.md

[MoE Refactor] Create MK for TRTLLM Kernels (#32564)

2026-03-03 10:39:50 -08:00

debug_vllm_compile.md

[vLLM IR] 2/N fused_add_rms_norm and maybe_inplace overload (#36823)

2026-05-01 23:41:15 -04:00

endpoint_plugins.md

[Frontend] Add endpoint plugins framework (#47454)

2026-07-08 10:00:41 +08:00

fused_moe_modular_kernel.md

[Feature]: Remove Chunking From FusedMoE (#34086)

2026-03-12 14:24:38 -04:00

fusions.md

[ROCm][MLA] Fuse MLA q/kv RMSNorm + FP8 per-token quant in the FP8 attention path (#44977)

2026-07-02 13:00:41 +08:00

huggingface_integration.md

[Frontend] Rework fastokens integration (#43168)

2026-05-21 15:36:58 -07:00

hybrid_kv_cache_manager.md

Chore: Fix minor doc sentence, grammar, quote errors (#40469)

2026-06-24 18:58:24 +00:00

io_processor_plugins.md

add io_process_plugin for sparse embedding (#34214)

2026-02-28 09:16:37 +00:00

logits_processors.md

[Bugfix][CI] fix typos (#34934)

2026-03-05 17:05:46 +00:00

lora_resolver_plugins.md

[Docs] Update server entrypoint examples (#42077)

2026-05-09 02:03:52 +00:00

metrics.md

[Doc] Fix typos, grammar, and broken commands across docs (#46398)

2026-06-23 02:01:22 +00:00

mm_processing.md

[1/N] Reorganize multimodal processing code (#32327)

2026-01-14 15:25:31 +00:00

model_runner_v2.md

[Hardware] Replace torch.cuda.synchronize() api with torch.accelerator.synchronize (#36085)

2026-03-05 10:36:39 +00:00

moe_kernel_features.md

Fix docs on main (#47009)

2026-06-29 15:50:57 +08:00

multiprocessing.md

[Docs] Update design/multiprocessing.md (#30677)

2026-03-04 17:58:59 +00:00

nixl_kv_cache_lease.md

[NixlConnector] Initiate deprecation cycle for kv_both role (#43874)

2026-06-05 11:08:17 +02:00

nixl_kv_push_connector.md

[KV Connector]: Support KV push from Prefill to Decode node using Nixl KV Connector (#35264)

2026-06-12 10:38:41 +00:00

optimization_levels.md

[Docs] Update server entrypoint examples (#42077)

2026-05-09 02:03:52 +00:00

paged_attention.md

Chore: Fix minor doc sentence, grammar, quote errors (#40469)

2026-06-24 18:58:24 +00:00

plugin_system.md

[Frontend] Add endpoint plugins framework (#47454)

2026-07-08 10:00:41 +08:00

prefix_caching.md

[Doc] Fix typos, grammar, and broken commands across docs (#46398)

2026-06-23 02:01:22 +00:00

torch_compile_multimodal.md

[Doc] Fix multimodal torch.compile troubleshooting to not use removed VLLM_TORCH_COMPILE_LEVEL (#44378)

2026-06-07 00:34:07 -07:00

torch_compile.md

[Frontend] Remap -O to -cc commandline flag (#29557)

2025-11-28 21:51:12 +00:00

vllm_ir.md

[vLLM IR] 2/N fused_add_rms_norm and maybe_inplace overload (#36823)

2026-05-01 23:41:15 -04:00