sychen52andGitHub 947138b6c2 Add nvfp4 kv cache support (#40177) ...

Signed-off-by: Shiyang Chen <shiychen@nvidia.com>

2026-05-01 04:55:16 +00:00

..

__init__.py

[Audio] Bundle get_generation_prompt() params into SpeechToTextParams (#36268)

2026-04-22 12:24:18 +08:00

attention.py

[Attention][Spec Decode] Allow independent drafter attention backend selection (#39930)

2026-04-27 19:38:09 -07:00

cache.py

[Feat] DeepSeek V4 Rebased (#40860)

2026-04-26 18:31:08 -07:00

compilation.py

[Feat] DeepSeek V4 Rebased (#40860)

2026-04-26 18:31:08 -07:00

device.py

[Mypy] Better fixes for the mypy issues in vllm/config (#37902)

2026-03-25 06:14:43 -07:00

ec_transfer.py

[Misc] Introduce ec_both role EC (encoder cache) connector (#34182)

2026-02-10 18:55:35 +00:00

kernel.py

[Feat] DeepSeek V4 Rebased (#40860)

2026-04-26 18:31:08 -07:00

kv_events.py

[Mypy] Better fixes for the mypy issues in vllm/config (#37902)

2026-03-25 06:14:43 -07:00

kv_transfer.py

[Misc] Set default kv_buffer_device in a better way (#36862)

2026-03-13 19:07:33 +00:00

load.py

Remove need for explicit \n in docstring lists for --help formatting (#38350)

2026-03-27 08:38:00 -07:00

lora.py

[LoRA] Support dual CUDA streams-Linear Layer (#35721)

2026-04-13 10:57:07 +08:00

mamba.py

[Mamba] Flashinfer selective_state_update (#36162)

2026-04-14 15:10:58 -04:00

model_arch.py

[Misc] use model arch converter for bidi models identification (#40701)

2026-04-23 13:42:52 +00:00

model.py

[Model] Add MiMo-V2.5 support (#40967)

2026-04-27 13:26:51 +00:00

multimodal.py

[Perf] FP8 FlashInfer Attn for ViT (#38065)

2026-04-27 13:44:15 +08:00

observability.py

[Bugfix][CI] fix typos (#34934)

2026-03-05 17:05:46 +00:00

offload.py

[offloader] v2: Hide weight onloading latency via prefetching (#29941)

2026-02-25 17:20:59 -08:00

parallel.py

[BUG] Two phase pause to prevent deadlock (#39366)

2026-04-29 17:51:03 -04:00

pooler.py

feat: rename logit_bias/logit_scale to logit_mean/logit_sigma for affine score calibration (#39530)

2026-04-13 04:43:44 +00:00

profiler.py

Remove need for explicit \n in docstring lists for --help formatting (#38350)

2026-03-27 08:38:00 -07:00

quantization.py

mxfp8 online quant move to new frontend (#40152)

2026-04-20 06:26:12 -07:00

reasoning.py

[Feature] Add auto-detection for reasoning_config when only reasoning_parser is set (#38214)

2026-04-10 01:36:26 +00:00

scheduler.py

[Refactor] Clean up log once scope="local" (#40540)

2026-04-22 16:42:43 -04:00

speculative.py

[Model] update for mimo v25 (#41029)

2026-04-27 21:52:54 -07:00

speech_to_text.py

support hotwords for FunASR model (#39674)

2026-04-22 02:25:06 -07:00

structured_outputs.py

Remove unused disable_fallback field (#36546)

2026-03-09 20:56:54 -07:00

utils.py

Remove need for explicit \n in docstring lists for --help formatting (#38350)

2026-03-27 08:38:00 -07:00

vllm.py

Add nvfp4 kv cache support (#40177)

2026-05-01 04:55:16 +00:00

weight_transfer.py

[Feat][RL][2/2] Native Weight Syncing API: IPC (#34171)

2026-02-27 13:45:21 -07:00