3 people 27e0057aed [Spec Decode] Add Gemma4 MTP speculative decoding support (#41745) ...

Signed-off-by: Luciano Martins <lucianommartins@users.noreply.github.com>
Co-authored-by: Luciano Martins <lucianommartins@users.noreply.github.com>

2026-05-06 22:39:29 +08:00

..

__init__.py

[Audio] Bundle get_generation_prompt() params into SpeechToTextParams (#36268)

2026-04-22 12:24:18 +08:00

attention.py

[Attention] Abstract the MLA prefill backends and eliminate cuDNN (#32623)

2026-05-01 13:36:20 -04:00

cache.py

[Feat] DeepSeek V4 Rebased (#40860)

2026-04-26 18:31:08 -07:00

compilation.py

[Feat] DeepSeek V4 Rebased (#40860)

2026-04-26 18:31:08 -07:00

device.py

[Mypy] Better fixes for the mypy issues in vllm/config (#37902)

2026-03-25 06:14:43 -07:00

ec_transfer.py

[Misc] Introduce ec_both role EC (encoder cache) connector (#34182)

2026-02-10 18:55:35 +00:00

kernel.py

[New Model][ROCm] Add AMD support for DeepSeek V4 (#40871)

2026-05-05 08:55:37 -07:00

kv_events.py

[Mypy] Better fixes for the mypy issues in vllm/config (#37902)

2026-03-25 06:14:43 -07:00

kv_transfer.py

[Misc] Set default kv_buffer_device in a better way (#36862)

2026-03-13 19:07:33 +00:00

load.py

Remove need for explicit \n in docstring lists for --help formatting (#38350)

2026-03-27 08:38:00 -07:00

lora.py

[LoRA] Support dual CUDA streams-Linear Layer (#35721)

2026-04-13 10:57:07 +08:00

mamba.py

[Mamba] Flashinfer selective_state_update (#36162)

2026-04-14 15:10:58 -04:00

model_arch.py

[Misc] use model arch converter for bidi models identification (#40701)

2026-04-23 13:42:52 +00:00

model.py

[Model] Add MiMo-V2.5 support (#40967)

2026-04-27 13:26:51 +00:00

multimodal.py

[Perf] FP8 FlashInfer Attn for ViT (#38065)

2026-04-27 13:44:15 +08:00

observability.py

[Bugfix][CI] fix typos (#34934)

2026-03-05 17:05:46 +00:00

offload.py

[offloader] v2: Hide weight onloading latency via prefetching (#29941)

2026-02-25 17:20:59 -08:00

parallel.py

[Bug] Fix status update address for non-MOE model within external dp mode (#40839)

2026-05-04 16:37:16 -07:00

pooler.py

feat: rename logit_bias/logit_scale to logit_mean/logit_sigma for affine score calibration (#39530)

2026-04-13 04:43:44 +00:00

profiler.py

Remove need for explicit \n in docstring lists for --help formatting (#38350)

2026-03-27 08:38:00 -07:00

quantization.py

mxfp8 online quant move to new frontend (#40152)

2026-04-20 06:26:12 -07:00

reasoning.py

[Feature] Add auto-detection for reasoning_config when only reasoning_parser is set (#38214)

2026-04-10 01:36:26 +00:00

scheduler.py

[Refactor] Clean up log once scope="local" (#40540)

2026-04-22 16:42:43 -04:00

speculative.py

[Spec Decode] Add Gemma4 MTP speculative decoding support (#41745)

2026-05-06 22:39:29 +08:00

speech_to_text.py

support hotwords for FunASR model (#39674)

2026-04-22 02:25:06 -07:00

structured_outputs.py

Remove unused disable_fallback field (#36546)

2026-03-09 20:56:54 -07:00

utils.py

Remove need for explicit \n in docstring lists for --help formatting (#38350)

2026-03-27 08:38:00 -07:00

vllm.py

[Bug] Fix tests/compile/test_config.py AttributeError: 'NoneType' object has no attribute 'dtype' (#41288)

2026-05-05 00:22:07 +08:00

weight_transfer.py

[Feat][RL][2/2] Native Weight Syncing API: IPC (#34171)

2026-02-27 13:45:21 -07:00