4 people 19bee6d12d [Performance][DP/EP] Add silu_mul_per_token_group_quant_fp8_colmajor kernel (#29470) ...

Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>

2025-12-03 18:04:59 +00:00

..

basic_correctness

[Bugfix][sleepmode][fp8 kv cache]: Fix FP8 KV cache + sleep(level=2) gibberish output (#28783)

2025-11-30 14:24:25 +08:00

benchmarks

Fix boolean nested params, add dict format support, and enhance plotting for vllm bench sweep (#29025)

2025-12-02 20:40:56 +00:00

compile

[Core] Rename PassConfig flags as per RFC #27995 (#29646)

2025-12-03 03:38:55 +00:00

config

[torch.compile] caching of config fields should be opt-out by default (#26468)

2025-11-19 06:13:54 -08:00

cuda

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

detokenizer

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

distributed

[Core] Rename PassConfig flags as per RFC #27995 (#29646)

2025-12-03 03:38:55 +00:00

engine

[Frontend] Remap -O to -cc commandline flag (#29557)

2025-11-28 21:51:12 +00:00

entrypoints

[Refactor] [1/N] to simplify the vLLM serving architecture (#28040)

2025-12-03 01:26:39 -08:00

evals

Add output token counting to gsm8k eval (#28594)

2025-11-14 09:32:03 +00:00

kernels

[Performance][DP/EP] Add silu_mul_per_token_group_quant_fp8_colmajor kernel (#29470)

2025-12-03 18:04:59 +00:00

kv_transfer

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

lora

Remove default values from InitVars so that they're not stored (#29859)

2025-12-02 12:16:37 +00:00

model_executor

[Frontend][torch.compile] CompilationConfig Overhaul (#20283): Set up -O infrastructure (#26847)

2025-11-27 01:55:58 -08:00

models

[Bugfix][Quantization] Support BF16 tensors on GGUF (#29948)

2025-12-03 10:33:46 +00:00

multimodal

[Bugfix] Missing cached item in the MultiModalReceiverCache (#28525)

2025-12-01 10:18:07 -08:00

plugins

[Frontend] Resettle pooling entrypoints (#29634)

2025-12-01 15:30:43 +08:00

plugins_tests

[Frontend] Resettle pooling entrypoints (#29634)

2025-12-01 15:30:43 +08:00

prompts

[BugFix] Fix input positions for long context with sliding window (#2088)

2023-12-13 12:28:13 -08:00

quantization

[Bugfix] Make compressed-tensors MoEs respect ignored layers (#28878)

2025-11-26 21:35:13 -05:00

reasoning

[Misc] Refactor tokenizer interface (#29693)

2025-11-29 04:02:21 -08:00

rocm/aiter

[Bugfix] [ROCm] [AITER]: Fix aiter block quant not compatible with torch compile dynamo (#28716)

2025-11-14 10:30:50 -08:00

samplers

[Core] Switch Flat logprob control from environment variable to SamplingParams (#28914)

2025-11-19 02:10:02 +00:00

standalone_tests

[CI/Build] Move pre-commit only scripts to tools/pre_commit (#27657)

2025-10-29 08:04:33 +00:00

system_messages

[V1] Implement Cascade Attention (#11635)

2025-01-01 21:56:46 +09:00

tokenizers_

Add Mistral Large 3 and Ministral 3 (#29757)

2025-12-02 10:29:00 +00:00

tool_use

[Bugfix] Mistral tool parser streaming update (#19425)

2025-12-03 17:45:31 +00:00

tools

[CI/Build] Move pre-commit only scripts to tools/pre_commit (#27657)

2025-10-29 08:04:33 +00:00

tpu

[Frontend][torch.compile] CompilationConfig Overhaul (#20283): name change compilation level to compilation mode, deprecation compilation level (#26355)

2025-10-15 02:51:16 +00:00

transformers_utils

[Chore]: Reorganize gguf utils funtions under transformers_utils (#29891)

2025-12-02 17:33:23 +00:00

utils_

[Chore] Move detokenizer_utils to vllm/tokenizers (#29727)

2025-11-29 06:25:17 -08:00

v1

[ROCm][CI] Fix v1/logits_processors failure on ROCm (#29927)

2025-12-04 01:17:07 +08:00

vllm_test_utils

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

weight_loading

[ROCm][CI] Fix Weight Loading With Multiple GPU Tests on ROCm (#28984)

2025-11-19 21:31:33 +00:00

__init__.py

[Small] Formatter only checks lints in changed files (#1528)

2023-10-31 15:39:38 -07:00

ci_envs.py

[Model][0/N] Improve all pooling task | clean up (#25817)

2025-10-13 16:44:50 +08:00

conftest.py

[Multimodal][Core] Optimize multimodal preprocessing cache by hashing image bytes instead of pixel values (#29621)

2025-12-02 21:49:02 +08:00

test_config.py

[Core] Rename PassConfig flags as per RFC #27995 (#29646)

2025-12-03 03:38:55 +00:00

test_embedded_commit.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_envs.py

[Misc] fix comment in test_envs (#28529)

2025-11-14 09:32:46 +00:00

test_inputs.py

[Chore] Move tokenizer initialization methods (#29793)

2025-12-02 13:33:37 +08:00

test_logger.py

[BugFix] respect VLLM_LOGGING_LEVEL in logger (#29761)

2025-12-02 07:49:16 +00:00

test_logprobs.py

[Core] Switch Flat logprob control from environment variable to SamplingParams (#28914)

2025-11-19 02:10:02 +00:00

test_outputs.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_pooling_params.py

[Frontend][Doc][5/N] Improve all pooling task | Polish encode (pooling) api & Document. (#25524)

2025-10-30 12:13:05 +00:00

test_regression.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_routing_simulator.py

[MoE][Refactor] Make select_experts a non-static method (#29067)

2025-11-24 13:38:04 -05:00

test_scalartype.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_seed_behavior.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_sequence.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_triton_utils.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_version.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_vllm_port.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

utils.py

[Chore] Move tokenizer initialization methods (#29793)

2025-12-02 13:33:37 +08:00