3 people 0a9ef0cfce Move query quantization to attention layer for Flashinfer & Triton. (#26534) ...

Signed-off-by: adabeyta <aabeyta@redhat.com>
Signed-off-by: Adrian Abeyta <aabeyta@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

2025-10-15 19:01:38 -04:00

..

basic_correctness

[V0 Deprecation] Remove VLLM_USE_V1 from tests (#26341)

2025-10-07 15:42:31 +00:00

benchmarks

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

compile

Move query quantization to attention layer for Flashinfer & Triton. (#26534)

2025-10-15 19:01:38 -04:00

config

[V0 Deprecation] Remove VLLM_USE_V1 from tests (#26341)

2025-10-07 15:42:31 +00:00

cuda

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

detokenizer

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

distributed

[Frontend][torch.compile] CompilationConfig Overhaul (#20283): name change compilation level to compilation mode, deprecation compilation level (#26355)

2025-10-15 02:51:16 +00:00

engine

[Frontend][torch.compile] CompilationConfig Overhaul (#20283): name change compilation level to compilation mode, deprecation compilation level (#26355)

2025-10-15 02:51:16 +00:00

entrypoints

Olmo 3 tool parser and tests (#26143)

2025-10-15 16:36:12 +00:00

evals

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

kernels

[torch.compile] Unwrap fused_marlin_moe custom op (#26739)

2025-10-14 02:22:16 +00:00

kv_transfer

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

lora

[Chore] Separate out vllm.utils.async_utils (#26913)

2025-10-15 15:33:00 +00:00

model_executor

[FrontEnd] UNREVERT CompilationConfig overhaul (#20283): deprecate use_inductor in favor of backend, simplify custom_ops (#26502)

2025-10-13 22:47:16 +00:00

models

[Chore] Separate out vllm.utils.func (#26904)

2025-10-15 13:03:58 +00:00

multimodal

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

plugins

[Model][2/N] Improve all pooling task | Support multi-vector retrieval (#25370)

2025-10-15 11:14:41 +00:00

plugins_tests

[Model][2/N] Improve all pooling task | Support multi-vector retrieval (#25370)

2025-10-15 11:14:41 +00:00

prompts

[BugFix] Fix input positions for long context with sliding window (#2088)

2023-12-13 12:28:13 -08:00

quantization

[CI Failure] Fix torchao dep failure for Quantization Test (#26824)

2025-10-14 16:41:43 -07:00

reasoning

[Model] Add DeepSeek-V3.1 reasoning parser (split from PR #24972) (#25589)

2025-10-15 11:09:52 +08:00

samplers

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

speculative_decoding/speculators

Add: Support for multiple hidden layers in Eagle3 (#26164)

2025-10-09 07:30:50 +00:00

standalone_tests

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

system_messages

[V1] Implement Cascade Attention (#11635)

2025-01-01 21:56:46 +09:00

tokenization

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

tool_use

[Bugfix]fix Qwen3 xml tool parser (#26345)

2025-10-15 09:50:30 +08:00

tools

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

tpu

[Frontend][torch.compile] CompilationConfig Overhaul (#20283): name change compilation level to compilation mode, deprecation compilation level (#26355)

2025-10-15 02:51:16 +00:00

transformers_utils

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

utils_

[Chore] Separate out vllm.utils.async_utils (#26913)

2025-10-15 15:33:00 +00:00

v1

[Misc] Remove isort and yapf ignores (#26888)

2025-10-15 12:09:03 +00:00

vllm_test_utils

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

weight_loading

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

__init__.py

[Small] Formatter only checks lints in changed files (#1528)

2023-10-31 15:39:38 -07:00

ci_envs.py

[Model][0/N] Improve all pooling task | clean up (#25817)

2025-10-13 16:44:50 +08:00

conftest.py

[Misc] rename torch_dtype to dtype (#26695)

2025-10-15 12:11:48 +00:00

test_config.py

[UX] Support nested dicts in hf_overrides (#25727)

2025-10-07 11:19:16 +08:00

test_embedded_commit.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_envs.py

[Perf] Cache vllm.env.__getattr__ result to avoid recomputation (#26146)

2025-10-14 17:03:21 -04:00

test_inputs.py

[Bugfix] Fix SHM cache initialization (#26427)

2025-10-09 02:48:04 -07:00

test_logger.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_outputs.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_pooling_params.py

[Model][2/N] Improve all pooling task | Support multi-vector retrieval (#25370)

2025-10-15 11:14:41 +00:00

test_regression.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_routing_simulator.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_scalartype.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_seed_behavior.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_sequence.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_triton_utils.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_version.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_vllm_port.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

utils.py

[CI/Build] Use 127.0.0.1 instead of localhost in utils (#26750)

2025-10-14 07:04:00 +00:00