3 people 80608ba5af [NIXL] Add support for MLA caches with different latent dim (#25902) ...

Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>

2025-09-30 12:18:29 +00:00

..

basic_correctness

[V0 Deprecation] Remove LLMEngine (#25033)

2025-09-20 17:56:30 -07:00

benchmarks

[Misc] Clean up flags in vllm bench serve (#25138)

2025-09-18 12:43:33 +00:00

compile

[New Model] DeepSeek-V3.2 (Rebased to Main) (#25896)

2025-09-30 17:14:41 +08:00

config

[V0 Deprecation] Remove multi-step scheduling (#22138)

2025-08-12 20:18:39 -07:00

cuda

[Bugfix][Ray] Set the cuda context eagerly in the ray worker (#19583)

2025-06-19 22:01:16 -07:00

detokenizer

[V0 Deprecation] Remove async_output_proc, preemption mode, delay factor (#25334)

2025-09-21 08:52:32 -07:00

distributed

[CI/Build] Fix and re-enable v1 PP test on CI (#25496)

2025-09-23 21:58:25 +00:00

engine

[mypy] Fix wrong type annotations related to tuple (#25660)

2025-09-25 13:00:45 +00:00

entrypoints

Test Prompt Embeds/LoRA compatibility and Enable LoRA Support for OPT Models (#25717)

2025-09-30 08:10:58 +08:00

evals

[Docs] GSM8K Accuracy Evaluation doc update (#25360)

2025-09-22 02:49:13 +00:00

kernels

[New Model] DeepSeek-V3.2 (Rebased to Main) (#25896)

2025-09-30 17:14:41 +08:00

kv_transfer

Remove deprecated PyNcclConnector (#24151)

2025-09-03 22:49:16 +00:00

lora

[Core] Optimize LoRA weight loading (#25403)

2025-09-23 18:19:45 +08:00

mistral_tool_use

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

model_executor

[V0 Deprecation] Remove vllm.worker and update according imports (#25901)

2025-09-29 23:26:11 +00:00

models

[Model] Move vision_feature_select_strategy into resolve_visual_encoder_outputs (#25938)

2025-09-30 11:24:57 +00:00

multimodal

Add option to restrict media domains (#25783)

2025-09-27 01:23:52 +00:00

plugins

[New Model] DeepSeek-V3.2 (Rebased to Main) (#25896)

2025-09-30 17:14:41 +08:00

plugins_tests

[V0 Deprecation] Remove LLMEngine (#25033)

2025-09-20 17:56:30 -07:00

prompts

[BugFix] Fix input positions for long context with sliding window (#2088)

2023-12-13 12:28:13 -08:00

quantization

[CI] Add E2E Blackwell Quantized MoE Test (#25723)

2025-09-26 12:23:00 -07:00

reasoning

[Bugfix] Improve GLM4 MoE Reasoning Parser's is_reasoning_end Condition (#25355)

2025-09-26 11:54:00 -07:00

samplers

[V0 Deprecation] Remove LLMEngine (#25033)

2025-09-20 17:56:30 -07:00

speculative_decoding/speculators

[Bugfix][Speculative Decoding] Fix Eagle3 quantization config issue (#25883)

2025-09-29 11:37:20 -04:00

standalone_tests

[CI] Remove duplicated docs build from buildkite (#22924)

2025-08-15 05:58:06 -07:00

system_messages

[V1] Implement Cascade Attention (#11635)

2025-01-01 21:56:46 +09:00

tokenization

[V0 Deprecation] Remove V0 Sequence class & Sampler (#25332)

2025-09-21 08:52:15 -07:00

tool_use

[Bugfix] Fix DeepSeekV31ToolParser to correctly parse multiple tools in non-streaming output (#25405)

2025-09-24 20:58:00 +08:00

tools

[Perf] Validate @config in pre-commit instead of dynamically (#20200)

2025-07-01 05:10:28 -04:00

tpu

[V0 Deprecation] Remove max_seq_len_to_capture (#25543)

2025-09-24 01:51:39 -07:00

transformers_utils

[Core] Support configuration parsing plugin (#24277)

2025-09-10 11:32:43 -07:00

utils_

[Core] GC Debug callback (#24829)

2025-09-27 17:53:31 +00:00

v1

[NIXL] Add support for MLA caches with different latent dim (#25902)

2025-09-30 12:18:29 +00:00

vllm_test_utils

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

weight_loading

[Kernel/Quant] Remove the original marlin format and qqq (#23204)

2025-08-20 15:13:36 -04:00

__init__.py

[Small] Formatter only checks lints in changed files (#1528)

2023-10-31 15:39:38 -07:00

ci_envs.py

[CI] Add ci_envs for convenient local testing (#24630)

2025-09-12 08:52:25 +00:00

conftest.py

[CI/Build] Fix v1 OOT registration test (#25547)

2025-09-24 08:03:13 +00:00

test_config.py

[V0 deprecation] Remove unreachable model_config.supported_tasks (#25642)

2025-09-25 11:26:31 +00:00

test_embedded_commit.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_envs.py

[Frontend] Responses API MCP tools for built in tools and to pass through headers (#24628)

2025-09-22 23:38:19 +00:00

test_inputs.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_logger.py

feat: Add --enable-log-outputs flag for logging model generations (#20707)

2025-08-06 23:10:13 -07:00

test_outputs.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_pooling_params.py

[Model] Pooling model activation supports per request control by PoolingParams (#20538)

2025-08-05 00:37:00 -07:00

test_regression.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_routing_simulator.py

[Model] Add LongCat-Flash (#23991)

2025-09-24 21:53:40 -07:00

test_scalartype.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_seed_behavior.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_sequence.py

[V0 Deprecation] Remove V0 tests in test_sequence.py (#25088)

2025-09-17 11:08:45 -07:00

test_triton_utils.py

[Bugfix] Add triton.language.tensor placeholder (#25649)

2025-09-25 10:31:14 +00:00

test_version.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_vllm_port.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

utils.py

[XPU]Fix xpu spec decoding UTs, avoid using cuda graph (#25847)

2025-09-29 05:15:10 +00:00