3 people 891cc4b9c5 [Frontend] Report cache usage in Anthropic /v1/messages API (#40912) ...

Signed-off-by: mistral0105 <zhangshuoming17@mails.ucas.ac.cn>
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>

2026-06-20 21:12:48 +00:00

..

basic_correctness

[XPU][Feature] transparent sleep mode support for XPU platform (#37149)

2026-06-07 10:45:31 +08:00

benchmarks

[ASR] Add Long Audio benchmark and correctness test (#44587)

2026-06-12 04:11:16 +00:00

compile

[XPU] Enable sequence parallel support for XPU (#38608)

2026-06-14 19:26:46 -07:00

config

[Perf] FP8 FlashInfer Attn for ViT (#38065)

2026-04-27 13:44:15 +08:00

cuda

[Hardware] Replace torch.cuda.device_count/current_device/set_device API (#36145)

2026-03-12 07:57:47 -07:00

detokenizer

[CI/Build] Remove use of skip_v1 (#34699)

2026-02-18 12:19:11 +08:00

distributed

[Model] Remove XverseForCausalLM (#45638)

2026-06-14 22:09:00 -07:00

engine

Stop setting CUDA_VISIBLE_DEVICES internally in vLLM, add device_ids arg (#45026)

2026-06-20 13:38:10 -07:00

entrypoints

[Frontend] Report cache usage in Anthropic /v1/messages API (#40912)

2026-06-20 21:12:48 +00:00

evals

[ROCm][CI] Skip Qwen3.5-35B-A3B-MXFP4-AITER-TP2 for non gfx950 (#46109)

2026-06-19 17:20:10 -05:00

fusion

Add the QuantizedActivation linear-kernel contract (#44260)

2026-06-12 13:48:15 -07:00

ir

[Perf] Set IR Op Priority Once at Worker Init (#42631)

2026-05-15 15:56:13 +00:00

kernels

[Bugfix] Fix gridDim.y overflow for large row counts (#45255)

2026-06-19 23:27:45 -04:00

lora

[Bugfix] Fix corrupt outputs in MoE FP8 LoRA responses and MoE base model responses when LoRAs are loaded (#42120)

2026-06-18 18:26:09 -07:00

model_executor

[Bugfix][Model] Validate DefaultModelLoader / LoadConfig and fail with clear errors (#45196)

2026-06-17 21:46:33 +00:00

models

[Perf] Optimize Qwen3-VL multi-video prompt processing (#46026)

2026-06-20 07:09:18 -07:00

multimodal

[Multimodal] Add Qwen3-VL video loader (#44412)

2026-06-16 03:45:34 +00:00

parser

[Bugfix][Parser] Fix U+FFFD leak at reasoning-to-content transition in engine parsers (#46159)

2026-06-19 22:09:28 +00:00

plugins

[Misc][Model] add io processor for query/document embeddings from ColBERT (jinaai/jina-colbert-v2) (#45210)

2026-06-16 01:32:32 +00:00

plugins_tests

[BugFix][CI] Fix scheduler plugin test (#45897)

2026-06-17 06:30:49 +00:00

prompts

[BugFix] Fix input positions for long context with sliding window (#2088)

2023-12-13 12:28:13 -08:00

quantization

fix(quantization): Fix AWQ dequantize on Intel XPU and refactor AutoAWQ config (#42727)

2026-06-18 20:12:28 +08:00

reasoning

[Frontend] Add Streaming Parser Engine and new GLM4.7/GLM5.1/GLM5.2 Parser (#45915)

2026-06-19 00:42:10 +08:00

renderers

[Bugfix][Gemma4] Fix offline parser truncation, adjust_request token leak, and chat template sync (#45553)

2026-06-16 04:31:53 +00:00

rocm/aiter

[ROCm] Use vLLM's fp8 quant max in AITER hipBLASLt accuracy test (#46176)

2026-06-19 13:24:02 -05:00

samplers

[Core] Support structured outputs for beam search (#35022)

2026-06-12 06:56:25 -07:00

spec_decode

[Feature] Support custom callable proposer backend for speculative decoding (#39487)

2026-05-13 16:53:01 +00:00

standalone_tests

Add structure to requirements/ directory (#39024)

2026-04-10 13:46:41 -07:00

system_messages

[V1] Implement Cascade Attention (#11635)

2025-01-01 21:56:46 +09:00

tokenizers_

Register parsed config classes before tokenizer init (#40299)

2026-06-16 05:33:08 +00:00

tool_parsers

[Tests] Add Qwen3 streaming parser delta boundary cases (#45708)

2026-06-18 17:37:39 +00:00

tool_use

[Bugfix][Gemma4] Fix parsing when thinking is disabled (#45832)

2026-06-17 02:41:36 +00:00

tools

build: embed image provenance metadata in vLLM containers (#40653)

2026-04-29 03:07:41 -07:00

tracing

[CI][Tracing] Fix race condition by adding server readiness check (#34364)

2026-02-16 12:57:39 +00:00

transformers_utils

[Migration] Migrate GGUF quantization support to plugin (#39612)

2026-06-12 12:02:21 -07:00

utils_

[Bugfix][Core] Fall back when numactl --membind is blocked in constrained containers (#45438)

2026-06-16 09:49:56 -07:00

v1

[Hardware][AMD][CI] Fix e2e core test group (#46024)

2026-06-20 02:04:35 -05:00

vllm_test_utils

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

weight_loading

[Quant] Consolidate GPTQ: rename gptq_marlin.py to auto_gptq.py (#38288)

2026-05-15 08:25:52 +08:00

__init__.py

[Small] Formatter only checks lints in changed files (#1528)

2023-10-31 15:39:38 -07:00

ci_envs.py

[Model][0/N] Improve all pooling task | clean up (#25817)

2025-10-13 16:44:50 +08:00

conftest.py

[Bugfix][V1] Clean up compiled-model bytecode hooks on VllmRunner exit (#45195)

2026-06-16 20:31:17 -07:00

test_access_log_filter.py

[Logging] add --disable-access-log-for-endpoints CLI option (#30011)

2026-01-26 21:49:03 +00:00

test_attention_backend_registry.py

[1/N][Attention] Restructure attention: move files (#31916)

2026-01-09 13:10:24 -08:00

test_config.py

[Model Runner V2] Migration to support quantized model by default [5/N] (#44446)

2026-06-18 12:20:44 -07:00

test_embedded_commit.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_envs.py

[Build] fix self-contradictory precompiled-flag orthogonality test (#44942)

2026-06-11 12:49:08 +08:00

test_force_first_config.py

[Perf] Add VLLM_TRITON_FORCE_FIRST_CONFIG to skip Triton autotuning (#42425)

2026-06-16 15:16:45 +02:00

test_fxgraphcache_pickle_patch.py

[ZenCPU] Make PT Backport Patch Accessible to vLLM (#38205)

2026-04-10 08:29:35 +00:00

test_inputs.py

[Refactor] Pass full VllmConfig to Renderer (#34485)

2026-02-12 22:48:38 -08:00

test_jit_monitor.py

Add Triton recompile detection (#45631)

2026-06-16 18:25:28 +08:00

test_logger.py

[Frontend] Consolidate online serving utils. (#44479)

2026-06-04 06:49:31 +00:00

test_logprobs.py

[Core] Switch Flat logprob control from environment variable to SamplingParams (#28914)

2025-11-19 02:10:02 +00:00

test_outputs.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_pooling_params.py

[Model] Deprecate the score task (this will not affect users). (#37537)

2026-03-20 08:07:56 +00:00

test_ray_env_utils.py

[Feat][Executor] Introduce RayExecutorV2 (#36836)

2026-04-01 14:34:29 -07:00

test_ray_env.py

fix nixl side-channel host selection (#41806)

2026-05-11 07:40:37 +00:00

test_regression.py

[CI/Build] Use modelscope's international site for regression test (#42176)

2026-05-09 19:47:09 -07:00

test_scalartype.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_sequence.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_triton_utils.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_version.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_vllm_port.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_zen_cpu_platform_detection.py

In-Tree AMD Zen CPU Backend via zentorch [1/N] (#35970)

2026-03-15 23:35:35 +00:00

utils.py

[ROCm][CI] Defer AITER sampler import and isolate server test PYTHONPATH (#44823)

2026-06-10 08:56:11 +00:00