6 people 2e2e626b40 [Bugfix] Count per-group blocks in get_max_concurrency_for_kv_cache_config (#48317) ...

Signed-off-by: David Orman <ormandj@corenode.com>
Co-authored-by: Luke Alonso <lalonso@gmail.com>
Co-authored-by: Martin Vit <martin@voipmonitor.org>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Yifan Qiao <yifanqiao@inferact.ai>

2026-07-21 00:29:10 +00:00

..

basic_correctness

[CI][AMD] Configure MI300 tests for native execution without DinD (#48387)

2026-07-15 02:14:16 +00:00

benchmarks

[Bugfix] Re-enable benchmarking of librispeech dataset. (#47033)

2026-07-08 16:19:26 +00:00

compile

[Model][Hardware][AMD]: Part 1/2 -> Enable e2e QK Norm + RoPE + KV Cache runtime fusion for Qwen3-30B-A3B on ROCM_AITER_FA, and ROCM_AITER_UNIFIED_ATTN (#42749)

2026-07-16 17:39:04 -05:00

config

[Model] Use standard ModelOpt config for Inkling NVFP4 (#48990)

2026-07-17 18:13:14 -07:00

cuda

Fix NVML capability lookup for visible devices (#47892)

2026-07-08 09:07:44 -04:00

detokenizer

[CI/Build] Remove use of skip_v1 (#34699)

2026-02-18 12:19:11 +08:00

distributed

[ROCm][CI] fix test_rocm_quick_reduce.py (#49234)

2026-07-20 16:39:33 -05:00

engine

[Misc][Docs] Add human-readable integer support for more cli-args (#47608)

2026-07-08 09:43:34 +00:00

entrypoints

fix(openai): reject non-numeric logprobs with 400 instead of 500 (#49144)

2026-07-20 10:04:50 +00:00

evals

[Core] Add MRV2 virtual-batch PCP for MLA (#46570)

2026-07-19 02:53:15 +00:00

fusion

Add the QuantizedActivation linear-kernel contract (#44260)

2026-06-12 13:48:15 -07:00

ir

[Perf] Set IR Op Priority Once at Worker Init (#42631)

2026-05-15 15:56:13 +00:00

kernels

[RL Infra][FlashInfer] Enable router replay output from FlashInfer monolithic MoE kernel (#44214)

2026-07-20 16:45:10 -07:00

lora

fix(lora): validate LoRA rank is positive in PEFTHelper (#48437)

2026-07-16 05:22:52 +00:00

model_executor

[RL Infra][FlashInfer] Enable router replay output from FlashInfer monolithic MoE kernel (#44214)

2026-07-20 16:45:10 -07:00

models

[copy of #45208] CuMem slept-L1 fragmentation accounting (#49208)

2026-07-20 23:08:11 +00:00

multimodal

[Multimodal] Allow keeping original image mode for ImageIO (#49159)

2026-07-20 13:42:45 +00:00

parser

[Bugfix][Tool Parser] Preserve whitespace in parameter values (MiniMax M2, Qwen3, MiniCPM5 XML) (#48846)

2026-07-17 16:45:41 +00:00

plugins

[bugfix] bge-m3-sparse-plugin mismatch requests (#48112)

2026-07-10 10:03:00 +08:00

plugins_tests

[Frontend] Add endpoint plugins framework (#47454)

2026-07-08 10:00:41 +08:00

prompts

…

quantization

[Bugfix][Gemma4] Fix ModelOpt mixed-precision MoE config mapping (#48563)

2026-07-20 06:39:28 -07:00

reasoning

[Frontend] [Parser] Port DeepSeek V4 to streaming parser engine framework (#45877)

2026-07-03 20:55:23 -04:00

renderers

[Model] Add Inkling model support [1/N] (#48799)

2026-07-15 23:40:07 -07:00

rocm/aiter

[ROCm] Fix AITER FP8 quantization schema tests (#46414)

2026-06-24 22:29:19 +08:00

samplers

[Bugfix] Fix beam search candidate indexing when logprobs count varies (#47126)

2026-07-01 07:07:06 +00:00

spec_decode

[Feature] Support custom callable proposer backend for speculative decoding (#39487)

2026-05-13 16:53:01 +00:00

standalone_tests

[CI][AMD] Configure MI300 tests for native execution without DinD (#48387)

2026-07-15 02:14:16 +00:00

system_messages

…

tokenizers_

[Bugfix] Fix logprobs token-string collision from SentencePiece space… (#48674)

2026-07-20 12:17:18 +08:00

tool_parsers

[Bugfix][Tool Parser] Preserve whitespace in parameter values (MiniMax M2, Qwen3, MiniCPM5 XML) (#48846)

2026-07-17 16:45:41 +00:00

tool_use

[Bugfix] Fix parallel_tool_calls=null crash in Responses API from_request() (#48098)

2026-07-15 18:01:17 +08:00

tools

[ROCm][CI] Adding metadata (#47477)

2026-07-02 17:45:23 -07:00

tracing

[CI][Tracing] Fix race condition by adding server readiness check (#34364)

2026-02-16 12:57:39 +00:00

transformers_utils

[CI] Don't try and download files that we already know don't exist (#46854)

2026-06-26 23:56:39 +00:00

utils_

[copy of #45208] CuMem slept-L1 fragmentation accounting (#49208)

2026-07-20 23:08:11 +00:00

v1

[Bugfix] Count per-group blocks in get_max_concurrency_for_kv_cache_config (#48317)

2026-07-21 00:29:10 +00:00

vllm_test_utils

…

weight_loading

[Quant] Consolidate GPTQ: rename gptq_marlin.py to auto_gptq.py (#38288)

2026-05-15 08:25:52 +08:00

__init__.py

…

ci_envs.py

…

conftest.py

[ROCm][CI] fix test_common.py (#48676)

2026-07-15 06:42:06 +00:00

test_access_log_filter.py

…

test_attention_backend_registry.py

…

test_config.py

[Model] Add Inkling model support [1/N] (#48799)

2026-07-15 23:40:07 -07:00

test_embedded_commit.py

…

test_envs.py

[KVOffload][P2P] Well-known default host/port env vars and per-DP-rank control port (#47636)

2026-07-15 15:22:56 +03:00

test_force_first_config.py

[Perf] Add VLLM_TRITON_FORCE_FIRST_CONFIG to skip Triton autotuning (#42425)

2026-06-16 15:16:45 +02:00

test_fxgraphcache_pickle_patch.py

[ZenCPU] Make PT Backport Patch Accessible to vLLM (#38205)

2026-04-10 08:29:35 +00:00

test_inputs.py

[Refactor] Pass full VllmConfig to Renderer (#34485)

2026-02-12 22:48:38 -08:00

test_jit_monitor.py

Bump flashinfer version to 0.6.14 (#47669)

2026-07-15 21:00:40 -07:00

test_logger.py

[Frontend] Consolidate online serving utils. (#44479)

2026-06-04 06:49:31 +00:00

test_logprobs.py

…

test_outputs.py

…

test_pooling_params.py

[Bugfix] Reject removed pooling parameters (#48984)

2026-07-19 05:18:03 -07:00

test_ray_env_utils.py

[Feat][Executor] Introduce RayExecutorV2 (#36836)

2026-04-01 14:34:29 -07:00

test_ray_env.py

fix nixl side-channel host selection (#41806)

2026-05-11 07:40:37 +00:00

test_regression.py

[CI/Build] Use modelscope's international site for regression test (#42176)

2026-05-09 19:47:09 -07:00

test_sampling_params.py

[Bugfix] Reject sampling params unsupported by diffusion models (#45418)

2026-07-07 11:25:36 +00:00

test_scalartype.py

…

test_sequence.py

…

test_triton_utils.py

…

test_version.py

…

test_vllm_port.py

…

test_zen_cpu_platform_detection.py

In-Tree AMD Zen CPU Backend via zentorch [1/N] (#35970)

2026-03-15 23:35:35 +00:00

utils.py

[CI] Move compatible 1xL4 jobs to H200 35GB MIG (#43024)

2026-07-19 19:21:25 -07:00