Nick HillandClaude Opus 4.8 a7fd4c7482 [Core] Unify extensible KV cache state on ExtensibleKVCacheBuffers ...

Move the grow-only buffer collection from the V2 attn_utils module to
vllm/utils/extensible_tensor.py and use it from the V1 runner as well
(replacing the _extensible_kv_cache_* attribute trio). Both runners now
expose the same `extensible_kv_buffers` attribute, so worker-level
features (memory measurement, sleep, connector deferral) can treat the
runners uniformly.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_0133xqsNmqLHG9Pyhr5wSp1D
Signed-off-by: Nick Hill <nickhill@us.ibm.com>

2026-07-20 14:42:55 +01:00

..

__init__.py

[V1] Adding min tokens/repetition/presence/frequence penalties to V1 sampler (#10681)

2024-12-26 19:02:58 +09:00

test_attn_utils.py

[Spec Decode] Support mixed KV page sizes for DFlash (#45181)

2026-06-21 22:45:14 +08:00

test_cp_utils.py

DCP supports hybrid attention (#40996)

2026-07-09 21:34:45 -07:00

test_encoder_runner.py

[Bugfix][Multimodal] Fix Qwen3-Omni use_audio_in_video with mixed image/video inputs (#46213)

2026-07-17 08:31:16 +00:00

test_extensible_kv_cache.py

[Core] Unify extensible KV cache state on ExtensibleKVCacheBuffers

2026-07-20 14:42:55 +01:00

test_gpu_autoregressive_speculator.py

[Model Runner V2][Spec Decode] Handle tuple hidden states from MTP draft models (#46786)

2026-06-27 18:38:07 -07:00

test_gpu_batch_ordering.py

[Bugfix][Model Runner V2] Order uniform decodes first so spec decodes aren't misclassified as prefills (#47381)

2026-07-09 14:26:27 +01:00

test_gpu_block_table.py

[PERF] Fuse multi-group block table staged writes (#44944)

2026-06-16 10:53:27 -07:00

test_gpu_gumbel_sample.py

[MRV2] Make FP32 Gumbel sampling more accurate (#45996)

2026-06-18 19:42:09 +00:00

test_gpu_input_batch.py

DCP supports hybrid attention (#40996)

2026-07-09 21:34:45 -07:00

test_gpu_model_runner_mm_gather.py

[Bugfix][Spec Decode] Fix EAGLE drafter multimodal encoder cache misses (#46315)

2026-06-22 18:14:02 +00:00

test_gpu_model_runner_v2_eplb.py

[Model] Add DiffusionGemma Support (#45163)

2026-06-11 22:17:35 -07:00

test_gpu_model_runner.py

[2/N][KV-Cache Layout Refactor] Pack K/V into the content dim across attention backends (#44455)

2026-07-11 11:11:16 -04:00

test_gpu_profiler.py

[Hardware][GPU] Profiler config additional to increase it scope and annotation details (#37524)

2026-07-17 13:38:59 -07:00

test_gpu_rejection_sampler_i64.py

[Bugfix][Model Runner V2][Spec Decode] Fix int32 offset overflow in block verification kernels (#47383)

2026-07-02 07:32:38 -07:00

test_gpu_worker_weight_transfer.py

[Bugfix][RL] Set vLLM config during weight reload (#45989)

2026-07-20 15:02:56 +08:00

test_gpu_worker.py

[Core] Persist and reuse the memory-profiling result across boots (opt-in) (#47388)

2026-07-08 00:53:02 +00:00

test_kv_block_zeroer.py

[Bugfix] Fix race condition in KVBlockZeroer (#48085)

2026-07-09 09:18:19 +00:00

test_late_interaction_runner.py

[Core] Move MRV1 late_interaction_runner.py out of MRV2 subtree (#48014)

2026-07-08 18:30:11 +00:00

test_mamba_utils.py

[Kernel] Support DS Mamba tail copy for MTP align mode (#45473)

2026-06-16 22:50:30 +00:00

test_mixed_warmup_gate.py

[BugFix] Gate MRV2 mixed sparse-MLA warmup on max_num_seqs > 1 (#47050)

2026-06-30 16:31:27 +01:00

test_mrope_prompt_embeds.py

[Security] Fix DoS via prompt_embeds on M-RoPE models (#45252)

2026-06-13 10:17:38 +00:00

test_sleep_mode_backend.py

[Core] Make sleep-mode backend capability flags communicator-agnostic (#47243)

2026-07-01 07:17:44 +00:00

test_utils.py

[V0 Deprecation] Refactor kv cache from list to element (#37487)

2026-03-23 20:10:11 -07:00

test_worker_memory_snapshot.py

[Hardware] Replace torch.cuda.device_count/current_device/set_device API (#36145)

2026-03-12 07:57:47 -07:00

test_xpu_model_runner.py

[XPU] Fix CUDA API shims breaking Torch Dynamo during AOT compile (#43092)

2026-07-06 08:29:20 +08:00