vllm/tests/v1/kv_connector/unit at 2a09d50034c19ef4ab8564cdb53ddf4bed29a323 - vllm

offloading_connector

[KV Offloading] Add labeled metrics support (#45957 )

2026-06-21 18:04:01 +00:00

__init__.py

[P/D] NIXL Integration (#17751 )

2025-05-12 09:46:16 -07:00

test_bidirectional_kv_transfer.py

[KV Connector]: Support KV push from Prefill to Decode node using Nixl KV Connector (#35264 )

2026-06-12 10:38:41 +00:00

test_cache_pollution_prevention.py

[P/D] KV Load Failure Recovery/Abort Configuration (#26813 )

2025-12-10 11:00:52 -08:00

test_config.py

[KV Connector] Update lmcache kv_offloading_backend to use LMCacheMPConnector (#42865 )

2026-06-03 19:23:55 -07:00

test_decode_bench_connector.py

[Spec Decode] Support hybrid attention models in extract_hidden_states (#39949 )

2026-05-13 10:45:53 -07:00

test_error_propagation.py

[Perf] Optimize scheduler overhead for PD disaggregation, around 5% E2E perf improvement (#35781 )

2026-03-10 21:25:30 -07:00

test_example_connector.py

[Mypy] Better fixes for the mypy issues in vllm/config (#37902 )

2026-03-25 06:14:43 -07:00

test_flexkv_connector.py

[KV Connector] Support using FlexKV as KV Cache Offloading option. (#34328 )

2026-03-12 00:46:20 -07:00

test_handshake_pp_aggregation.py

[Model] Add DiffusionGemma Support (#45163 )

2026-06-11 22:17:35 -07:00

test_hf3fs_client.py

[KVConnector] Support 3FS KVConnector (#37636 )

2026-04-07 15:46:00 +00:00

test_hf3fs_connector.py

[KVConnector] Support 3FS KVConnector (#37636 )

2026-04-07 15:46:00 +00:00

test_hf3fs_metadata_server.py

[KVConnector] Support 3FS KVConnector (#37636 )

2026-04-07 15:46:00 +00:00

test_hma_auto_config.py

[KV Transfer] Enable HMA by default for connectors that support it (#41847 )

2026-05-26 12:28:51 +02:00

test_invalid_blocks_correctness.py

[Perf] Optimize scheduler overhead for PD disaggregation, around 5% E2E perf improvement (#35781 )

2026-03-10 21:25:30 -07:00

test_kv_cache_layout.py

[Bugfix] Disable cross-layer KV cache for MLA attention backends (#37090 )

2026-03-16 19:03:10 +02:00

test_kv_connector_lifecycle.py

[Spec Decode] Support hybrid attention models in extract_hidden_states (#39949 )

2026-05-13 10:45:53 -07:00

test_kv_load_failure_recovery.py

[Perf] Optimize scheduler overhead for PD disaggregation, around 5% E2E perf improvement (#35781 )

2026-03-10 21:25:30 -07:00

test_lmcache_connector.py

[Prefix Cache] Include lora_name in BlockStored event for deterministic KV-cache reconstruction (#27577 )

2025-12-30 00:17:16 +00:00

test_lmcache_integration.py

[V0 Deprecation] Deprecate virtual engine (#37195 )

2026-03-18 14:30:14 -07:00

test_mooncake_connector_hma.py

[KV Connector][Mooncake] Pipeline-parallel support for PD-disaggregated serving with Mooncake connector (#44528 )

2026-06-16 04:35:38 -07:00

test_mooncake_connector.py

[KV Connector][Mooncake] Pipeline-parallel support for PD-disaggregated serving with Mooncake connector (#44528 )

2026-06-16 04:35:38 -07:00

test_mooncake_stats.py

[P/D][Mooncake] Add KVConnectorStats for transfer observability (#40414 )

2026-05-05 02:17:38 -07:00

test_mooncake_store_connector.py

[KV Connector][Mooncake] Async lookup to reduce scheduler overhead (#45659 )

2026-06-18 21:44:02 +00:00

test_mooncake_store_coordinator.py

[Perf][KVConnector][Mooncake] Compact chunk-hash keys and zero-copy lookup wire format (#45969 )

2026-06-20 15:00:11 -07:00

test_mooncake_store_hma_e2e.py

[Perf][KVConnector][Mooncake] Compact chunk-hash keys and zero-copy lookup wire format (#45969 )

2026-06-20 15:00:11 -07:00

test_mooncake_store_scheduler.py

[KV Connector][Mooncake] Async lookup to reduce scheduler overhead (#45659 )

2026-06-18 21:44:02 +00:00

test_mooncake_store_worker.py

[Perf][KVConnector][Mooncake] Compact chunk-hash keys and zero-copy lookup wire format (#45969 )

2026-06-20 15:00:11 -07:00

test_moriio_connector.py

[ROCm][P/D] Support MiniMax-M3 mixed KV layouts in MoRIIO READ mode (#46039 )

2026-06-21 12:55:19 +00:00

test_moriio_kv_layout.py

[ROCm][P/D] Support MiniMax-M3 mixed KV layouts in MoRIIO READ mode (#46039 )

2026-06-21 12:55:19 +00:00

test_multi_connector.py

[Core][KV Connector] fix scheduler KV connector stats aggregation (#43877 )

2026-06-12 14:51:55 +00:00

test_nixl_connector_hma.py

[KV Connector]: Support KV push from Prefill to Decode node using Nixl KV Connector (#35264 )

2026-06-12 10:38:41 +00:00

test_nixl_connector.py

[Bugfix] Fix NixlConnector handshake block_len validation for GQA-replicated KV heads (#45879 )

2026-06-17 15:11:29 -07:00

test_nixl_heartbeat.py

[Nixl][PD] Lease renewal TTL KV blocks on P (#41383 )

2026-05-11 09:27:30 +00:00

test_nixl_push_connector.py

[KV Connector]: Support KV push from Prefill to Decode node using Nixl KV Connector (#35264 )

2026-06-12 10:38:41 +00:00

test_nixl_simple_cpu_offload.py

[KV Connector]: Support KV push from Prefill to Decode node using Nixl KV Connector (#35264 )

2026-06-12 10:38:41 +00:00

test_offloading_connector.py

[KV Offloading] Remove dummy worker-side stats from OffloadingConnector (#45905 )

2026-06-18 08:13:28 +03:00

test_output_aggregator.py

[Core] Simplify async KV output aggregation (#28327 )

2025-11-09 09:44:13 -08:00

test_remote_decode_lifecycle.py

[Core][KVConnector] Support HMA+NixlConnector (#35758 )

2026-03-06 08:51:21 +01:00

test_remote_prefill_lifecycle.py

[KV Connector]: Support KV push from Prefill to Decode node using Nixl KV Connector (#35264 )

2026-06-12 10:38:41 +00:00

test_rixl_gpu_mem_diag.py

[NixlConnector] Initiate deprecation cycle for kv_both role (#43874 )

2026-06-05 11:08:17 +02:00

test_scheduler_kv_connector_override.py

[KV Connector] Remove compat support for pre-v0.12.0 constructor signatures without KVCacheConfig (#39832 )

2026-05-09 23:39:46 +00:00

test_tp_mapping.py

[NIXL] Per-region KV transfer classification for mixed full-attn + MLA groups (#44583 )

2026-06-11 21:42:41 -07:00

test_transfer_topology_sharded.py

[KVConnector][1/N] PP-aware handshake aggregation and intermediate-PP output plumbing (#43720 )

2026-06-04 22:04:19 -07:00

utils.py

[KV Connector]: Support KV push from Prefill to Decode node using Nixl KV Connector (#35264 )

2026-06-12 10:38:41 +00:00