Mark McLoughlinandGitHub 340d7b1b21 [V1][Spec Decoding] Add num_drafts and num_accepted_tokens_per_position metrics (#16665) ...

Signed-off-by: Mark McLoughlin <markmc@redhat.com>

2025-04-24 08:57:40 -07:00

..

test_kv_cache_utils.py

[V1] Remove pre-allocation for KV cache (#16941)

2025-04-22 00:52:18 -07:00

test_prefix_caching.py

[V1] Remove pre-allocation for KV cache (#16941)

2025-04-22 00:52:18 -07:00

test_scheduler_e2e.py

[V1] Support long_prefill_token_threshold in v1 scheduler (#15419)

2025-03-25 14:22:26 -07:00

test_scheduler.py

[V1][Spec Decoding] Add num_drafts and num_accepted_tokens_per_position metrics (#16665)

2025-04-24 08:57:40 -07:00

test_specialized_manager.py

[V1] Implement sliding window attention in kv_cache_manager (#14097)

2025-04-01 00:33:17 -07:00