Seiji EicherandGitHub 6370e53f24 [Frontend] Reuse prefill token ids on the decode chat path for disaggregated serving (#48145) ...

Signed-off-by: Seiji Eicher <seiji@anyscale.com>

2026-07-29 10:02:57 +02:00

..

__init__.py

[Refactor] Relocate chat completion and anthropic tests (#36919)

2026-03-14 12:16:16 +08:00

test_batched_chat_completions.py

[Frontend] Expose logprob_token_ids on Python OpenAI endpoints (#43463)

2026-07-13 14:40:21 -07:00

test_chat_completion_with_prompt_embeds.py

[Bugfix][CI] Gemma3 Transformers multimodal encoder profiling and build prompt-embedding fixtures (#44952)

2026-06-09 05:49:30 +00:00

test_chat_completion.py

[Frontend] Reuse prefill token ids on the decode chat path for disaggregated serving (#48145)

2026-07-29 10:02:57 +02:00

test_chat_echo.py

[Refactor] Relocate chat completion and anthropic tests (#36919)

2026-03-14 12:16:16 +08:00

test_chat_error.py

[Frontend][Core] Standardize request error handling with VLLMError hierarchy (#49665)

2026-07-29 04:20:40 +00:00

test_chat_logit_bias_validation.py

[Bugfix] Raise VLLMValidationError for non-integer logit_bias keys (#46612)

2026-06-30 06:18:59 +00:00

test_chat.py

[Frontend][Core] Standardize request error handling with VLLMError hierarchy (#49665)

2026-07-29 04:20:40 +00:00

test_completion_with_function_calling.py

[Frontend] Fix Kimi K2 tool call IDs for required tool choice (#46344)

2026-06-24 19:59:40 +00:00

test_enable_force_include_usage.py

[CI] Consolidate Speech to Text tests (#42274)

2026-05-11 19:50:17 +00:00

test_extra_content_fields.py

[Model] Support TranslateGemma-12b-it (#41599)

2026-07-17 07:17:59 +00:00

test_include_reasoning.py

[Feature][Parser] Support include_reasoning param for non-Harmony models (#44301)

2026-07-10 15:34:02 +08:00

test_logprob_token_ids.py

[Frontend][Core] Standardize request error handling with VLLMError hierarchy (#49665)

2026-07-29 04:20:40 +00:00

test_root_path.py

[Refactor] Relocate completion and chat completion tests (#37125)

2026-03-17 11:31:23 +08:00

test_serving_chat.py

[Frontend] Reuse prefill token ids on the decode chat path for disaggregated serving (#48145)

2026-07-29 10:02:57 +02:00

test_thinking_token_budget_validation.py

[Frontend][Core] Standardize request error handling with VLLMError hierarchy (#49665)

2026-07-29 04:20:40 +00:00

test_thinking_token_budget.py

[ROCm][CI][Bugfix] Fix flaky parallel tool-call streaming (test assertion + Mistral/Granite parsers) (#47550)

2026-07-06 19:06:19 -04:00