Seiji EicherandGitHub 6370e53f24 [Frontend] Reuse prefill token ids on the decode chat path for disaggregated serving (#48145) ...

Signed-off-by: Seiji Eicher <seiji@anyscale.com>

2026-07-29 10:02:57 +02:00

..

anthropic

[Front-end] [Messages] Populate num_cache_creation_tokens (#48535)

2026-07-18 13:04:35 -04:00

generate

[Frontend] Refine the entrypoint class's inheritance hierarchy. (#47498)

2026-07-03 10:50:06 +00:00

llm

[Frontend][Core] Standardize request error handling with VLLMError hierarchy (#49665)

2026-07-29 04:20:40 +00:00

multimodal

[Frontend][Core] Standardize request error handling with VLLMError hierarchy (#49665)

2026-07-29 04:20:40 +00:00

openai

[Frontend] Reuse prefill token ids on the decode chat path for disaggregated serving (#48145)

2026-07-29 10:02:57 +02:00

pooling

[Bugfix] Restore truncate_prompt_tokens for Jina rerank/score online (#49963)

2026-07-27 22:52:59 +08:00

scale_out

[Render] Add round trip parity test and docs for derender (#48617)

2026-07-17 05:02:46 +00:00

serve

[Frontend][Core] Standardize request error handling with VLLMError hierarchy (#49665)

2026-07-29 04:20:40 +00:00

speech_to_text

[Bugfix] Changed speech to text chunk timestamp to cumulative approach (#41131)

2026-07-27 17:06:46 +00:00

tool_parsers

Make bare hugging_face imports forbidden (#49726)

2026-07-25 04:18:39 -07:00

unit_tests

[Frontend][Core] Standardize request error handling with VLLMError hierarchy (#49665)

2026-07-29 04:20:40 +00:00

weight_transfer

[Core][Frontend] Add weight version tagging for RL rollouts (#49040)

2026-07-28 14:35:29 +08:00

__init__.py

[CI/Build] Move test_utils.py to tests/utils.py (#4425)

2024-05-13 23:50:09 +09:00

conftest.py

Make bare hugging_face imports forbidden (#49726)

2026-07-25 04:18:39 -07:00