Mark McLoughlinandGitHub c386c43ca3 [V1][Metrics] Add per-request prompt/generation_tokens histograms (#12516) ...

Signed-off-by: Mark McLoughlin <markmc@redhat.com>

2025-01-28 22:07:22 +00:00

..

llm

[core] allow callable in collective_rpc (#12151)

2025-01-17 20:47:01 +08:00

offline_mode

[Bugfix] Fix offline mode when using mistral_common (#9457)

2024-10-18 18:12:32 -07:00

openai

[V1][Metrics] Add per-request prompt/generation_tokens histograms (#12516)

2025-01-28 22:07:22 +00:00

__init__.py

[CI/Build] Move test_utils.py to tests/utils.py (#4425)

2024-05-13 23:50:09 +09:00

conftest.py

[CI] Add test case with JSON schema using references + use xgrammar by default with OpenAI parse (#10935)

2024-12-17 11:39:58 +08:00

test_chat_utils.py

[Misc] Add deepseek_vl2 chat template (#12143)

2025-01-17 06:34:48 +00:00