3 people 97c4317bf5 [Bugfix][Frontend] Default max_tokens server-side on /inference/v1/generate (#42329) ...

Signed-off-by: hallerite <git@hallerite.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>

2026-05-13 11:16:46 +02:00

..

disagg

[Bugfix][Frontend] Default max_tokens server-side on /inference/v1/generate (#42329)

2026-05-13 11:16:46 +02:00

instrumentator

[Core][Metrics] expose waiting request breakdown via labeled metric (capacity/deferred) (#38435)

2026-04-13 15:30:55 -04:00

lora

[Frontend][4/n] Improve pooling entrypoints | pooling. (#39153)

2026-04-09 10:09:45 +00:00

render

[Misc] Reorganize inputs (#35182)

2026-03-25 10:22:54 -07:00

tokenize

[Feature] Warm up readonly multimodal processor during renderer startup (#40797)

2026-04-25 03:57:41 +00:00

__init__.py

[Refactor] Relocate endpoint tests to mirror serving code directory structure (#37504)

2026-03-19 07:19:36 +00:00