TJian and GitHub
302954e5f6
[ROCm] [CI] fix transcription flakiness AMD: Entrypoints Integration (API Server OpenAI - Part 1) (mi325_1) ( #46823 )
...
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com >
2026-06-26 21:33:35 +08:00
Hyunkyun Moon and GitHub
950ee4c2e4
[API] Add token offsets to render endpoints (/v1/.../render) ( #44226 )
...
Signed-off-by: HyunKyun Moon <mhg5303@gmail.com >
2026-06-26 05:02:52 -07:00
Chauncey and GitHub
84c2f9f0fb
[Frontend] Fix Kimi K2 tool call IDs for required tool choice ( #46344 )
...
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com >
2026-06-24 19:59:40 +00:00
489abadfb8
feat: support to OpenMOSS-Team ( #44124 )
...
Signed-off-by: nagisa-kun <1434936049@qq.com >
Signed-off-by: nagisa19 <1434936049@qq.com >
Signed-off-by: nagisa <1434936049@qq.com >
Co-authored-by: OpenAI Codex <codex@openai.com >
Co-authored-by: Roger Wang <hey@rogerw.io >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-06-24 00:08:13 -07:00
Maxwill Lin and GitHub
e48f2aa4ca
[Bugfix][Frontend] Emit a content block for empty Anthropic completions ( #46525 )
...
Signed-off-by: EazyReal <8047065+EazyReal@users.noreply.github.com >
2026-06-24 00:04:26 +00:00
f59db63732
[Bugfix] GPT-OSS Autodrop reasoning in Response API and cleanup ( #45048 )
...
Signed-off-by: Yifan Zong <yzong@redhat.com >
Co-authored-by: Ben Browning <bbrownin@redhat.com >
2026-06-23 09:36:33 -04:00
1bf149f334
Filter Pydantic-internal markers from validation error param ( #46457 )
...
Signed-off-by: muhammadfawaz1 <135441198+muhammadfawaz1@users.noreply.github.com >
Co-authored-by: Mahad Rehmann <114791389+mahadrehmann@users.noreply.github.com >
2026-06-23 13:20:50 +00:00
2a675a7b9f
[Bugfix] Responses API assistant EasyInputMessageParam input ( #44361 )
...
Signed-off-by: Yifan Zong <yzong@redhat.com >
Co-authored-by: Ben Browning <bbrownin@redhat.com >
2026-06-23 08:54:46 -04:00
wang.yuqi and GitHub
31ca9504b1
[Frontend] Split ServingRender into renderer and entrypoint. ( #44285 )
...
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io >
2026-06-23 11:19:09 +00:00
6c427dd401
[BugFix] Omit empty tool_calls from OpenAI chat responses ( #44105 )
...
Signed-off-by: QwertyJack <7554089+QwertyJack@users.noreply.github.com >
Signed-off-by: Chauncey <chaunceyjiang@gmail.com >
Co-authored-by: QwertyJack <7554089+QwertyJack@users.noreply.github.com >
Co-authored-by: Chauncey <chaunceyjiang@gmail.com >
2026-06-23 13:43:53 +08:00
3ce5823762
[Refactor] Responses API parser state into conversation context ( #46030 )
...
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-06-23 13:42:58 +08:00
wang.yuqi and GitHub
1eb2cc961e
[Frontend] Refactor ServingTokenization entrypoint. ( #46022 )
...
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io >
2026-06-22 06:27:58 +00:00
635c38338a
[Multimodal] Add Qwen2-VL/Qwen2.5-VL processor-mapped video loader ( #45555 )
...
Signed-off-by: Ranran <hzz5361@psu.edu >
Signed-off-by: Ranran Haoran Zhang <ranzhang@redhat.com >
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn >
2026-06-21 18:56:50 +00:00
f57ac274b2
[Render] Add reasoning/tool parsing to /derender + fix byte-fallback FFFD ( #45919 )
...
Signed-off-by: aoshen524 <aoshen524@gmail.com >
Co-authored-by: Martin Hickey <martin.hickey@ie.ibm.com >
2026-06-20 19:43:32 -04:00
891cc4b9c5
[Frontend] Report cache usage in Anthropic /v1/messages API ( #40912 )
...
Signed-off-by: mistral0105 <zhangshuoming17@mails.ucas.ac.cn >
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com >
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com >
2026-06-20 21:12:48 +00:00
ebfbcfe46a
Stop setting CUDA_VISIBLE_DEVICES internally in vLLM, add device_ids arg ( #45026 )
...
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com >
Co-authored-by: Claude <noreply@anthropic.com >
Co-authored-by: Codex <codex@openai.com >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: kourosh hakhamaneshi <kouroshHakha@users.noreply.github.com >
2026-06-20 13:38:10 -07:00
Ben Browning and GitHub
4a8abf37c7
[Test] Migrate test_openai_schema.py to schemathesis 4.x ( #46173 )
...
Signed-off-by: Ben Browning <bbrownin@redhat.com >
2026-06-19 18:05:18 +00:00
69bdd34542
[Bugfix] Fall back to Pydantic loc for param in validation errors ( #46038 )
...
Signed-off-by: professorsab <135441198+professorsab@users.noreply.github.com >
Co-authored-by: Mahad Durrani <114791389+mahadrehmann@users.noreply.github.com >
2026-06-19 19:11:11 +08:00
4ce2d01453
fix(anthropic): auto-detect template support for mid-conversation system messages ( #46025 )
...
Signed-off-by: felix0080 <felix0080@users.noreply.github.com >
Signed-off-by: Ben Browning <bbrownin@redhat.com >
Co-authored-by: felix0080 <felix0080@users.noreply.github.com >
Co-authored-by: Ben Browning <bbrownin@redhat.com >
2026-06-18 16:19:11 -04:00
1e9f04da14
fix(anthropic): preserve inline system message position for prefix caching ( #44602 )
...
Signed-off-by: felix0080 <felix0080@users.noreply.github.com >
Co-authored-by: felix0080 <felix0080@users.noreply.github.com >
2026-06-18 15:58:11 +08:00
Taneem Ibrahim and GitHub
43fa24e832
[Misc] Validate Cohere Embed Mixed Content Payloads ( #45873 )
...
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com >
2026-06-17 06:57:12 +00:00
Taneem Ibrahim and GitHub
81d8f4ebac
[Misc] Added validation for Cohere /v2/embed input field exclusivity ( #45640 )
...
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com >
2026-06-16 05:42:43 +00:00
Flora Feng and GitHub
0d80979644
[Chore] Consolidate reasoning/tool parser attributes into unified Parser in chat serving ( #45548 )
...
Signed-off-by: sfeng33 <4florafeng@gmail.com >
2026-06-15 11:16:45 -04:00
Juan Pérez de Algaba and GitHub
b997071ec4
(security) Enforce audio upload size limit before full file materialization ( #45510 )
...
Signed-off-by: jperezde <jperezde@redhat.com >
2026-06-15 10:25:24 +00:00
Ting SUN and GitHub
48df95c43e
[Feature][Frontend] Report multimodal token counts in usage.prompt_tokens_details ( #45458 )
...
Signed-off-by: Ting Sun <suntcrick@gmail.com >
2026-06-15 05:20:58 +00:00
Taneem Ibrahim and GitHub
2c764c089a
Added real /v1/embeddings support for messages + chat_template_kw ( #45173 )
...
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com >
2026-06-15 09:08:10 +08:00
54bbf51668
[Bugfix] nightly Docker images crash with ImportError: AnthropicOutputConfig since May 28 ( #44795 )
...
Signed-off-by: achyuthan.s <113010327+Achyuthan-S@users.noreply.github.com >
Signed-off-by: Achyuthan S <achyuthan.sivasankar@gmail.com >
Signed-off-by: Achyuthan Sivasankar <achyuthan.sivasankar@gmail.com >
Co-authored-by: Shengqi Chen <harry-chen@outlook.com >
2026-06-13 21:45:29 -07:00
43f0e024bc
[Render] Add /derender endpoints for disaggregated postprocessing ( #43606 )
...
Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com >
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn >
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn >
2026-06-13 13:55:33 +08:00
Andreas Karatzas and GitHub
1033ffac2e
[CI] Wait for SSL cert refresher events in the test ( #45489 )
...
Signed-off-by: Andreas Karatzas <akaratza@amd.com >
2026-06-13 04:57:18 +00:00
WEI CHENG CHIU and GitHub
17ee5b1ac5
[Bugfix] Set type/role explicitly in streaming message_start event ( #45376 )
...
Signed-off-by: Wayne Chiu <waynehacking8@gmail.com >
2026-06-13 01:40:50 +00:00
Flora Feng and GitHub
6e4a547176
[Refactor] Deprecate ResponsesParser wrapper, inline parsing into ParsableContext ( #45431 )
...
Signed-off-by: sfeng33 <4florafeng@gmail.com >
2026-06-12 16:15:41 -04:00
Chauncey and GitHub
3b8fc3fe6d
[Frontend] Support strict mode for tool calling with ResponsesAPI ( #45396 )
...
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com >
2026-06-12 10:59:59 -04:00
Ethan Feng and GitHub
b7f9b6ab27
[Metrics] Add group-aware KV cache capacity to vllm:cache_config_info ( #42206 )
...
The startup log already reports the correct group-aware KV cache capacity for
hybrid models, but Prometheus did not expose matching info in 'vllm:cache_config_info`.
This PR adds kv_cache_size_tokens and kv_cache_max_concurrency.
Signed-off-by: Ethan Feng <ethan.fengch@gmail.com >
2026-06-12 11:49:44 +00:00
2043258dec
[Frontend] Support strict mode for tool calling ( #45003 )
...
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com >
Co-authored-by: cjackal <44624812+cjackal@users.noreply.github.com >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-06-12 07:51:48 +00:00
Ekagra Ranjan and GitHub
226ba9fc9e
[ASR] Add Long Audio benchmark and correctness test ( #44587 )
...
Signed-off-by: Ekagra Ranjan <3116519+ekagra-ranjan@users.noreply.github.com >
2026-06-12 04:11:16 +00:00
42ae5e7ac6
[Bugfix] Fix --enable-prompt-tokens-details omitting zero cached tokens ( #44383 )
...
Signed-off-by: Sasindharan Sankar <sasindharansankar@email.com >
Co-authored-by: Sasindharan Sankar <sasindharansankar@email.com >
Co-authored-by: Chauncey <chaunceyjiang@gmail.com >
2026-06-11 20:37:42 -07:00
yzong-rh and GitHub
e0871ad225
[Refactor] Chat Completions Streaming Harmony Refactor and Bugfixes ( #45104 )
...
Signed-off-by: Yifan Zong <yzong@redhat.com >
2026-06-12 01:09:47 +00:00
yzong-rh and GitHub
f712fd0d7d
[Refactor] Chat Completions Harmony Refactor, non-streaming path. ( #45171 )
...
Signed-off-by: Yifan Zong <yzong@redhat.com >
2026-06-11 21:18:30 +00:00
Ben Browning and GitHub
235b63c004
[Bugfix] Fix Anthropic tool_use content handling dropping args ( #45287 )
...
Signed-off-by: Ben Browning <bbrownin@redhat.com >
2026-06-11 20:01:29 +00:00
Harry Mellor and GitHub
03878d1c22
Deprecations for v0.23 and v0.24 ( #44992 )
...
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
2026-06-11 14:35:38 +00:00
9492362972
[Security] Apply sanitize_message to Anthropic and STT error paths ( #45119 )
...
Signed-off-by: jperezde <jperezde@redhat.com >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-06-11 10:05:34 +00:00
Flora Feng and GitHub
3a04061701
[Refactor][Parser] Unify Response API to use parser.parse() like Chat Completion API ( #45190 )
...
Signed-off-by: sfeng33 <4florafeng@gmail.com >
2026-06-11 04:37:51 +00:00
12f3f19c19
feat(qwen3-asr): support prompt parameter in v1/audio/transcriptions ( #35415 )
...
Signed-off-by: Nathan Price <nathan@abridge.com >
Co-authored-by: Cursor <cursoragent@cursor.com >
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-06-10 19:54:59 +00:00
5828a205ef
Fix Harmony tool descriptions for optional fields ( #44686 )
...
Signed-off-by: Varun Shenoy <varun.vinayak.shenoy@oracle.com >
Co-authored-by: Codex <codex@openai.com >
2026-06-09 23:29:22 -07:00
wang.yuqi and GitHub
996222f4bf
[CI] Reorganize entrypoints CI ( #44947 )
...
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io >
2026-06-09 00:46:11 -07:00
Andreas Karatzas and GitHub
f843ac1a1c
[Bugfix][CI] Gemma3 Transformers multimodal encoder profiling and build prompt-embedding fixtures ( #44952 )
...
Signed-off-by: Andreas Karatzas <akaratza@amd.com >
2026-06-09 05:49:30 +00:00
wang.yuqi and GitHub
93ee4cd47f
[CI] Consolidate multimodal entrypoint tests. ( #44819 )
...
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io >
2026-06-08 04:48:08 -07:00
yzong-rh and GitHub
703fb17b13
[Bugfix] GPT-OSS instruction rendering ( #44330 )
...
Signed-off-by: Yifan Zong <yzong@redhat.com >
2026-06-05 13:52:32 -04:00
6542d48964
[Bugfix] Fix test_invocations flaky failure with newer openai SDK ( #44618 )
...
Signed-off-by: Xu Zhou <xuzhou9417@163.com >
Co-authored-by: Xu Zhou <xuzhou9417@163.com >
2026-06-05 07:36:20 +00:00
wang.yuqi and GitHub
d01d0b4646
[Frontend] Consolidate online serving utils. ( #44479 )
...
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io >
2026-06-04 06:49:31 +00:00
