635c38338a
[Multimodal] Add Qwen2-VL/Qwen2.5-VL processor-mapped video loader ( #45555 )
...
Signed-off-by: Ranran <hzz5361@psu.edu >
Signed-off-by: Ranran Haoran Zhang <ranzhang@redhat.com >
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn >
2026-06-21 18:56:50 +00:00
f57ac274b2
[Render] Add reasoning/tool parsing to /derender + fix byte-fallback FFFD ( #45919 )
...
Signed-off-by: aoshen524 <aoshen524@gmail.com >
Co-authored-by: Martin Hickey <martin.hickey@ie.ibm.com >
2026-06-20 19:43:32 -04:00
891cc4b9c5
[Frontend] Report cache usage in Anthropic /v1/messages API ( #40912 )
...
Signed-off-by: mistral0105 <zhangshuoming17@mails.ucas.ac.cn >
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com >
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com >
2026-06-20 21:12:48 +00:00
ebfbcfe46a
Stop setting CUDA_VISIBLE_DEVICES internally in vLLM, add device_ids arg ( #45026 )
...
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com >
Co-authored-by: Claude <noreply@anthropic.com >
Co-authored-by: Codex <codex@openai.com >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: kourosh hakhamaneshi <kouroshHakha@users.noreply.github.com >
2026-06-20 13:38:10 -07:00
Ben Browning and GitHub
4a8abf37c7
[Test] Migrate test_openai_schema.py to schemathesis 4.x ( #46173 )
...
Signed-off-by: Ben Browning <bbrownin@redhat.com >
2026-06-19 18:05:18 +00:00
69bdd34542
[Bugfix] Fall back to Pydantic loc for param in validation errors ( #46038 )
...
Signed-off-by: professorsab <135441198+professorsab@users.noreply.github.com >
Co-authored-by: Mahad Durrani <114791389+mahadrehmann@users.noreply.github.com >
2026-06-19 19:11:11 +08:00
4ce2d01453
fix(anthropic): auto-detect template support for mid-conversation system messages ( #46025 )
...
Signed-off-by: felix0080 <felix0080@users.noreply.github.com >
Signed-off-by: Ben Browning <bbrownin@redhat.com >
Co-authored-by: felix0080 <felix0080@users.noreply.github.com >
Co-authored-by: Ben Browning <bbrownin@redhat.com >
2026-06-18 16:19:11 -04:00
1e9f04da14
fix(anthropic): preserve inline system message position for prefix caching ( #44602 )
...
Signed-off-by: felix0080 <felix0080@users.noreply.github.com >
Co-authored-by: felix0080 <felix0080@users.noreply.github.com >
2026-06-18 15:58:11 +08:00
Taneem Ibrahim and GitHub
43fa24e832
[Misc] Validate Cohere Embed Mixed Content Payloads ( #45873 )
...
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com >
2026-06-17 06:57:12 +00:00
Taneem Ibrahim and GitHub
81d8f4ebac
[Misc] Added validation for Cohere /v2/embed input field exclusivity ( #45640 )
...
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com >
2026-06-16 05:42:43 +00:00
Flora Feng and GitHub
0d80979644
[Chore] Consolidate reasoning/tool parser attributes into unified Parser in chat serving ( #45548 )
...
Signed-off-by: sfeng33 <4florafeng@gmail.com >
2026-06-15 11:16:45 -04:00
Juan Pérez de Algaba and GitHub
b997071ec4
(security) Enforce audio upload size limit before full file materialization ( #45510 )
...
Signed-off-by: jperezde <jperezde@redhat.com >
2026-06-15 10:25:24 +00:00
Ting SUN and GitHub
48df95c43e
[Feature][Frontend] Report multimodal token counts in usage.prompt_tokens_details ( #45458 )
...
Signed-off-by: Ting Sun <suntcrick@gmail.com >
2026-06-15 05:20:58 +00:00
Taneem Ibrahim and GitHub
2c764c089a
Added real /v1/embeddings support for messages + chat_template_kw ( #45173 )
...
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com >
2026-06-15 09:08:10 +08:00
54bbf51668
[Bugfix] nightly Docker images crash with ImportError: AnthropicOutputConfig since May 28 ( #44795 )
...
Signed-off-by: achyuthan.s <113010327+Achyuthan-S@users.noreply.github.com >
Signed-off-by: Achyuthan S <achyuthan.sivasankar@gmail.com >
Signed-off-by: Achyuthan Sivasankar <achyuthan.sivasankar@gmail.com >
Co-authored-by: Shengqi Chen <harry-chen@outlook.com >
2026-06-13 21:45:29 -07:00
43f0e024bc
[Render] Add /derender endpoints for disaggregated postprocessing ( #43606 )
...
Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com >
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn >
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn >
2026-06-13 13:55:33 +08:00
Andreas Karatzas and GitHub
1033ffac2e
[CI] Wait for SSL cert refresher events in the test ( #45489 )
...
Signed-off-by: Andreas Karatzas <akaratza@amd.com >
2026-06-13 04:57:18 +00:00
WEI CHENG CHIU and GitHub
17ee5b1ac5
[Bugfix] Set type/role explicitly in streaming message_start event ( #45376 )
...
Signed-off-by: Wayne Chiu <waynehacking8@gmail.com >
2026-06-13 01:40:50 +00:00
Flora Feng and GitHub
6e4a547176
[Refactor] Deprecate ResponsesParser wrapper, inline parsing into ParsableContext ( #45431 )
...
Signed-off-by: sfeng33 <4florafeng@gmail.com >
2026-06-12 16:15:41 -04:00
Chauncey and GitHub
3b8fc3fe6d
[Frontend] Support strict mode for tool calling with ResponsesAPI ( #45396 )
...
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com >
2026-06-12 10:59:59 -04:00
Ethan Feng and GitHub
b7f9b6ab27
[Metrics] Add group-aware KV cache capacity to vllm:cache_config_info ( #42206 )
...
The startup log already reports the correct group-aware KV cache capacity for
hybrid models, but Prometheus did not expose matching info in 'vllm:cache_config_info`.
This PR adds kv_cache_size_tokens and kv_cache_max_concurrency.
Signed-off-by: Ethan Feng <ethan.fengch@gmail.com >
2026-06-12 11:49:44 +00:00
2043258dec
[Frontend] Support strict mode for tool calling ( #45003 )
...
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com >
Co-authored-by: cjackal <44624812+cjackal@users.noreply.github.com >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-06-12 07:51:48 +00:00
Ekagra Ranjan and GitHub
226ba9fc9e
[ASR] Add Long Audio benchmark and correctness test ( #44587 )
...
Signed-off-by: Ekagra Ranjan <3116519+ekagra-ranjan@users.noreply.github.com >
2026-06-12 04:11:16 +00:00
42ae5e7ac6
[Bugfix] Fix --enable-prompt-tokens-details omitting zero cached tokens ( #44383 )
...
Signed-off-by: Sasindharan Sankar <sasindharansankar@email.com >
Co-authored-by: Sasindharan Sankar <sasindharansankar@email.com >
Co-authored-by: Chauncey <chaunceyjiang@gmail.com >
2026-06-11 20:37:42 -07:00
yzong-rh and GitHub
e0871ad225
[Refactor] Chat Completions Streaming Harmony Refactor and Bugfixes ( #45104 )
...
Signed-off-by: Yifan Zong <yzong@redhat.com >
2026-06-12 01:09:47 +00:00
yzong-rh and GitHub
f712fd0d7d
[Refactor] Chat Completions Harmony Refactor, non-streaming path. ( #45171 )
...
Signed-off-by: Yifan Zong <yzong@redhat.com >
2026-06-11 21:18:30 +00:00
Ben Browning and GitHub
235b63c004
[Bugfix] Fix Anthropic tool_use content handling dropping args ( #45287 )
...
Signed-off-by: Ben Browning <bbrownin@redhat.com >
2026-06-11 20:01:29 +00:00
Harry Mellor and GitHub
03878d1c22
Deprecations for v0.23 and v0.24 ( #44992 )
...
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com >
2026-06-11 14:35:38 +00:00
9492362972
[Security] Apply sanitize_message to Anthropic and STT error paths ( #45119 )
...
Signed-off-by: jperezde <jperezde@redhat.com >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-06-11 10:05:34 +00:00
Flora Feng and GitHub
3a04061701
[Refactor][Parser] Unify Response API to use parser.parse() like Chat Completion API ( #45190 )
...
Signed-off-by: sfeng33 <4florafeng@gmail.com >
2026-06-11 04:37:51 +00:00
12f3f19c19
feat(qwen3-asr): support prompt parameter in v1/audio/transcriptions ( #35415 )
...
Signed-off-by: Nathan Price <nathan@abridge.com >
Co-authored-by: Cursor <cursoragent@cursor.com >
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-06-10 19:54:59 +00:00
5828a205ef
Fix Harmony tool descriptions for optional fields ( #44686 )
...
Signed-off-by: Varun Shenoy <varun.vinayak.shenoy@oracle.com >
Co-authored-by: Codex <codex@openai.com >
2026-06-09 23:29:22 -07:00
wang.yuqi and GitHub
996222f4bf
[CI] Reorganize entrypoints CI ( #44947 )
...
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io >
2026-06-09 00:46:11 -07:00
Andreas Karatzas and GitHub
f843ac1a1c
[Bugfix][CI] Gemma3 Transformers multimodal encoder profiling and build prompt-embedding fixtures ( #44952 )
...
Signed-off-by: Andreas Karatzas <akaratza@amd.com >
2026-06-09 05:49:30 +00:00
wang.yuqi and GitHub
93ee4cd47f
[CI] Consolidate multimodal entrypoint tests. ( #44819 )
...
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io >
2026-06-08 04:48:08 -07:00
yzong-rh and GitHub
703fb17b13
[Bugfix] GPT-OSS instruction rendering ( #44330 )
...
Signed-off-by: Yifan Zong <yzong@redhat.com >
2026-06-05 13:52:32 -04:00
6542d48964
[Bugfix] Fix test_invocations flaky failure with newer openai SDK ( #44618 )
...
Signed-off-by: Xu Zhou <xuzhou9417@163.com >
Co-authored-by: Xu Zhou <xuzhou9417@163.com >
2026-06-05 07:36:20 +00:00
wang.yuqi and GitHub
d01d0b4646
[Frontend] Consolidate online serving utils. ( #44479 )
...
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io >
2026-06-04 06:49:31 +00:00
Ted Mostly and GitHub
0c1e6f63f5
[Bugfix] Fix VLLMNotFoundError when using LoRA adapter name in poolin… ( #44410 )
...
Signed-off-by: Ted Mostly <wanghenshui@qq.com >
2026-06-04 02:22:03 +00:00
f0204358d9
[Bugfix] fix crash in postprocess for null tool args ( #43862 )
...
Signed-off-by: William-Rom <william.rom@intility.no >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2026-06-02 22:17:26 -07:00
ed9a7526b6
[Anthropic] Support system role messages inside messages array ( #44283 )
...
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com >
Co-authored-by: Aleksandar Yanakiev <alexander.yanakiev@discretestack.com >
Co-authored-by: Ang Kah Min, Kelvin <syraxius@hotmail.com >
2026-06-02 18:13:54 +00:00
wang.yuqi and GitHub
b623f7ea95
[Frontend] Consolidate dev entrypoints. ( #44170 )
...
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io >
2026-06-02 06:30:21 -07:00
alberto and GitHub
e30313220c
[Parser] Migrate ResponsesParser to unified Parser interface ( #42977 )
...
Signed-off-by: Alberto Perdomo <aperdomo@redhat.com >
2026-06-02 08:50:05 +00:00
Flora Feng and GitHub
68dafcca75
[Refactor] Unify reasoning + tool-call parsing behind Parser.parse() ( #44267 )
...
Signed-off-by: sfeng33 <4florafeng@gmail.com >
2026-06-02 15:11:42 +08:00
Andreas Karatzas and GitHub
54d0c36fff
[CI] Stabilize OpenAI schema fuzzing for malformed structural tags ( #44131 )
...
Signed-off-by: Andreas Karatzas <akaratza@amd.com >
2026-06-01 19:56:15 -07:00
Flora Feng and GitHub
9affc17a05
[Refactor] Move unstreamed tool-arg flush from serving layer to parser ( #44017 )
...
Signed-off-by: sfeng33 <4florafeng@gmail.com >
2026-06-02 10:37:43 +08:00
266b9d9c64
[Frontend][Core] Add sparse NCCL weight transfer support for in-place updates ( #40096 )
...
Signed-off-by: Siddharth Bedekar <bedeksid@gmail.com >
Co-authored-by: OpenAI Codex <codex@openai.com >
2026-06-01 15:37:30 -04:00
Chaojun Zhang and GitHub
bd0aecdc08
[XPU][CI] Fix test_audio_in_video flake by using module-scoped server fixture ( #44146 )
...
Signed-off-by: Chaojun Zhang <chaojun.zhang@intel.com >
2026-06-01 11:21:36 +00:00
wang.yuqi and GitHub
0910f7e0e1
[Frontend] Resettle generative scoring entrypoint. ( #44153 )
...
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io >
2026-06-01 07:54:59 +00:00
Flora Feng and GitHub
8c6daf6e2f
[CI] Remove duplicate Harmony test coverage ( #44023 )
...
Signed-off-by: sfeng33 <4florafeng@gmail.com >
2026-05-29 22:52:46 +00:00
