karylab_agents/vllm
1
0
Fork 0
forked from Karylab-cklius/vllm
Code Pull Requests 2 Actions 1 Packages Activity
17,719 Commits 354 Branches 175 Tags
d2fbaf73c19e2bf519e4e4fc954ec8c14ba1e1fc
Commit Graph
949 Commits
Author SHA1 Message Date
Taneem IbrahimandGitHub 81d8f4ebac [Misc] Added validation for Cohere /v2/embed input field exclusivity (#45640) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
 2026-06-16 05:42:43 +00:00
Flora FengandGitHub 0d80979644 [Chore] Consolidate reasoning/tool parser attributes into unified Parser in chat serving (#45548) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-06-15 11:16:45 -04:00
Juan Pérez de AlgabaandGitHub b997071ec4 (security) Enforce audio upload size limit before full file materialization (#45510) 
Signed-off-by: jperezde <jperezde@redhat.com>
 2026-06-15 10:25:24 +00:00
Ting SUNandGitHub 48df95c43e [Feature][Frontend] Report multimodal token counts in usage.prompt_tokens_details (#45458) 
Signed-off-by: Ting Sun <suntcrick@gmail.com>
 2026-06-15 05:20:58 +00:00
Taneem IbrahimandGitHub 2c764c089a Added real /v1/embeddings support for messages + chat_template_kw (#45173) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
 2026-06-15 09:08:10 +08:00
achyuthan.sGitHubShengqi Chen
 		54bbf51668 [Bugfix] nightly Docker images crash with ImportError: AnthropicOutputConfig since May 28 (#44795) 
Signed-off-by: achyuthan.s <113010327+Achyuthan-S@users.noreply.github.com>
Signed-off-by: Achyuthan S <achyuthan.sivasankar@gmail.com>
Signed-off-by: Achyuthan Sivasankar <achyuthan.sivasankar@gmail.com>
Co-authored-by: Shengqi Chen <harry-chen@outlook.com>
 2026-06-13 21:45:29 -07:00
Martin HickeyGitHubIsotr0py
 		43f0e024bc [Render] Add /derender endpoints for disaggregated postprocessing (#43606) 
Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
 2026-06-13 13:55:33 +08:00
Andreas KaratzasandGitHub 1033ffac2e [CI] Wait for SSL cert refresher events in the test (#45489) 
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
 2026-06-13 04:57:18 +00:00
WEI CHENG CHIUandGitHub 17ee5b1ac5 [Bugfix] Set type/role explicitly in streaming message_start event (#45376) 
Signed-off-by: Wayne Chiu <waynehacking8@gmail.com>
 2026-06-13 01:40:50 +00:00
Flora FengandGitHub 6e4a547176 [Refactor] Deprecate ResponsesParser wrapper, inline parsing into ParsableContext (#45431) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-06-12 16:15:41 -04:00
ChaunceyandGitHub 3b8fc3fe6d [Frontend] Support strict mode for tool calling with ResponsesAPI (#45396) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2026-06-12 10:59:59 -04:00
Ethan FengandGitHub b7f9b6ab27 [Metrics] Add group-aware KV cache capacity to vllm:cache_config_info (#42206) 
The startup log already reports the correct group-aware KV cache capacity for
hybrid models, but Prometheus did not expose matching info in 'vllm:cache_config_info`.

This PR adds kv_cache_size_tokens and kv_cache_max_concurrency.

Signed-off-by: Ethan Feng <ethan.fengch@gmail.com>
 2026-06-12 11:49:44 +00:00
ChaunceyGitHubcjackalmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 		2043258dec [Frontend] Support strict mode for tool calling (#45003) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
Co-authored-by: cjackal <44624812+cjackal@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-06-12 07:51:48 +00:00
Ekagra RanjanandGitHub 226ba9fc9e [ASR] Add Long Audio benchmark and correctness test (#44587) 
Signed-off-by: Ekagra Ranjan <3116519+ekagra-ranjan@users.noreply.github.com>
 2026-06-12 04:11:16 +00:00
sasindharanGitHubSasindharan SankarChauncey
 		42ae5e7ac6 [Bugfix] Fix --enable-prompt-tokens-details omitting zero cached tokens (#44383) 
Signed-off-by: Sasindharan Sankar <sasindharansankar@email.com>
Co-authored-by: Sasindharan Sankar <sasindharansankar@email.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
 2026-06-11 20:37:42 -07:00
yzong-rhandGitHub e0871ad225 [Refactor] Chat Completions Streaming Harmony Refactor and Bugfixes (#45104) 
Signed-off-by: Yifan Zong <yzong@redhat.com>
 2026-06-12 01:09:47 +00:00
yzong-rhandGitHub f712fd0d7d [Refactor] Chat Completions Harmony Refactor, non-streaming path. (#45171) 
Signed-off-by: Yifan Zong <yzong@redhat.com>
 2026-06-11 21:18:30 +00:00
Ben BrowningandGitHub 235b63c004 [Bugfix] Fix Anthropic tool_use content handling dropping args (#45287) 
Signed-off-by: Ben Browning <bbrownin@redhat.com>
 2026-06-11 20:01:29 +00:00
Harry MellorandGitHub 03878d1c22 Deprecations for v0.23 and v0.24 (#44992) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-06-11 14:35:38 +00:00
Juan Pérez de AlgabaGitHubmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 		9492362972 [Security] Apply sanitize_message to Anthropic and STT error paths (#45119) 
Signed-off-by: jperezde <jperezde@redhat.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-06-11 10:05:34 +00:00
Flora FengandGitHub 3a04061701 [Refactor][Parser] Unify Response API to use parser.parse() like Chat Completion API (#45190) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-06-11 04:37:51 +00:00
Nathan PriceGitHubCursorCyrus Leungmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 		12f3f19c19 feat(qwen3-asr): support prompt parameter in v1/audio/transcriptions (#35415) 
Signed-off-by: Nathan Price <nathan@abridge.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-06-10 19:54:59 +00:00
Varun Vinayak ShenoyGitHubCodex
 		5828a205ef Fix Harmony tool descriptions for optional fields (#44686) 
Signed-off-by: Varun Shenoy <varun.vinayak.shenoy@oracle.com>
Co-authored-by: Codex <codex@openai.com>
 2026-06-09 23:29:22 -07:00
wang.yuqiandGitHub 996222f4bf [CI] Reorganize entrypoints CI (#44947) 
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
 2026-06-09 00:46:11 -07:00
Andreas KaratzasandGitHub f843ac1a1c [Bugfix][CI] Gemma3 Transformers multimodal encoder profiling and build prompt-embedding fixtures (#44952) 
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
 2026-06-09 05:49:30 +00:00
wang.yuqiandGitHub 93ee4cd47f [CI] Consolidate multimodal entrypoint tests. (#44819) 
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
 2026-06-08 04:48:08 -07:00
yzong-rhandGitHub 703fb17b13 [Bugfix] GPT-OSS instruction rendering (#44330) 
Signed-off-by: Yifan Zong <yzong@redhat.com>
 2026-06-05 13:52:32 -04:00
XuZhouGitHubXu Zhou
 		6542d48964 [Bugfix] Fix test_invocations flaky failure with newer openai SDK (#44618) 
Signed-off-by: Xu Zhou <xuzhou9417@163.com>
Co-authored-by: Xu Zhou <xuzhou9417@163.com>
 2026-06-05 07:36:20 +00:00
wang.yuqiandGitHub d01d0b4646 [Frontend] Consolidate online serving utils. (#44479) 
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
 2026-06-04 06:49:31 +00:00
Ted MostlyandGitHub 0c1e6f63f5 [Bugfix] Fix VLLMNotFoundError when using LoRA adapter name in poolin… (#44410) 
Signed-off-by: Ted Mostly <wanghenshui@qq.com>
 2026-06-04 02:22:03 +00:00
William RomGitHubmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 		f0204358d9 [Bugfix] fix crash in postprocess for null tool args (#43862) 
Signed-off-by: William-Rom <william.rom@intility.no>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-06-02 22:17:26 -07:00
ChaunceyGitHubAleksandar YanakievAng Kah Min, Kelvin <syraxius@hotmail.com>
 		ed9a7526b6 [Anthropic] Support system role messages inside messages array (#44283) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
Co-authored-by: Aleksandar Yanakiev <alexander.yanakiev@discretestack.com>
Co-authored-by: Ang Kah Min, Kelvin <syraxius@hotmail.com>
 2026-06-02 18:13:54 +00:00
wang.yuqiandGitHub b623f7ea95 [Frontend] Consolidate dev entrypoints. (#44170) 
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
 2026-06-02 06:30:21 -07:00
albertoandGitHub e30313220c [Parser] Migrate ResponsesParser to unified Parser interface (#42977) 
Signed-off-by: Alberto Perdomo <aperdomo@redhat.com>
 2026-06-02 08:50:05 +00:00
Flora FengandGitHub 68dafcca75 [Refactor] Unify reasoning + tool-call parsing behind Parser.parse() (#44267) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-06-02 15:11:42 +08:00
Andreas KaratzasandGitHub 54d0c36fff [CI] Stabilize OpenAI schema fuzzing for malformed structural tags (#44131) 
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
 2026-06-01 19:56:15 -07:00
Flora FengandGitHub 9affc17a05 [Refactor] Move unstreamed tool-arg flush from serving layer to parser (#44017) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-06-02 10:37:43 +08:00
Siddharth BedekarGitHubOpenAI Codex
 		266b9d9c64 [Frontend][Core] Add sparse NCCL weight transfer support for in-place updates (#40096) 
Signed-off-by: Siddharth Bedekar <bedeksid@gmail.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
 2026-06-01 15:37:30 -04:00
Chaojun ZhangandGitHub bd0aecdc08 [XPU][CI] Fix test_audio_in_video flake by using module-scoped server fixture (#44146) 
Signed-off-by: Chaojun Zhang <chaojun.zhang@intel.com>
 2026-06-01 11:21:36 +00:00
wang.yuqiandGitHub 0910f7e0e1 [Frontend] Resettle generative scoring entrypoint. (#44153) 
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
 2026-06-01 07:54:59 +00:00
Flora FengandGitHub 8c6daf6e2f [CI] Remove duplicate Harmony test coverage (#44023) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-05-29 22:52:46 +00:00
Wentao YeandGitHub 5dbf1605a0 [Feature] SSL support for dp supervisor (#43688) 
Signed-off-by: yewentao256 <zhyanwentao@126.com>
 2026-05-29 19:28:12 +00:00
Flora FengandGitHub 6de08e8b46 [CI] Remove redundant test_chat_with_tool_reasoning.py (#44011) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-05-29 19:23:56 +00:00
ChaunceyandGitHub d692b89c2c [Feature] Add structured output and effort support to Anthropic Messages API (#42396) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2026-05-28 12:06:48 +00:00
Ignacio SicaGitHubsfeng33
 		7909f82a45 [Bugfix][Frontend] streaming tool-call serializer drops first args chunk when name and args share a DeltaMessage (#42683) 
Signed-off-by: ignaciosica <mignacio.sica@gmail.com>
Signed-off-by: sfeng33 <4florafeng@gmail.com>
Co-authored-by: sfeng33 <4florafeng@gmail.com>
 2026-05-28 05:20:55 +00:00
Nick HillandGitHub 626fa9bba5 [BugFix] Fix blocked reasoning parsing with MRV2 (#43808) 
Signed-off-by: Nick Hill <nickhill123@gmail.com>
 2026-05-28 04:59:34 +00:00
Ashwin GiridharanGitHubChauncey
 		52a31ccecc [Bugfix] Map reasoning_effort to enable_thinking in chat template kwargs (#43401) 
Signed-off-by: Ashwin Giridharan <girida@amazon.com>
Signed-off-by: Chauncey <chaunceyjiang@gmail.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
 2026-05-27 05:39:49 -07:00
Vadim GimpelsonGitHubgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 		812e7e7364 [Bugfix][V1] Fix TOCTOU race causing intermittent EADDRINUSE on multi-API-server DP startup (#42585) 
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
Signed-off-by: Vadim Gimpelson <156319763+vadiklyutiy@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-05-26 14:06:00 -07:00
linzm1007GitHubmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 		739af5c7e1 [Reasoning] [Bugfix] Reject invalid thinking_token_budget values (#43402) 
Signed-off-by: linzm1007 <linzm1007@126.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-05-26 03:37:30 -07:00
wang.yuqiGitHubgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 		d5cf7b4a2c [Frontend] Split the offline inference APIs and utils. (#43553) 
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-05-26 05:20:24 +00:00