karylab_agents/vllm
1
0
Fork 0
forked from Karylab-cklius/vllm
Code Pull Requests 2 Actions 1 Packages Activity
18,973 Commits 354 Branches 175 Tags
b8fb56d970a4fa2a8d668d7e09ee5c7fbb7b680b
Commit Graph
6578 Commits
Author SHA1 Message Date
Michael GoinandGitHub b8fb56d970 [CI] Add gemma-4-E4B-it-assistant to CI gsm8k for GemmaMTP (#49243) 
Signed-off-by: mgoin <mgoin64@gmail.com>
 2026-07-21 16:51:04 -04:00
rasmithGitHubAndreas Karatzas
 		60d443f738 [CI/Build][The Rock][BugFix] Use fork method in test_multiproc_executor_multi_node for py 3.14 compat and fix test_multiproc_executor_shutdown_cleanup (#48655) 
Signed-off-by: Randall Smith <Randall.Smith@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
 2026-07-21 15:40:29 -05:00
Nick HillGitHubClaude Opus 4.8
 		1dca300653 [CI] Fix and wire encoder/manager cudagraph unit tests (#49339) 
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
 2026-07-21 20:41:16 +01:00
Flora FengandGitHub fca252d59e [CI][Bugfix] Reduce max_model_len in OOT embedding test to fix KV-cache OOM on small GPUs (#49351) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-07-21 15:00:06 -04:00
Nick HillGitHubClaude Opus 4.8
 		de6ec294ef [Bugfix] Fix DSA crash under breakable piecewise cudagraphs (#49302) 
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
 2026-07-21 18:28:13 +01:00
stefankoncarevicandGitHub 61e10f0116 [ROCm][CI] Fix AITER MLA fp8 decode metadata regression test (#48845) 
Signed-off-by: Stefan Koncarevic <Stefan.Koncarevic@amd.com>
 2026-07-21 12:19:45 -05:00
Michael GoinGitHubJoe Rowell
 		47f1b47a73 Ci/add laguna xs gsm8k (#49241) 
Signed-off-by: Joe Rowell <joerowell4@gmail.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Joe Rowell <joerowell4@gmail.com>
 2026-07-21 11:30:42 -04:00
Stefano CastagnettaGitHubBenjamin Chislett
 		5812e1a66b [Test] Add DeepSeek MTP parallel-load tests (#41653) 
Signed-off-by: Stefano Castagnetta <scastagnetta@nvidia.com>
Co-authored-by: Benjamin Chislett <bchislett@nvidia.com>
 2026-07-21 10:38:20 -04:00
Seiji EicherGitHubLixi ZhangharjothkharaClaude Opus 4.8Nick Hill
 		8950394e0a [Bugfix] Prefix-cache metrics double-counted when a KV connector defers requests (#48860) 
Signed-off-by: Seiji Eicher <58963096+eicherseiji@users.noreply.github.com>
Signed-off-by: Seiji Eicher <seiji@anyscale.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Lixi Zhang <muxixibbb@gmail.com>
Co-authored-by: harjothkhara <harjoth.khara@gmail.com>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
 2026-07-21 15:02:03 +01:00
Ilya MarkovGitHubMarkov Ilya
 		f890e1dbe2 [BugFix] Set graph_pool_id before FULL CUDA graph capture in ModelRunner V2 (#48843) 
Signed-off-by: Markov Ilya <markovilya19@gmail.com>
Co-authored-by: Markov Ilya <markovilya19@gmail.com>
 2026-07-21 08:59:26 -04:00
bastefaniakandGitHub 4d30c510ce [bugfix] Fix Cosmos3 Edge checkpoint weights filtering, video loading, prompt expansion (#49190) 
Signed-off-by: Bartosz Stefaniak <bstefaniak@nvidia.com>
 2026-07-21 17:18:36 +08:00
Lucas WilkinsonGitHubClaudeOpenAI Codex
 		6700813f86 [3/N][KV-Cache Layout Refactor] Standardize Mamba cache; drop get_transfer_cache_regions (#44456) 
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
 2026-07-21 09:16:15 +00:00
Nicolò LucchesiandGitHub 7a98c7a392 [Misc] Remove old now unsupported max_num_partial_prefills and max_long_partial_prefills (#49244) 
Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai>
 2026-07-21 08:52:52 +00:00
vllm-agentGitHubvllm-agent
 		1134545b6f Revert "[Sampler] Stop upcasting logits to fp32 in apply_sampling_params" (#48641) (#49033) 
Co-authored-by: vllm-agent <vllm-agent@users.noreply.github.com>
 2026-07-21 09:36:45 +01:00
aoshen02GitHubaoshen02Codex
 		d9aa35161d Update BGE-M3 token expectations for leading spaces (#49269) 
Signed-off-by: aoshen02 <aoshen02@users.noreply.github.com>
Co-authored-by: aoshen02 <aoshen02@users.noreply.github.com>
Co-authored-by: Codex <noreply@openai.com>
 2026-07-21 03:49:17 +00:00
Andreas KaratzasGitHubOpenAI Codex
 		6bcda970fd [CI][NIXL] Isolate concurrent engine internal ports (#49129) 
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
 2026-07-20 22:28:11 -05:00
ChaunceyandGitHub 94ed0bf4e0 [Bugfix][KV Offloading] Handle queued request aborts without allocated KV blocks (#49146) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2026-07-21 11:16:26 +08:00
Simon MoandGitHub 72d16aee15 [CI] Exercise FA3 FP8 attention on SM90 (#49231) 
Signed-off-by: Simon Mo <simon@inferact.ai>
 2026-07-21 10:26:55 +08:00
ormandjGitHubLuke AlonsoMartin VitClaudeYifan Qiao
 		2e2e626b40 [Bugfix] Count per-group blocks in get_max_concurrency_for_kv_cache_config (#48317) 
Signed-off-by: David Orman <ormandj@corenode.com>
Co-authored-by: Luke Alonso <lalonso@gmail.com>
Co-authored-by: Martin Vit <martin@voipmonitor.org>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Yifan Qiao <yifanqiao@inferact.ai>
 2026-07-21 00:29:10 +00:00
sungsoo haGitHubClaude Opus 4.8Lucas WilkinsonMatthew Bonanni
 		2396a61108 [Attention][MLA][DCP] Query replication for MLA decode (DeepSeek-V2/R1 + Kimi-K2.5) (#45964) 
Signed-off-by: Sungsoo Ha <sungsooh@nvidia.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
 2026-07-20 23:51:27 +00:00
Xuanyu ZhangGitHubClaudeaoshen02OpenAI Codex
 		97a668152b [RL Infra][FlashInfer] Enable router replay output from FlashInfer monolithic MoE kernel (#44214) 
Signed-off-by: Xuanyu Zhang <xuanyu.zhang@mistral.ai>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: OpenAI Codex <noreply@openai.com>
 2026-07-20 16:45:10 -07:00
Matthew BonanniGitHubhaosdentClaude Opus 4.7Justin Wood
 		58b2012aa2 [copy of #45208] CuMem slept-L1 fragmentation accounting (#49208) 
Signed-off-by: haosdent <haosdent@gmail.com>
Signed-off-by: Justin Wood <justin.m.wood@me.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: haosdent <haosdent@gmail.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Co-authored-by: Justin Wood <jwood@me.com>
 2026-07-20 23:08:11 +00:00
Charlie FuandGitHub 5feb3950e5 [ROCm][CI] fix test_rocm_quick_reduce.py (#49234) 
Signed-off-by: charlifu <charlifu@amd.com>
 2026-07-20 16:39:33 -05:00
Oxana KorzhGitHubCursorokorzh-amdMatthew Bonanni
 		4ec199b66a [Bugfix][Spec-Decode] Populate draft seq_lens_cpu_upper_bound for spec-decode attention metadata (#44492) 
Signed-off-by: Oxana Korzh <okorzh@amd.com>
Signed-off-by: okorzh-amd <okorzh-amd@users.noreply.github.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: okorzh-amd <okorzh-amd@users.noreply.github.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
 2026-07-20 20:50:58 +00:00
Roberto L. CastroGitHubmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 		7ca017778f [Feat][Perf] Add new warmup infrastructure for JITs (#47451) 
Signed-off-by: LopezCastroRoberto <rocastro@redhat.com>
Signed-off-by: Roberto L. Castro <38211239+LopezCastroRoberto@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-07-20 13:21:55 -07:00
coltonottleyGitHubColton OttleyOr Ozeri
 		fbfe58133d [Bugfix][KV Offload] Preserve reachable tails for hybrid SWA groups (#48911) 
Signed-off-by: Colton Ottley <colton@ottleyengineering.com>
Co-authored-by: Colton Ottley <colton@ottleyengineering.com>
Co-authored-by: Or Ozeri <oro@il.ibm.com>
 2026-07-20 22:12:36 +03:00
wkutakGitHubIsotr0pyRoger Wang
 		9dd62d80ab Cosmos3 FP8 ModelOpt/Diffusers remapping (#48952) 
Signed-off-by: Wojciech Kutak <wkutak@nvidia.com>
Signed-off-by: wkutak <wkutak@nvidia.com>
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
 2026-07-20 11:31:48 -07:00
Matthew BonanniGitHubmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 		bd091079cb [Attention] FlashAttention 4 SM100 FP8 kv cache support (#42569) 
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-07-20 10:53:27 -07:00
Isotr0pyandGitHub 15cb8e140d [Multimodal] Allow keeping original image mode for ImageIO (#49159) 
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
 2026-07-20 13:42:45 +00:00
Chang GuoGitHubOpenAI Codex
 		f007cceb42 [KV Offload] Support self-describing KV events with TieringOffloadingSpec (#48679) 
Signed-off-by: Change72 <changg@nvidia.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
 2026-07-20 16:41:58 +03:00
wangqianGitHubOpenAI Codex
 		0a5069e4e3 [Bugfix][Gemma4] Fix ModelOpt mixed-precision MoE config mapping (#48563) 
Signed-off-by: wangqian <601731555@qq.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
 2026-07-20 06:39:28 -07:00
hclandGitHub 530ee36a0d fix(openai): reject non-numeric logprobs with 400 instead of 500 (#49144) 
Signed-off-by: Chenglun Hu <chenglunhu@gmail.com>
 2026-07-20 10:04:50 +00:00
aoshen02andGitHub 9459fc6471 [Bugfix][RL] Set vLLM config during weight reload (#45989) 
Signed-off-by: aoshen02 <aoshen@inferact.ai>
 2026-07-20 15:02:56 +08:00
Akash kaothalkarGitHubAkash KaothalkarAkash KaothalkarAkash KaothalkarAkash kaothalkarLi, Jiang <jiang1.li@intel.com>
 		5c9f6557d7 [Hardware][CPU] Enable granite-4 model on cpu (#47641) 
Signed-off-by: Akash Kaothalkar <akashkaothalkar@akashs-mbp.bl1-in.ibm.com>
Signed-off-by: Akash Kaothalkar <akashkaothalkar@dhcp-9-123-5-76.bl1-in.ibm.com>
Signed-off-by: Akash Kaothalkar <akashkaothalkar@Akashs-MBP.lan>
Signed-off-by: Akash kaothalkar <akash.kaothalkar@ibm.com>
Co-authored-by: Akash Kaothalkar <akashkaothalkar@dhcp-9-123-5-76.bl1-in.ibm.com>
Co-authored-by: Akash Kaothalkar <akashkaothalkar@Akashs-MBP.lan>
Co-authored-by: Akash Kaothalkar <akashkaothalkar@akashs-mbp.bl1-in.ibm.com>
Co-authored-by: Akash kaothalkar <akash.kaothalkar@ibm.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
 2026-07-20 06:15:16 +00:00
aoshen02GitHubmvanhornClaude Opus 4.6mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 		dcfebf93f4 [Bugfix] Fix logprobs token-string collision from SentencePiece space… (#48674) 
Signed-off-by: Allen Shen <aoshen@inferact.ai>
Co-authored-by: mvanhorn <mvanhorn@users.noreply.github.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-07-20 12:17:18 +08:00
Andreas KaratzasGitHubOpenAI Codex
 		752bd10647 [ROCm][CI] Fix sparse MLA metadata sync fixture (#49128) 
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
 2026-07-19 23:02:03 -05:00
Kevin H. LuuGitHubSimon MoOpenAI CodexOpenAI Codex
 		1dcbbd9cac [CI] Move compatible 1xL4 jobs to H200 35GB MIG (#43024) 
Signed-off-by: Simon Mo <simon@inferact.ai>
Co-authored-by: Simon Mo <simon@inferact.ai>
Co-authored-by: OpenAI Codex <noreply@openai.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
 2026-07-19 19:21:25 -07:00
Taneem IbrahimandGitHub e6d1310b2a [Bugfix] Reject removed pooling parameters (#48984) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
 2026-07-19 05:18:03 -07:00
yzong-rhandGitHub ac5f38a0f7 [Refactor] Extract StructuredOutputsParams creation logic from Request.to_sampling_params (#49003) 
Signed-off-by: Yifan Zong <yzong@redhat.com>
 2026-07-19 05:18:00 -07:00
Lucas WilkinsonGitHubCodexOpenAI CodexMatthew Bonanni
 		b6ff8a2f50 [Core] Add MRV2 virtual-batch PCP for MLA (#46570) 
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Codex <noreply@openai.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
 2026-07-19 02:53:15 +00:00
Andreas KaratzasandGitHub df362b2d6d [ROCm][CI] Ensure sliding window tests release GPU memory (#49055) 
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
 2026-07-18 20:44:05 +00:00
yzong-rhandGitHub a287eb163f [Front-end] [Messages] Populate num_cache_creation_tokens (#48535) 
Signed-off-by: Yifan Zong <yzong@redhat.com>
 2026-07-18 13:04:35 -04:00
Kevin H. LuuGitHubSimon MoOpenAI Codex
 		29c0ec4d63 [ci] Move 3 entrypoints tests to h200_35gb queue (#43164) 
Signed-off-by: Simon Mo <simon@inferact.ai>
Signed-off-by: Simon Mo <simon@simon-mac-mini-9.local>
Co-authored-by: Simon Mo <simon@inferact.ai>
Co-authored-by: OpenAI Codex <noreply@openai.com>
 2026-07-18 08:43:49 -07:00
xuebwang-amdandGitHub f12b80c6ef [ROCm][Bugfix] Fix GPT-OSS Quark MXFP4 MoE loading - emulation buffer not block-aligned (#43979) 
Signed-off-by: xuebwang-amd <xuebwang@amd.com>
 2026-07-18 03:49:41 +00:00
Michael GoinGitHubmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>Nick Hill
 		425c4eafb0 [Sampler] Stop upcasting logits to fp32 in apply_sampling_params (#48641) 
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
 2026-07-17 18:15:20 -07:00
Michael GoinandGitHub 02c01f442b [Model] Use standard ModelOpt config for Inkling NVFP4 (#48990) 
Signed-off-by: mgoin <mgoin64@gmail.com>
 2026-07-17 18:13:14 -07:00
aoshen02GitHubWojciech WaisFederico Kamelhar
 		41ea2dd44a [Bugfix][V1/V2] Fix prompt_logprobs to respect logprobs_mode (#47680) 
Signed-off-by: Wojciech Wais <wojciech.wais@gmail.com>
Signed-off-by: Federico Kamelhar <209537060+fede-kamel@users.noreply.github.com>
Signed-off-by: Allen Shen <aoshen@inferact.ai>
Co-authored-by: Wojciech Wais <wojciech.wais@gmail.com>
Co-authored-by: Federico Kamelhar <209537060+fede-kamel@users.noreply.github.com>
 2026-07-17 21:58:59 +01:00
devalshahamdGitHubDeval Shah
 		fcd2255d16 [Hardware][GPU] Profiler config additional to increase it scope and annotation details (#37524) 
Signed-off-by: devalshahamd <deval.shah@amd.com>
Signed-off-by: Deval Shah <devashah@amd.com>
Signed-off-by: Deval Shah <deval.shah@amd.com>
Co-authored-by: Deval Shah <devashah@amd.com>
 2026-07-17 13:38:59 -07:00
Wentao YeandGitHub b5433b6f50 [Perf] Optimize dsv4 routing using specialized kernel, 2.94% E2E TPOT improvement (#48660) 
Signed-off-by: yewentao256 <zhyanwentao@126.com>
 2026-07-17 13:35:06 -07:00
Michael GoinGitHubOpenAI Codex
 		cc25f028b7 [Loader] Improve InstantTensor loading (#46868) 
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
 2026-07-17 16:30:02 -04:00