karylab_agents/vllm
1
0
Fork 0
forked from Karylab-cklius/vllm
Code Pull Requests 2 Actions 1 Packages Activity
17,559 Commits 354 Branches 175 Tags
a014dddbaa67661236a8a7d0dc3d5773d4e0f60a
Commit Graph
17559 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Chris LeonardGitHubShengqi Chen
 		a014dddbaa [11b/n] Migrate Machete kernels to torch stable ABI (#45304) 
Signed-off-by: Chris Leonard <chleonar@redhat.com>
Signed-off-by: Shengqi Chen <harry-chen@outlook.com>
Co-authored-by: Shengqi Chen <harry-chen@outlook.com>
 2026-06-12 10:36:49 +00:00
Thomas ParnellandGitHub a37b4a940e [Doc] AGENTS.md: add section about coding style (#45301) 
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
 2026-06-12 06:23:04 -04:00
Juan Pérez de AlgabaandGitHub f715f25f29 Fix misleading error for audio duration limit rejection (#45113) 
Signed-off-by: jperezde <jperezde@redhat.com>
 2026-06-12 09:58:08 +00:00
Fynn Schmitt-UlmsandGitHub 462ef83d58 Update hidden states extraction integration test triggers (#45294) 
Signed-off-by: Fynn Schmitt-Ulms <fschmitt@redhat.com>
 2026-06-12 01:05:19 -07:00
JinYan SuGitHubClaude Fable 5
 		1ae1051b4b [Bugfix][Rust Frontend] Return 400 for prompt-validation submit errors (#45286) 
Signed-off-by: xiaguan <751080330@qq.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-06-12 07:53:11 +00:00
ChaunceyGitHubcjackalmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 		2043258dec [Frontend] Support strict mode for tool calling (#45003) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
Co-authored-by: cjackal <44624812+cjackal@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-06-12 07:51:48 +00:00
Michael GoinGitHubClaude Fable 5
 		bd59c913bc [CI] ci-fetch-log.sh: fetch all failed jobs from a build URL or PR number (#45274) 
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-06-12 00:42:18 -07:00
Ma JianGitHubmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 		04cec9e4d8 [XPU][DeepSeek-V4] Fix MTP: sync with upstream fixes #44821 and #43746 (#45240) 
Signed-off-by: Ma Jian <jian1.ma@intel.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-06-12 15:41:36 +08:00
Will EatonandGitHub 87b98d6d6c [Rust Frontend][Bugfix] Forward --shutdown-timeout and --disable-log-stats to the managed Python engine (#45300) 
Signed-off-by: Will Eaton <weaton@redhat.com>
 2026-06-12 07:39:27 +00:00
Yuwen ZhouandGitHub 0cd9b7af25 [CPU] Support CPU W4A16 INT4 MoE (#43409) 
Signed-off-by: yuwenzho <yuwen.zhou@intel.com>
 2026-06-12 07:12:37 +00:00
Isotr0pyandGitHub a2c72d4388 [Bugfix] Fix Dockerfile dependency graph pre-commit error (#45374) 
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
 2026-06-12 07:10:18 +00:00
Rohan PotdarandGitHub fe04238292 [ROCm][gpt-oss] Pass GateMode.INTERLEAVE for MXFP4 W4A16 fused MoE (#44893) 
Signed-off-by: Rohan Potdar <rohan.potdar@amd.com>
Signed-off-by: Rohan138 <rohanpotdar138@gmail.com>
Signed-off-by: Rohan Potdar <66227218+Rohan138@users.noreply.github.com>
 2026-06-12 01:02:04 -05:00
allgatherGitHubIsotr0py
 		39dee1114a [MM][Perf][CG] Support ViT full cudagraphs for mllama4 (#40660) 
Signed-off-by: allgather <all2allops@gmail.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
 2026-06-11 22:17:55 -07:00
+1
Lucas WilkinsonGitHubMartin KuklaMatthew BonanniDipika SikkaNickLucchejiahancAlec KohlhoffPorras HuangClaudescoootscooob
 		eb28452b10 [Model] Add DiffusionGemma Support (#45163) 
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Martin Kukla <martin.kukla@cantab.net>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Dipika Sikka <dsikka@redhat.com>
Co-authored-by: NickLucche <nlucches@redhat.com>
Co-authored-by: jiahanc <173873397+jiahanc@users.noreply.github.com>
Co-authored-by: Alec Kohlhoff <134344302+aleckohlhoff@users.noreply.github.com>
Co-authored-by: Porras Huang <20535584+porrashuang@users.noreply.github.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: scoootscooob <167050519+scoootscooob@users.noreply.github.com>
 2026-06-11 22:17:35 -07:00
Divakar VermaandGitHub 1ce3cdc5c1 [ROCm][CI] fix fp8 support for test_deepep_moe (#45302) 
Signed-off-by: Divakar Verma <divakar.verma@amd.com>
 2026-06-12 00:16:14 -05:00
Dao007foreverandGitHub 6fbfdd1831 [NIXL] Per-region KV transfer classification for mixed full-attn + MLA groups (#44583) 2026-06-11 21:42:41 -07:00
Chris LeonardandGitHub 7021be66e8 [11a/n] Migrate Marlin kernels to torch stable ABI (#45176) 
Signed-off-by: Chris Leonard <chleonar@redhat.com>
 2026-06-11 21:22:37 -07:00
Ekagra RanjanandGitHub 226ba9fc9e [ASR] Add Long Audio benchmark and correctness test (#44587) 
Signed-off-by: Ekagra Ranjan <3116519+ekagra-ranjan@users.noreply.github.com>
 2026-06-12 04:11:16 +00:00
Varun Sundar RabindranathGitHubvarun sundar rabindranath
 		b927004c44 [Bugfix] Mamba CPU Offloading (#44599) 
Signed-off-by: varun sundar rabindranath <vsundarr@redhat.com>
Co-authored-by: varun sundar rabindranath <vsundarr@redhat.com>
 2026-06-11 21:07:35 -07:00
Ekagra RanjanGitHubmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 		e0b9fb1290 [ASR] Optimize CPU preproc to get 2.5x RTFx via multi-threading (#44612) 
Signed-off-by: Ekagra Ranjan <3116519+ekagra-ranjan@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-06-11 21:05:11 -07:00
sasindharanGitHubSasindharan SankarChauncey
 		42ae5e7ac6 [Bugfix] Fix --enable-prompt-tokens-details omitting zero cached tokens (#44383) 
Signed-off-by: Sasindharan Sankar <sasindharansankar@email.com>
Co-authored-by: Sasindharan Sankar <sasindharansankar@email.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
 2026-06-11 20:37:42 -07:00
Nick HillandGitHub 2263f8a3de [CI][BugFix] Fix broken test_mamba_prefix_cache.py due to stale mock (#45345) 
Signed-off-by: Nick Hill <nickhill123@gmail.com>
 2026-06-12 03:26:17 +00:00
Ting SUNandGitHub c1076839c9 [Bugfix][Model] Pass revision by name in Run:ai and bitsandbytes index downloads (#45308) 
Signed-off-by: Ting Sun <suntcrick@gmail.com>
 2026-06-11 20:21:46 -07:00
Fangzhou AiGitHubvLLM Contributor
 		fcf5115c45 [ROCm][DSv4][Perf] Flash-decode split-K decode attention kernel (#44899) 
Co-authored-by: vLLM Contributor <contributor@vllm.ai>
 2026-06-12 03:17:52 +00:00
littlecircle0730GitHubHsiao-Yuan ChenOr Ozeri
 		4bc83323f2 [Bugfix] OffloadingConnector: respect skip_reading_prefix_cache flag (#44592) 
Signed-off-by: Hsiao-Yuan Chen <hy.c@Hsiao-YuandeMacBook-Pro.local>
Signed-off-by: littlecircle0730 <littlecircle0730@gmail.com>
Signed-off-by: littlecircle0730 <43994952+littlecircle0730@users.noreply.github.com>
Co-authored-by: Hsiao-Yuan Chen <hy.c@Hsiao-YuandeMacBook-Pro.local>
Co-authored-by: Or Ozeri <or@ozery.com>
 2026-06-12 02:20:39 +00:00
yzong-rhandGitHub e0871ad225 [Refactor] Chat Completions Streaming Harmony Refactor and Bugfixes (#45104) 
Signed-off-by: Yifan Zong <yzong@redhat.com>
 2026-06-12 01:09:47 +00:00
jpwangGitHubmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 		6f573f486b [Bugfix] Initialize missing attributes in mistral eagle (#45217) 
Signed-off-by: jpwang <jpwang@smail.nju.edu.cn>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-06-12 08:21:01 +08:00
Neil SchemenauerandGitHub 9bbf42be26 Make mistral_common optional by deferring MistralToolCall import (#45305) 
Signed-off-by: Neil Schemenauer <nas@arctrix.com>
 2026-06-11 22:59:11 +00:00
Dao007foreverGitHubClaude
 		8a91228dbe [Bugfix][KVConnector][Mooncake] Close MooncakeDistributedStore on connector teardown (#45206) 
Signed-off-by: Dao Le <Dao007forever@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
 2026-06-11 14:33:48 -07:00
yzong-rhandGitHub f712fd0d7d [Refactor] Chat Completions Harmony Refactor, non-streaming path. (#45171) 
Signed-off-by: Yifan Zong <yzong@redhat.com>
 2026-06-11 21:18:30 +00:00
Wentao YeandGitHub 5a6c7b7ab5 [Bug] Fix test flashmla for DSv4 (#45052) 
Signed-off-by: yewentao256 <zhyanwentao@126.com>
 2026-06-11 16:22:26 -04:00
Tiezhen WANGGitHubClaude
 		c9340e6f35 [Model] Remove InternLMForCausalLM registry alias (#45128) 
Signed-off-by: Xianbao QIAN <xianbao.qian@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
 2026-06-11 20:02:51 +00:00
Ben BrowningandGitHub 235b63c004 [Bugfix] Fix Anthropic tool_use content handling dropping args (#45287) 
Signed-off-by: Ben Browning <bbrownin@redhat.com>
 2026-06-11 20:01:29 +00:00
Chao-Ju ChenGitHubBugen Zhao
 		3b03a2cf47 [Rust Frontend] Support continuous_usage_stats stream option (#43965) 
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Signed-off-by: RickyChen / 陳昭儒 <ricky.chen@infinirc.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
 2026-06-11 17:50:59 +00:00
wentian-byteandGitHub b8142294b7 [Bugfix] Restrict FlashInfer cuDNN FP8 ViT attention gate to Blackwell (SM 100) (#45251) 
Signed-off-by: Wentian Byte <3400259131@qq.com>
 2026-06-11 16:39:24 +00:00
Xiaohong (Sean) ChenGitHubYanan Caomergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 		2ec6594db9 [Kernel][Helion][1/N] Add Helion kernel for per_token_group_fp8_quant (#36902) 
Signed-off-by: Sean Chen <seachen@redhat.com>
Co-authored-by: Yanan Cao <gmagogsfm@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-06-11 08:59:08 -07:00
vraitiandGitHub 79f8c5bd8c [Metrics] Scope unregister_vllm_metrics() to strictly "vllm:" metrics (#42331) 
`unregister_vllm_metrics()` currently uses "vllm" in `collector._name` to decide
which collectors to remove from the Prometheus registry, removing every even
metrics registered by other subsystems or downstream extensions like "vllm_omni:"

Signed-off-by: vraiti <vraiti@redhat.com>
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
 2026-06-11 15:43:14 +00:00
Jiangyun ZhuandGitHub f81daf8880 [Attention] add triton diff-kv backend for mimo (#41797) 
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
 2026-06-11 11:36:31 -04:00
Nick HillGitHubClaude Opus 4.8
 		4085ff7cb4 [Core] Add kvcache watermark to reduce preemptions (#44594) 
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
 2026-06-11 08:27:31 -07:00
fangyuchuGitHubTyler Michael Smith
 		23eb7c8fbb [Bugfix] Fix NixlEPAll2AllManager's dependency on --enable-elastic-ep to function (#44422) 
Signed-off-by: fangyuchu <fangyuchu@qq.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
 2026-06-11 08:14:49 -07:00
wineandchordandGitHub c2b4cd39ac [Doc][Attention] Fix MLA top-of-file comments (#37047) 
Signed-off-by: wineandchord <guoqizhou19@gmail.com>
 2026-06-11 08:14:45 -07:00
Kai K.andGitHub f1d8d99717 [Bugfix] CohereModel.load_weights: skip modelopt _quantizer.* keys (#43495) 
Signed-off-by: Kai Köhler <kai.koehler@web.de>
 2026-06-11 08:14:21 -07:00
Nicolò LucchesiandGitHub 750aab5b8e [Bugfix] Fix CPU memory leak related to not cleaning up old remotes data (#44424) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2026-06-11 07:54:52 -07:00
Michael GoinGitHubClaude
 		5edf7ff489 [Core] Release cached device memory under pressure on UMA GPUs during weight loading (#45179) 
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
 2026-06-11 17:49:50 +03:00
Natalie LinGitHubHarry Mellor
 		b78fc47f05 [Docs] Add redirect for moved lmcache examples page (#45218) 
Signed-off-by: nataliepjlin <nataliepjlin@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-06-11 10:41:08 -04:00
Harry MellorandGitHub 03878d1c22 Deprecations for v0.23 and v0.24 (#44992) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-06-11 14:35:38 +00:00
zhanqiuhuGitHublHrHenry233underfituu
 		55911db580 [PD][Core] Fix Mamba prefix cache hit rate in PD disaggregation (#44243) 
Co-authored-by: lHrHenry233 <2381623149@qq.com>
Co-authored-by: underfituu <hzhucong@163.com>
Signed-off-by: Zhanqiu Hu <zhu@redhat.com>
 2026-06-11 14:10:25 +00:00
Will EatonGitHubBugen Zhaomergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 		cc640ee8bc [Rust Frontend][Metrics] Export vllm:lora_requests_info from frontend (#45030) 
Signed-off-by: Will Eaton <weaton@redhat.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-06-11 06:45:03 -07:00
Fynn Schmitt-UlmsGitHubmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 		ebc6ef971a Hidden states extraction improvements (#43805) 
Signed-off-by: Fynn Schmitt-Ulms <fschmitt@redhat.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-06-11 09:44:45 -04:00
tc-mbandGitHub ab3a1fd2e6 minicpmv4_6: fix ImageSize (W,H) order for placeholder token calculation (#45244) 
Signed-off-by: tc-mb <tianchi_cai@icloud.com>
 2026-06-11 13:43:56 +00:00