karylab_agents/vllm
1
0
Fork 0
forked from Karylab-cklius/vllm
Code Pull Requests 2 Actions 1 Packages Activity
17,781 Commits 354 Branches 175 Tags
ee04cef6e7dfbdfd5a30b91b851b33ce85574378
Commit Graph
17781 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Tyler Michael SmithandClaude Opus 4.6 ee04cef6e7 [CI] Pin schemathesis<4 to fix test_openai_schema.py collection failure 
schemathesis v4 (released 2025-06-10) removed the `GenerationConfig`
class from its public API.  The test imports it as
`from schemathesis import GenerationConfig`, which breaks at collection
time with `ImportError: cannot import name 'GenerationConfig'`.

The requirements files specified `schemathesis>=3.39.15` with no upper
bound, so CI resolves the latest (v4.x) and fails.  Pin to `<4` in all
four input/unpinned requirements files (cuda.in, rocm.in, xpu.in,
nightly-torch.txt) to keep the v3 API the test relies on.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
 2026-06-19 20:38:01 -04:00
Mark McLoughlinandGitHub bf2a393034 Temporarily remove @markmc from CODEOWNERS (#46053) 
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
 2026-06-18 14:15:43 +00:00
Tiezhen WANGGitHubClaude
 		d682968aa9 [Model] Remove BambaForCausalLM (#45990) 
Signed-off-by: Xianbao QIAN <xianbao.qian@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
 2026-06-18 06:51:00 -07:00
lyd1992GitHubYuanSheng
 		021cdf72bc Fix _riscv_supports_rvv_vlen128() to detect RVV on hardware without zvl flags (#43179) 
Signed-off-by: liuyudong <liuyudong@iscas.ac.cn>
Co-authored-by: YuanSheng <yuansheng@isrc.iscas.ac.cn>
 2026-06-18 21:22:35 +08:00
AsharandGitHub 4cb5e746b6 [Rust Frontend]: Add /get_world_size route with static parallel size (#44801) 2026-06-18 13:10:20 +00:00
Jee Jee LiandGitHub 22cc891108 [Kernel] Add PDL support for DeepGEMM kernel (#46006) 
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
 2026-06-18 20:49:01 +08:00
Tuukka SarviGitHubganyiCursorMarkus HartikainenJin Tao
 		afdcbd5d39 [ROCm][DSv4] Functional fixes for DeepSeek V4 on MI300X/MI325X (#45681) 
Signed-off-by: ganyi <ygan@amd.com>
Signed-off-by: Markus Hartikainen <markus.hartikainen@amd.com>
Signed-off-by: Tuukka Sarvi <tuukka.sarvi@amd.com>
Co-authored-by: ganyi <ygan@amd.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Markus Hartikainen <markus.hartikainen@amd.com>
Co-authored-by: Jin Tao <jintao12@amd.com>
 2026-06-18 12:21:14 +00:00
AlexHuangGitHubClaudeKunshang Jimergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 		8d4f54966c fix(quantization): Fix AWQ dequantize on Intel XPU and refactor AutoAWQ config (#42727) 
Signed-off-by: Alex <alex.tech.lab@outlook.com>
Signed-off-by: AlexHuang <jihuihuang@tencent.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-06-18 20:12:28 +08:00
Jonathan MamouGitHubLi, Jiang <jiang1.li@intel.com>
 		351c72d6e5 [CPU] Skip Triton kernel monkey-patches when Triton-CPU is available (#44991) 
Signed-off-by: jmamou <jonathan.mamou@intel.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
 2026-06-18 18:59:30 +08:00
Tahsin TunanandGitHub 7299e6509e [Rust Frontend] Return model metadata fields in /v1/models (#45950) 
Signed-off-by: Tahsin Tunan <tahsintunan@gmail.com>
 2026-06-18 10:29:21 +00:00
littlecircle0730andGitHub 08985351f3 Fix Stale Encoder Cache After Weight Update (#45093) 
Signed-off-by: littlecircle0730 <littlecircle0730@gmail.com>
 2026-06-18 09:32:10 +00:00
Wei ZhaoandGitHub 5fd3b276f8 [Mooncake] Skip KV lookup for non-reachable SWA blocks (#45444) 
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
 2026-06-18 02:23:20 -07:00
MrFanGitHubfelix0080
 		1e9f04da14 fix(anthropic): preserve inline system message position for prefix caching (#44602) 
Signed-off-by: felix0080 <felix0080@users.noreply.github.com>
Co-authored-by: felix0080 <felix0080@users.noreply.github.com>
 2026-06-18 15:58:11 +08:00
Ting SUNGitHubmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 		702214146c [Bugfix][Frontend] Fix Anthropic count_tokens decorator order driving server load negative (#44725) 
Signed-off-by: Ting Sun <suntcrick@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-06-17 23:56:46 -07:00
liuzhenweiGitHubmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 		a331589394 [XPU] Update nixl to v0.10.1 in Dockerfile (#40287) 
Signed-off-by: zhenwei-intel <zhenwei.liu@intel.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-06-18 14:01:26 +08:00
Micah WilliamsonandGitHub e945169207 Revert "[Kernel] Add PDL support for DeepGEMM kernel" (#45999) 2026-06-17 22:59:48 -07:00
AlexHuangGitHubOr Ozeri
 		554352a311 [Test][KV Connector] Add request_finished fence population tests for offloading scheduler (#45679) 
Signed-off-by: Alex <alex.tech.lab@outlook.com>
Signed-off-by: AlexHuang <jihuihuang@future.com>
Co-authored-by: Or Ozeri <oro@il.ibm.com>
 2026-06-18 08:13:52 +03:00
AlexHuangGitHubOr Ozeri
 		421c1ec448 [KV Offloading] Remove dummy worker-side stats from OffloadingConnector (#45905) 
Signed-off-by: Alex <alex.tech.lab@outlook.com>
Signed-off-by: AlexHuang <jihuihuang@alexai.com>
Co-authored-by: Or Ozeri <oro@il.ibm.com>
 2026-06-18 08:13:28 +03:00
Wentao YeGitHubShengqi Chen
 		b4c80ec0fd [Refactor] Remove dead cutlass mxfp8 code (#44681) 
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Shengqi Chen <harry-chen@outlook.com>
 2026-06-17 21:18:25 -07:00
Ronen SchafferandGitHub f428718ffe [Fix][KV offload] Defer on_request_finished until in-flight transfers drain (#45823) 
Signed-off-by: Ronen Schaffer <ronen.schaffer@ibm.com>
 2026-06-18 07:05:46 +03:00
Jee Jee LiandGitHub 4403af8fb5 [Kernel] Add PDL support for DeepGEMM kernel (#42996) 
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
 2026-06-17 20:37:17 -07:00
Jonathan ChenGitHubmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 		d57888efa4 [SimpleCPUOffloadConnector]: Add support for reset_cache() (#39726) 
Signed-off-by: Jonathan Chen <chenleejonathan@gmail.com>
Signed-off-by: Jonathan <chenleejonathan@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-06-17 19:47:12 -07:00
Varun Sundar RabindranathGitHubVarun Sundar Rabindranath
 		ed938ad7db [CPUOffloading] Guard CPU eviction check (#45757) 
Signed-off-by: Varun Sundar Rabindranath <varun-sundar-rabindranath@h100-01.nemg-001.lab.rdu2.dc.redhat.com>
Co-authored-by: Varun Sundar Rabindranath <varun-sundar-rabindranath@h100-01.nemg-001.lab.rdu2.dc.redhat.com>
 2026-06-18 05:34:59 +03:00
ReidandGitHub 731fb3323d [Rust Frontend] Validate tokenized bad_words vocabulary range (#45876) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
 2026-06-18 02:28:45 +00:00
Yejing LaiGitHubKunshang Ji
 		8dd8b6ed78 [XPU] Fix FP8 block-scaled scheme selection on non-CUDA platforms (#43958) 
Signed-off-by: Lai, Yejing <yejing.lai@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
 2026-06-18 10:16:20 +08:00
Bugen ZhaoGitHubmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 		e1a5fc406b [Rust Frontend][Perf] O(n) argument scan in tool parser (#45826) 
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
 2026-06-18 01:42:35 +00:00
Ace EldeibandGitHub b4092176b9 [Bugfix] Complete one-shot fused all-reduce PDL at end to avoid NaN (#45448) 2026-06-18 00:54:39 +00:00
Jee Jee LiandGitHub ebbb2d55ac [CI/Build][Bugfix] Fix SD LoRA (#45941) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
 2026-06-18 00:34:15 +00:00
liuzhenweiandGitHub 2959a9273a [XPU][CI] add model runner v2 into CI (#44650) 
Signed-off-by: zhenwei-intel <zhenwei.liu@intel.com>
 2026-06-18 00:28:34 +00:00
Woosuk KwonGitHubClaude Opus 4.8
 		1797576237 Revert "[DSV4 Perf] Optimize dsv4 cudagraph by reducing eager_break_during_capture" (#45309) (#45972) 
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
 2026-06-17 17:20:59 -07:00
Bryan ShanGitHubwaynehacking8
 		0d339cf135 [Bugfix] Fix NixlConnector handshake block_len validation for GQA-replicated KV heads (#45879) 
Signed-off-by: Oseltamivir <58582368+Oseltamivir@users.noreply.github.com>
Co-authored-by: waynehacking8 <waynehacking8@gmail.com>
 2026-06-17 15:11:29 -07:00
shanjiazGitHubshanjiaz
 		5fd21eb0b2 [BUG] fix hidden states nan for hybrid attention models (#45849) 
Signed-off-by: shanjiaz <hezhao@redhat.com>
Co-authored-by: shanjiaz <hezhao@redhat.com>
 2026-06-17 18:02:24 -04:00
Ting SUNandGitHub 9d4b87f4f0 [Bugfix][Model] Validate DefaultModelLoader / LoadConfig and fail with clear errors (#45196) 
Signed-off-by: Ting Sun <suntcrick@gmail.com>
 2026-06-17 21:46:33 +00:00
Luciano MartinsGitHubLuciano Martins
 		58b2e89642 [Bugfix][Gemma4] Render reasoning on assistant turns without tool_calls (#45867) 
Signed-off-by: Luciano Martins <lucianommartins@users.noreply.github.com>
Co-authored-by: Luciano Martins <lucianommartins@users.noreply.github.com>
 2026-06-17 20:44:15 +00:00
Wentao YeandGitHub 2659f60a1a [Refactor] Remove dead quantization code and tests (#45454) 
Signed-off-by: yewentao256 <zhyanwentao@126.com>
 2026-06-17 16:12:01 -04:00
wangjiaxin99GitHubTJianDouglas Lehr
 		091386a99b [Bugfix] MiniMax-M3 (AMD): add packed_modules_mapping and pass swiglu… (#45794) 
Signed-off-by: wangjiaxin99 <jiaxwang@amd.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
Co-authored-by: Douglas Lehr <91553416+dllehr-amd@users.noreply.github.com>
 2026-06-17 19:15:46 +00:00
qli88andGitHub d112eb1ac7 [feature] MiniMax-M3-MXFP4 support added (#45896) 
Signed-off-by: Qiang Li <qiang.li2@amd.com>
 2026-06-17 18:50:48 +00:00
Wentao YeandGitHub 2a47a9ff0f [DSV4 Perf] Optimize dsv4 cudagraph by reducing eager_break_during_capture, 26.8% ~ 27.9% E2E TTFT improvement (#45309) 
Signed-off-by: yewentao256 <zhyanwentao@126.com>
 2026-06-17 09:34:53 -07:00
Wentao YeandGitHub 9c7c74bf10 [Log] Update deepgemm log (#45857) 
Signed-off-by: yewentao256 <zhyanwentao@126.com>
 2026-06-17 15:34:22 +00:00
daniserebandGitHub 5e27b2baf4 [Bugfix] Pass TP group to FlashInfer all-reduce fusion (#45917) 
Signed-off-by: Daniel Serebrenik <daserebrenik@nvidia.com>
 2026-06-17 15:24:26 +00:00
zhanqiuhuandGitHub eb0fdeb1e8 [Bugfix][PD] Fix DSV4 disaggregated serving (#45831) 
Signed-off-by: ZhanqiuHu <zhu@redhat.com>
 2026-06-17 15:17:14 +00:00
Xiaohong (Sean) ChenGitHubYanan Cao
 		46f74e144b [Kernel][Helion][1/N] Add Helion kernel for rms_norm_dynamic_per_token_quant (#34432) 
Signed-off-by: Sean Chen <seachen@redhat.com>
Co-authored-by: Yanan Cao <gmagogsfm@gmail.com>
 2026-06-17 23:03:54 +08:00
Wentao YeandGitHub 0a7bacdcac [DSv4 Perf] DSv4 flashinfer sparse index cache for metadata, 2%~4% TTFT improvement (#45863) 
Signed-off-by: yewentao256 <zhyanwentao@126.com>
 2026-06-17 10:55:48 -04:00
amirkl94andGitHub 8b2b566ea7 Feature: Enable Flashinfer non-gated MoE bf16 (#43853) 
Signed-off-by: Amir Klein <203507526+amirkl94@users.noreply.github.com>
 2026-06-17 14:32:49 +00:00
xaguilar-amdandGitHub 0b131b16c9 [ROCm][AITER][Quark] Tag per-channel FP8 weights as PER_CHANNEL so AITER pre-shuffled GEMM is selected (#44626) 
Signed-off-by: Xavier Aguilar <xavier.aguilarfruto@amd.com>
 2026-06-17 14:05:34 +00:00
Yi LiuGitHubn1ck-guoZhenzhong1
 		bcb518ad7a [quant][autoround]Refactor INC quantization into package with INCScheme orchestrator (#40601) 
Signed-off-by: yiliu30 <yi4.liu@intel.com>
Signed-off-by: Zhenzhong1 <zhenzhong.xu@intel.com>
Signed-off-by: Zhenzhong Xu <zhenzhong.xu@intel.com>
Co-authored-by: n1ck-guo <heng.guo@intel.com>
Co-authored-by: Zhenzhong1 <zhenzhong.xu@intel.com>
 2026-06-17 21:51:32 +08:00
Chaojun ZhangandGitHub 06e1e0885c [XPU] Fix test_logprobs_e2e import error: pin lm-eval[api]>=0.4.12 (#44469) 
Signed-off-by: Chaojun Zhang <chaojun.zhang@intel.com>
 2026-06-17 12:26:47 +00:00
Isotr0pyandGitHub 1a59078c87 [CI/Build] Avoid duplicate ViT CG test introduced by accident (#45654) 
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
 2026-06-17 12:23:44 +00:00
Oğuzhan KIRandGitHub fa85ead2f3 [MM][Perf][CG] Support ViT full CUDA graph for Kimi-VL (#41992) 
Signed-off-by: oguz <oguzhankir17@gmail.com>
 2026-06-17 12:14:01 +00:00
Hongxia YangGitHubtjtanaa
 		e28e8c8782 [ROCm][Quant] Minimax-M3: Enable fp8_per_channel for bf16 weights on mi300x (#45854) 
Signed-off-by: Hongxia Yang <hongxia.yang@amd.com>
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: tjtanaa <tunjian.tan@embeddedllm.com>
 2026-06-17 12:02:40 +00:00