karylab_agents/vllm
1
0
Fork 0
forked from Karylab-cklius/vllm
Code Pull Requests 2 Actions 2 Packages Activity
18,238 Commits 354 Branches 175 Tags
aa3f2efe425ac51e2967e9fbbec4edebaa62f685
Commit Graph
18238 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Shengqi Chen aa3f2efe42 [Temp] Cherry-pick #47139 to fix build 
Signed-off-by: Shengqi Chen <harry-chen@outlook.com>
 2026-06-30 19:38:28 +08:00
Shengqi ChenandCodex a32d1bff95 [Doc] Document CUDA wheel architecture coverage 
Explain that pre-built CUDA wheels use the architecture lists selected by the release and build pipelines, which may be narrower than the full set vLLM can build from source.

Call out CUDA 12.9 architecture-specific wheel coverage, CUDA 13 family-specific targets, and the no-kernel-image error users may see when a wheel does not cover their GPU.

Co-authored-by: Codex <codex@openai.com>

Signed-off-by: Shengqi Chen <harry-chen@outlook.com>
 2026-06-30 19:27:42 +08:00
Shengqi ChenandCodex ee47a21fcd [Build] Warn on uncovered CUDA device architectures 
Expose the compiled CUDA arch list from the stable extension and check visible CUDA devices against it during CUDA platform startup. The runtime check distinguishes exact architecture targets from CUDA 13 family targets so users get an early warning before hitting missing kernel images.

The startup warning is limited to the NVML-backed CUDA platform path to preserve the existing no-CUDA-init import behavior for non-NVML environments.

Co-authored-by: Codex <codex@openai.com>

Signed-off-by: Shengqi Chen <harry-chen@outlook.com>
 2026-06-30 19:27:42 +08:00
Shengqi ChenandCodex 0f471a3088 [Build] Scope stable CUDA kernel feature macros 
Keep optional stable CUDA kernel feature macros on the source files that consume them instead of adding them to VLLM_GPU_FLAGS. This avoids perturbing unrelated compile commands and invalidating more cache entries when optional kernel families change.

Also align CUTLASS grouped MoE support with the SM10x/SM11x family so Thor works under both CUDA 12 SM101 and CUDA 13 SM110 reporting, and remove the stale ENABLE_CUTLASS_MLA definition left after the old CUTLASS MLA path was deleted.

Co-authored-by: Codex <codex@openai.com>

Signed-off-by: Shengqi Chen <harry-chen@outlook.com>
 2026-06-30 19:27:42 +08:00
Chaojun ZhangandGitHub ea9ddf59fc [XPU][CI] Enable shared loader test (#45977) 
Signed-off-by: Chaojun Zhang <chaojun.zhang@intel.com>
 2026-06-30 11:20:33 +00:00
Cheng JiangGitHubchengvjiangAndreas Karatzas
 		8cf7c4d8ad [Attention Backend] add HPC-Ops Attention backend (#46020) 
Signed-off-by: chengvjiang <chengvjiang@tencent.com>
Co-authored-by: chengvjiang <chengvjiang@tencent.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
 2026-06-30 18:17:43 +08:00
Agata DobrzyniewiczGitHubKunshang Ji
 		8e9d70fdd5 [Kernel][XPU] Adjust kernel unit tests for XPU (#45140) 
Signed-off-by: Dobrzyniewicz, Agata <agata.dobrzyniewicz@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
 2026-06-30 09:57:27 +00:00
Juan Pérez de AlgabaandGitHub 364ee36af1 fix(security): prevent image decompression bomb OOM denial of service (#47010) 
Signed-off-by: jperezde <jperezde@redhat.com>
 2026-06-30 09:39:22 +00:00
Nicolò LucchesiandGitHub 06fae69114 [Misc] Mistral label alert (#47132) 
Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai>
 2026-06-30 09:02:07 +00:00
Li, JiangGitHubHarry Mellor
 		14f8660a18 [CI/Build] Add CPU test dependency pre-commit hooks (#47032) 
Signed-off-by: jiang1.li <jiang1.li@intel.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-06-30 07:59:13 +00:00
Aman PaswanGitHubamanambakChauncey
 		aed541def4 [Bugfix][Responses] Set completed status for Harmony function calls (#46945) 
Signed-off-by: amanambak <aman.paswan@ambak.com>
Co-authored-by: amanambak <aman.paswan@ambak.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
 2026-06-30 07:55:14 +00:00
ChaunceyGitHubmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 		2bc20e8aba [Frontend] Add Streaming Parser Engine and new Kimi k2.5/k2.6/k2.7 Parser (#46610) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-06-30 07:53:17 +00:00
Chaojun ZhangandGitHub 8cc242335d [XPU] Optimize XPU worker shutdown logic to prevent resource leak (#46433) 
Signed-off-by: Chaojun Zhang <chaojun.zhang@intel.com>
 2026-06-30 15:27:21 +08:00
Andreas KaratzasandGitHub ba22cb6765 [ROCm][Ray][CI] Keep assigned GPU visible for weight transfer (#47000) 
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
 2026-06-30 14:59:18 +08:00
Uros MarkovicandGitHub 81bcced482 [Bugfix][ROCm] Preserve MoE weight padding for unquantized Triton path (#46381) 
Signed-off-by: Uros Markovic <umarkovi@amd.com>
 2026-06-30 14:47:57 +08:00
Kunshang JiandGitHub fb42e5219e [Platform] Replace torch.cuda.mem_get_info with torch.accelerator.get_memory_info (#44825) 
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
 2026-06-30 14:39:52 +08:00
Dakai AnandGitHub 0feca7ffa8 PD disagg with Mooncake Connector: GDN support (Qwen3.5) and MLA support (Deepseek-V4-Flash) (#46807) 2026-06-29 23:29:04 -07:00
Muhammad FawazGitHubMahad Durrani
 		97b5ce5c39 [Bugfix] Raise VLLMValidationError for non-integer logit_bias keys (#46612) 
Signed-off-by: muhammadfawaz1 <135441198+muhammadfawaz1@users.noreply.github.com>
Co-authored-by: Mahad Durrani <114791389+mahadrehmann@users.noreply.github.com>
 2026-06-30 06:18:59 +00:00
Andreas KaratzasandGitHub 4236514098 [ROCm][CI][Multimodal] Use ROCm-aware FA availability check for Unlimited-OCR (#47004) 
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
 2026-06-30 14:03:13 +08:00
Blas Rodriguez IrizarandGitHub e45c8a9f4b [Rust Frontend] Start current wave for a stale DP FirstRequest (#46833) 
Signed-off-by: Blas Rodriguez Irizar <rodrigblas@gmail.com>
 2026-06-30 05:13:09 +00:00
Wei ZhaoandGitHub b153dd3f28 [Bugfix] Use larger workspace size for Flashinfer MLA LSE (#47074) 
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
 2026-06-29 22:11:03 -07:00
ReidandGitHub 930f8dc0a1 [Bugfix][Rust Frontend] Reject prompt_logprobs for streaming generate (#46839) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
 2026-06-30 05:10:07 +00:00
ReidandGitHub a16dbd5b85 [Rust Frontend] Avoid LoRA registry scans without active LoRA requests (#47040) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
 2026-06-30 04:58:19 +00:00
liranschourGitHubOr OzeriOr Ozeri
 		bec232a914 Secondary tier implementation for PD disaggregation (#42285) 
Signed-off-by: Liran Schour <lirans@il.ibm.com>
Signed-off-by: liranschour <liranschour@users.noreply.github.com>
Co-authored-by: Or Ozeri <or@ozery.com>
Co-authored-by: Or Ozeri <oro@il.ibm.com>
 2026-06-30 07:51:44 +03:00
linitra24GitHubJee Jee Li
 		b5c9e1ac33 [LoRA] Add language-backbone LoRA support for MiniCPM-V 4.6 (#46740) 
Signed-off-by: linitra24 <Joy25810@foxmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
 2026-06-30 04:19:31 +00:00
Yejing LaiGitHubKunshang Ji
 		ae2c4f3db7 [XPU][UT]Fix xpu pass_config.fuse_norm_quant assert issue (#46804) 
Signed-off-by: Lai, Yejing <yejing.lai@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
 2026-06-29 21:13:44 -07:00
ganeshandGitHub fca432e60a [Bugfix] Propagate default stop_token_ids to per-request SamplingParams (#35076) 
Signed-off-by: sriganesh123 <arjulasriganesh@gmail.com>
 2026-06-30 12:10:09 +08:00
hclGitHubmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 		af1ee8c475 fix(config): reject negative max_logprobs (except -1) and long_prefill_token_threshold (#44070) 
Signed-off-by: Chenglun Hu <chenglunhu@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-06-30 04:02:36 +00:00
Summer YangGitHubClaude
 		5b4cb69523 [Bugfix][MLA] Fix LSE log-base mismatch in DCP + FlashInfer MLA decode (#47079) 
Signed-off-by: girasoley <girasoleyang@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
 2026-06-29 19:15:02 -07:00
peizhang56GitHubClaude
 		9fc0c08026 [ROCm][CI] Make tests/v1/shutdown an importable package (#47085) 
Signed-off-by: pei.zhang <pei.zhang@amd.com>
Co-authored-by: Claude <noreply@anthropic.com>
 2026-06-29 21:01:27 -05:00
peizhang56GitHubAndreas KaratzasClaude
 		f2b5fabb23 [ROCm][CI] Move LM Eval Large Models (8 GPUs) to mi300 pool (#47094) 
Signed-off-by: pei.zhang <pei.zhang@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: Claude <noreply@anthropic.com>
 2026-06-29 20:59:08 -05:00
Tahsin TunanGitHubBugen Zhaomergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 		b8cb75b149 [Rust Frontend] Add static HTTPS and mTLS support for HTTP and gRPC (#45890) 
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Signed-off-by: Tahsin Tunan <tahsintunan@gmail.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
 2026-06-30 01:45:59 +00:00
Thien TranandGitHub 43916891b2 [GDN] Improve kkt kernel of CuteDSL prefill backend (#46346) 
Signed-off-by: Thien Tran <gau.nernst@yahoo.com.sg>
 2026-06-29 18:34:18 -07:00
Ashwin GiridharanGitHubCursor AgentSimon Mo
 		cda05ee8c4 [Bugfix][Reasoning] Fix thinking_token_budget not enforced on re-entry after forced end (#43757) 
Signed-off-by: Ashwin Giridharan <girida@amazon.com>
Signed-off-by: Cursor Agent <cursor-agent@cursor.com>
Co-authored-by: Cursor Agent <cursor-agent@cursor.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>
 2026-06-30 01:04:25 +00:00
weishuandGitHub 77654d080c [KVTransfer] MultiConnector: merge kv_transfer_params dicts across connectors (#46777) 
Signed-off-by: deng451e <838677410@qq.com>
 2026-06-30 00:25:05 +00:00
Wentao YeandGitHub 75698e60b3 [Bug] Fix sparse attention issue for GLM5.2 non-torch compile path (#47083) 
Signed-off-by: yewentao256 <zhyanwentao@126.com>
 2026-06-29 15:45:53 -07:00
Andreas KaratzasandGitHub 8632c884dc [ROCm][CI] Use spawn around the threaded OTLP test (#47003) 
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
 2026-06-29 16:34:05 -05:00
peizhang56GitHubClaude
 		c3734e8334 [CI][Bugfix] Add cohere_melody to ROCm test requirements (#47072) 
Signed-off-by: pei.zhang <pei.zhang@amd.com>
Co-authored-by: Claude <noreply@anthropic.com>
 2026-06-29 16:29:47 -05:00
Andreas KaratzasGitHubTyler Michael Smith
 		53f7553f09 [ROCm][DeepEP] Stabilize high-throughput DBO for DP+EP (#46990) 
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
 2026-06-29 14:28:02 -07:00
Andreas KaratzasGitHubCodex
 		4eb227992a [ROCm][CI] Make memory sampling less racy in tests and sleep mode (#45490) 
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Signed-off-by: Codex <codex@example.invalid>
Co-authored-by: Codex <codex@example.invalid>
 2026-06-29 14:26:41 -07:00
Micah WilliamsonandGitHub ebcf511ec3 [ROCm][CI] Soft Fail Spec Decode Ngram + Suffix and Entrypoints Integration (LLM) AMD Mirrors (#47067) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
 2026-06-29 16:24:08 -05:00
Matthew BonanniandGitHub 8fc1b2d046 Fix FA4 dynamic_causal for full attention layers (#46659) 
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
 2026-06-29 14:23:34 -07:00
Harry MellorandGitHub 5316638a5e Fix transient dependency issues caused by requirements/common.txt (#47015) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-06-29 14:20:33 -07:00
zhrrrandGitHub 61ab70ec3b [Model Runner V2] support mamba hybrid models align prefix cache (#42406) 
Signed-off-by: zhuhaoran <zhuhaoran.zhr@alibaba-inc.com>
 2026-06-29 14:09:16 -07:00
Woosuk KwonandGitHub a309d4fe60 Support DCP with FlashInfer MLA (#43729) 
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
 2026-06-29 13:24:29 -07:00
zofiaGitHubKunshang Ji
 		72f639927f [XPU] [RMSNorm] revert weightless change on xpu (#46987) 
Signed-off-by: Zhu, Zufang <zufang.zhu@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
 2026-06-29 19:03:06 +00:00
Nick HillandGitHub 8ad4a01825 [ModelRunner V2] Simplify recent UnlimitedOCR-related changes (#46975) 
Signed-off-by: Nick Hill <nickhill123@gmail.com>
 2026-06-29 09:56:17 -07:00
Jee Jee LiandGitHub 7be582697b [Bugfix] Fix DeepseekV2Model hidden_size (#46986) 
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
 2026-06-29 16:44:05 +00:00
Roberto L. CastroGitHubLucas Wilkinson
 		030c9523bd [Perf][1/N] Expand Triton kernel warmup coverage, DSv4 (#46634) 
Signed-off-by: LopezCastroRoberto <rocastro@redhat.com>
Signed-off-by: Roberto L. Castro <38211239+LopezCastroRoberto@users.noreply.github.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
 2026-06-29 16:40:34 +00:00
Wei ZhaoGitHubJee Jee Li
 		4708292d48 Bump flashinfer version to 0.6.13 (#46683) 
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
 2026-06-29 09:30:57 -07:00