karylab_agents/vllm
1
0
Fork 0
forked from Karylab-cklius/vllm
Code Pull Requests 2 Actions 1 Packages Activity
16,474 Commits 354 Branches 175 Tags
ci/narrow-models-basic-deps
Commit Graph
16474 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
khluu 74690b24e7 Add tasks/version/logging_utils to models_basic GPU deps 
Following the deeper audit pattern from #42219:

- `vllm/tasks.py`: imported by `vllm/model_executor/models/registry.py`
  and other model-side code; a change to `POOLING_TASKS` /
  `SupportedTask` would otherwise silently skip these jobs.
- `vllm/version.py`: imported by `vllm/v1/engine/core.py` and
  `vllm/engine/arg_utils.py`. Release-tooling bumps would
  otherwise skip the model init jobs.
- `vllm/logging_utils/`: imported by `vllm/model_executor/models/registry.py`
  (`logtime`) and `vllm/v1/engine/core.py`.

Applied to GPU jobs (Initialization, Other). The CPU job
(test_utils, test_vision) does not transitively reach these
modules — its tests only import `vllm.distributed`,
`vllm.model_executor.models.{utils,vision}`, `vllm.platforms`,
`vllm.utils`, none of which import the new edge modules — so
the CPU job is unchanged.

Signed-off-by: Kevin H. Luu <kevin@anyscale.com>

Signed-off-by: khluu <khluu000@gmail.com>
 2026-05-10 03:48:11 -07:00
khluu 8ac682b513 Add sequence.py and config/ to models_basic deps 
Address review on #42220:

- Add `vllm/sequence.py` to GPU jobs (Initialization, Other) — it
  defines `IntermediateTensors` and other core types used in the
  model forward path; an incompatible change can break model
  initialization even without a direct test import.
- Add `vllm/config/` to the CPU job —
  `vllm/model_executor/models/vision.py` (imported by
  `tests/models/test_vision.py`) imports
  `MultiModalConfig` from `vllm.config`.

Skipped gemini's other suggestions: `vllm/core/` does not exist at
the top level (the relevant code lives under `vllm/v1/core/` which
is already covered by `vllm/v1/`), and `vllm/multimodal/` is not
directly imported by `test_utils.py` or `test_vision.py`
(`MultiModalConfig` is the config class, listed under `vllm/config/`).

Signed-off-by: Kevin H. Luu <kevin@anyscale.com>

Signed-off-by: khluu <khluu000@gmail.com>
 2026-05-10 03:35:03 -07:00
khluu 1966261291 [CI] Narrow models_basic.yaml source dependencies 
Three jobs in `.buildkite/test_areas/models_basic.yaml` listed
`vllm/` as a source dependency. Replace each with the modules the
underlying tests actually import:

- Basic Models Tests (Initialization): runs
  `tests/models/test_initialization.py`, which instantiates models
  via `vllm_runner`. Narrowed to the inference-stack modules used
  during model load.
- Basic Models Tests (Other): same narrowing as Initialization.
- Basic Models Test (Other CPU): unit tests
  (`test_utils.py`, `test_vision.py`) that only import
  `vllm.distributed`, `vllm.model_executor.models`, `vllm.platforms`,
  `vllm.utils` — narrowed to those four.

`Basic Models Tests (Extra Initialization)` already had a narrow
`vllm/model_executor/models/` dep and is unchanged. The optional
nightly transformers jobs have no `source_file_dependencies` and
are unchanged.

Signed-off-by: Kevin H. Luu <kevin@anyscale.com>

Signed-off-by: khluu <khluu000@gmail.com>
 2026-05-10 03:27:42 -07:00
Andreas KaratzasandGitHub 0a309b5ee9 [ROCm] Cap Triton paged attention block size to fix ROCm shared memory OOM (#38502) 
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
 2026-05-10 10:03:00 +00:00
Jee Jee LiandGitHub 84f7a55340 [CI] Trigger LoRA test when changing MoE code. (#42196) 
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
 2026-05-10 01:26:09 -07:00
Ethan FengandGitHub a2c9d548d7 [Docs] Fix broken local links (#42160) 
Signed-off-by: Ethan Feng <ethan.fengch@gmail.com>
 2026-05-10 01:15:38 -07:00
Yongye ZhuandGitHub 301305c093 Add @zyongye to CODEOWNERS (#42200) 
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
 2026-05-10 16:07:32 +08:00
Mohammad Miadh AngkadandGitHub efd0e7789d Fix mypy failure on main (#42197) 
Signed-off-by: Mohammad Miadh Angkad <MAngkad.BSDSBA2027@aim.edu>
 2026-05-10 07:55:57 +00:00
abdulrahman-cohereGitHubCursor AgentNicolò Lucchesi
 		a5d0a5afba [Frontend][Bugfix] Abort ASR engine requests on cancellation (#41266) 
Signed-off-by: abdulrahman-cohere <abdulrahman.abdulrazzag@cohere.com>
Signed-off-by: <>
Co-authored-by: Cursor Agent <cursor-agent@cursor.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
 2026-05-09 23:51:11 -07:00
Andreas KaratzasandGitHub f2840120f6 [ROCm][CI] Fix NIXL spec-decode acceptance startup and diagnostics (#41313) 
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
 2026-05-10 14:50:16 +08:00
Dao007foreverandGitHub 3f5bd482f5 [Bugfix][KV Transfer][NIXL] Notify P node on pre-admission rejection to free stranded KV blocks (#41269) 2026-05-09 22:52:09 -07:00
Andreas KaratzasandGitHub fb1ac806c5 [ROCm][CI] Stabilize ROCm shutdown and distributed compile CI (#41573) 
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
 2026-05-10 03:47:40 +00:00
Wei ZhaoandGitHub 986edc858a [Bugfix] Fix DeepSeek v4 topk numerical issue for unaligned max-model-len (#42169) 2026-05-09 20:30:08 -07:00
Abhishek GuptaGitHubAbhiOnGithub
 		27d3bac272 docs: clarify Gemma 4 assistant speculative decoding (#42180) 
Signed-off-by: AbhiOnGithub <abhiOnGithub@users.noreply.github.com>
Co-authored-by: AbhiOnGithub <abhiOnGithub@users.noreply.github.com>
 2026-05-09 20:08:44 -07:00
Itay EtelisGitHubItay EtelisOr OzeriItay Etelismergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 		00b0618a03 Use CU_MEMCPY_SRC_ACCESS_ORDER_ANY for batch KV cache swaps (#39306) 
Signed-off-by: Itay Etelis <itay.etelis@ibm.com>
Signed-off-by: Itay Etelis <etelis2019@gmail.com>
Signed-off-by: Itay Etelis <92247226+Etelis@users.noreply.github.com>
Co-authored-by: Itay Etelis <itay.etelis@ibm.com>
Co-authored-by: Or Ozeri <oro@il.ibm.com>
Co-authored-by: Itay Etelis <etelis2019@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-05-10 05:57:09 +03:00
Christian VanGitHubChristian Van
 		0d382ecde8 Handle optional bool-or-string CLI args in get_kwargs (#40951) 
Signed-off-by: Christian Van <cvan20191@gmail.com>
Co-authored-by: Christian Van <cvan20191@gmail.com>
 2026-05-09 19:47:21 -07:00
Isotr0pyandGitHub 1029e5ef28 [CI/Build] Use modelscope's international site for regression test (#42176) 
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
 2026-05-09 19:47:09 -07:00
Wang XingranGitHubHongjian Zhang
 		0b272a6e01 [Bugfix] Fix SP pass for multimodal models and PP+SP residual handling (#33322) 
Signed-off-by: Xingran Wang <wangxingran123456@outlook.com>
Signed-off-by: Hongjian Zhang <hirokenovo@gmail.com>
Co-authored-by: Hongjian Zhang <hirokenovo@gmail.com>
 2026-05-09 19:44:16 -07:00
Nave AssafGitHubmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 		dcb3135af7 Fix: Nemotron 3 rescue whitespace-only final_content, not just None (#41846) 
Signed-off-by: Nave Assaf <nassaf@nvidia.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-05-10 02:07:58 +00:00
baonudesifeizhaiGitHubmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 		bc5fdc1e6a Add NVFP4 all-gather GEMM fusion for AsyncTP (#41882) 
Signed-off-by: roG0d <baonudesifeizhai@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-05-10 01:13:22 +00:00
aoshen02andGitHub 006af4b956 [Bugfix] Skip routed-experts hot path when disabled (#42148) 2026-05-09 18:01:04 -07:00
Wentao YeandGitHub ea0e501bb1 [KV Connector] Remove compat support for pre-v0.12.0 constructor signatures without KVCacheConfig (#39832) 
The v0.12.0 release contained initial support for HMA in KV Connectors. As part
of these changes, a KVCacheConfig argument was added to KV connector
constructors. Backwards compatibility support for out-of-tree connectors was
included in this change, with a very prominent warning. See #25712 and #27887.

Since the warning has been around for over 5 months, we can safely remove
the support of it.

Signed-off-by: yewentao256 <zhyanwentao@126.com>
 2026-05-09 23:39:46 +00:00
Wentao YeandGitHub f80aa53c9d [Refactor] Nixl util using lazy init (#41392) 
Signed-off-by: yewentao256 <zhyanwentao@126.com>
 2026-05-09 17:46:52 -04:00
Juhi MittalandGitHub 7a2b596982 [Quantization] Add ModelOpt NVFP4 W4A16 (4-bit weights, fp16/bf16 activations) support (#41769) 
Signed-off-by: Juhi Mittal <juhim@nvidia.com>
 2026-05-09 21:15:50 +00:00
Jiangyun ZhuandGitHub 2ee8c2a56e [SpecDecoding] extend mtp support for mimo 2.5 (#41905) 
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
 2026-05-09 18:22:59 +00:00
SoluMilkenandGitHub cd74911d92 [Model] use AutoWeightsLoader for DeepSeekV2 (#41706) 
Signed-off-by: SoluMilken <ypiheyn.imm02g@g2.nctu.edu.tw>
 2026-05-10 01:55:25 +08:00
SoluMilkenandGitHub 25abddc1a5 [BugFix] Fix Gemma4 'layers.0.moe.experts.0.down_proj_packed' KeyError issue (#40708) 
Signed-off-by: SoluMilken <ypiheyn.imm02g@g2.nctu.edu.tw>
 2026-05-09 17:20:44 +00:00
Nicolò LucchesiGitHubZhanqiuHu
 		171d59ae8d [Bugfix][PD] Fix DSv4 Disaggregated (#41957) 
Signed-off-by: NickLucche <nlucches@redhat.com>
Co-authored-by: ZhanqiuHu <zhu@redhat.com>
 2026-05-09 16:48:24 +00:00
Thomas ParnellGitHubJiangyun Zhu
 		3dda9aeb54 [Bugfix] Remove nested torch.compile in GDN rearrange_mixed_qkv causing CUDA graph capture failure (#42070) 
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
Co-authored-by: Jiangyun Zhu <riverclouds.zhu@qq.com>
 2026-05-09 08:30:55 -07:00
KermitandGitHub adb6d96516 [Bugfix] Fix GDN KKT precision loss on Hopper GPUs by aligning tl.dot operand layout with WGMMA (#42076) 
Signed-off-by: kermit <ckeming@outlook.com>
 2026-05-09 13:08:46 +00:00
Thien TranandGitHub 530d371302 [DSv4] Improved fused Indexer Q quant kernel (#41428) 2026-05-09 01:20:32 -07:00
Micah WilliamsonandGitHub 34ab4f2565 [ROCm] Upgrade aiter to v0.1.13-rc5 (#42113) 
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
 2026-05-09 08:13:45 +00:00
Jee Jee LiandGitHub ecd0b60aad [LoRA] Initial EP support for LoRA (#40867) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
 2026-05-09 00:31:23 -07:00
Richard BarnesGitHubClaude
 		d6563d693c Require C++20 for compatibility with PyTorch (#40380) 
Signed-off-by: Richard Barnes <rbarnes@meta.com>
Co-authored-by: Claude <noreply@anthropic.com>
 2026-05-08 22:04:43 -07:00
Rishapveer SinghandGitHub f6490a2841 [Bugfix] Preserve leading/trailing whitespace in GLM non-streaming tool parser (#42026) 
Signed-off-by: Rishapveer Singh <singhrishapveer@gmail.com>
 2026-05-08 21:49:15 -07:00
Terrence ZhaoGitHubCursor
 		a2812becd6 [Models] Cohere Eagle + fix to Cohere MoE (#42078) 
Signed-off-by: Terrencezzj <terrence@cohere.ai>
Co-authored-by: Cursor <cursoragent@cursor.com>
 2026-05-08 21:46:26 -07:00
Markus HartikainenGitHubTJian
 		e8f9038ebd [ROCm][Bugfix] Re-tag AITER MoE weights as preshuffled after replace_parameter (#42061) 
Signed-off-by: Markus Hartikainen <markus.hartikainen@amd.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
 2026-05-08 21:42:07 -07:00
David ZhengGitHubgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>Andreas KaratzasKunshang Ji
 		df2636a9d8 [Bugfix] Fix LOGITPROC_SOURCE_ENTRYPOINT test to use spawn-compatible dist-info registration for XPU/ROCm (#42040) 
Signed-off-by: dqzhengAP <dqzheng1996@gmail.com>
Signed-off-by: David Zheng <153074367+dzhengAP@users.noreply.github.com>
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
 2026-05-09 12:32:04 +08:00
Shengqi ChenandGitHub 97cc7685c4 Add @Harry-Chen in CODEOWNERS (#42130) 
Signed-off-by: Shengqi Chen <harry-chen@outlook.com>
 2026-05-09 04:08:22 +00:00
haosdentandGitHub e934e459e6 [CI][Bugfix] Make test_gpt2_cache_hit observable across V1 EngineCore (#42037) 
Signed-off-by: haosdent <haosdent@gmail.com>
 2026-05-09 11:53:15 +08:00
David ZhengandGitHub 845ca327ce [Bugfix] Fix test_whisper distributed test process handling (#42038) 
Signed-off-by: dqzhengAP <dqzheng1996@gmail.com>
 2026-05-09 11:37:21 +08:00
Yan MaGitHubKunshang Ji
 		4f6fa6341d [XPU] update supported models on XPU (#41911) 
Signed-off-by: Yan Ma <yan.ma@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
 2026-05-09 10:44:03 +08:00
Ethan FengandGitHub a43bc34baf [Docs] Update server entrypoint examples (#42077) 
Signed-off-by: Ethan Feng <ethan.fengch@gmail.com>
 2026-05-09 02:03:52 +00:00
Ethan FengandGitHub 236bf9d152 [Docs] Fix RLHF example links (#42073) 
Signed-off-by: Ethan Feng <ethan.fengch@gmail.com>
 2026-05-09 02:03:42 +00:00
Lucas WilkinsonandGitHub b1728c1e66 [Attention][Cleanup] Remove tree attention (#42121) 
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
 2026-05-08 18:36:19 -07:00
Yan MaGitHubKunshang Ji
 		be0dcc29dc [XPU] remove q/k/v force contiguous for flash_attn (#40356) 
Signed-off-by: Yan Ma <yan.ma@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
 2026-05-09 01:19:05 +00:00
Sumanth R HegdeandGitHub e3b65a5ba0 [feat] Add explicit /start_weight_update and /finish_weight_update APIs for weight transfer (#39212) 2026-05-08 18:03:33 -07:00
Harry MellorandGitHub 30f519e947 Use pre-commit / pre-run-check to gate docs build too (#42053) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-05-09 00:02:51 +00:00
Roy WangandGitHub 60851b1d22 [Bugfix][KV Transfer] Reject NixlConnector + expandable_segments:True (#41237) 2026-05-08 16:47:33 -07:00
Michael GoinandGitHub 8bcd8a260c [Bugfix] Fix FlashInfer CUTLASS MXFP4-MXFP8 MoE by restoring swizzled scale (#42089) 
Signed-off-by: mgoin <mgoin64@gmail.com>
 2026-05-08 15:59:06 -07:00