karylab_agents/vllm
1
0
Fork 0
forked from Karylab-cklius/vllm
Code Pull Requests 2 Actions 2 Packages Activity
18,975 Commits 354 Branches 175 Tags
08e50675615fc0b3e4e458645d8dd16cefb371bd
Commit Graph
2495 Commits
Author SHA1 Message Date
Lena OnyshchenkoandGitHub 0d9e60619b [Misc][Docs] Fix XPU compute-runtime driver link version mismatch (#49299) 
Signed-off-by: oonyshch <xonyshch@gmail.com>
 2026-07-21 08:45:41 +00:00
Kunshang JiandGitHub e78a0c8e59 [XPU][Doc] Update XPU docker image documents (#49148) 
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
 2026-07-21 10:11:27 +08:00
Lena OnyshchenkoGitHubCursor
 		1d874867ea [Misc][Docs] Fix broken protocol link in speech_to_text doc (#47212) 
Signed-off-by: oonyshch <xonyshch@gmail.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
 2026-07-21 01:05:05 +00:00
Matthew BonanniGitHubmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 		bd091079cb [Attention] FlashAttention 4 SM100 FP8 kv cache support (#42569) 
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-07-20 10:53:27 -07:00
Chang GuoGitHubOpenAI Codex
 		f007cceb42 [KV Offload] Support self-describing KV events with TieringOffloadingSpec (#48679) 
Signed-off-by: Change72 <changg@nvidia.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
 2026-07-20 16:41:58 +03:00
Lena OnyshchenkoandGitHub ae10e855ab [Misc][Docs] Remove duplicate CodeGeex4 row in XPU model table (#47210) 
Signed-off-by: oonyshch <xonyshch@gmail.com>
 2026-07-20 10:05:36 +00:00
Lena OnyshchenkoGitHubCursor
 		47d0597ca2 [Misc][Docs] Fix broken csrc kernel links in fusions doc (#47211) 
Signed-off-by: oonyshch <xonyshch@gmail.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
 2026-07-20 09:44:25 +00:00
Itay EtelisGitHubItay Etelis
 		5245c80564 [Doc] Document blocks_per_chunk in the KV offloading guide (#49100) 
Signed-off-by: Itay Etelis <itay.etelis@ibm.com>
Co-authored-by: Itay Etelis <itay.etelis@ibm.com>
 2026-07-20 09:48:43 +03:00
Julien DenizeGitHubNicolò Lucchesi
 		ce4bdcbda4 [Bugfix] Enable FlashAttention MLA prefill for Mistral Small 4 head dims (#48855) 
Signed-off-by: juliendenize <julien.denize@mistral.ai>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
 2026-07-17 18:07:00 +08:00
Kevin H. LuuGitHubOpenAI Codex
 		867ff69733 [CI] Gate non-default release wheel builds (#48772) 
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: OpenAI Codex <noreply@openai.com>
 2026-07-17 02:16:44 -07:00
SageandGitHub 109b736b86 [docs] preserve page path in stable-docs announcement link (#48839) 
Signed-off-by: Sage Ahrac <sagiahrak@gmail.com>
 2026-07-17 08:56:45 +00:00
Chang GuoGitHubCodexClaude Fable 5
 		426d48bfa1 [KV Offload] Add optional tier locality to FS/OBJ KV events (#48281) 
Signed-off-by: Change72 <changg@nvidia.com>
Co-authored-by: Codex <codex@openai.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-07-17 10:31:52 +03:00
Martin HickeyandGitHub 4d4e04f452 [Render] Add round trip parity test and docs for derender (#48617) 
Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com>
 2026-07-17 05:02:46 +00:00
Daoyuan LiandGitHub b88abb5036 [Misc] Remove orphaned env vars and stale env-var references (#44749) 
Signed-off-by: Daoyuan Li <94409450+DaoyuanLi2816@users.noreply.github.com>
 2026-07-17 00:00:47 +00:00
yuvalluriaGitHubYuval LuriaClaude Sonnet 4.5
 		ab0a20d151 [Docs] Add Phi-3.5-mini-instruct to batch invariance tested models (#46396) 
Signed-off-by: Yuval Luria <yuvalluria@users.noreply.github.com>
Co-authored-by: Yuval Luria <yuvalluria@users.noreply.github.com>
Co-authored-by: Claude Sonnet 4.5 <noreply@anthropic.com>
 2026-07-16 18:05:58 -04:00
rongfu.lengandGitHub 3935829f89 [Docs] fix error key name (#48802) 
Signed-off-by: rongfu.leng <lenronfu@gmail.com>
 2026-07-16 03:16:16 +00:00
Taneem IbrahimGitHubmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 		de100ffb62 [Docs] Document pooling config resolution (#48497) 
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-07-15 14:24:16 -04:00
Gopala-Krishna CharandGitHub 5810e884f1 [Model] Add RobertaForTokenClassification / XLMRobertaForTokenClassification (#47991) 
Signed-off-by: krishy91 <crgkc.r@gmail.com>
 2026-07-15 14:30:33 +00:00
liranschourGitHubmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 		615834ee58 [KVOffload][P2P] Well-known default host/port env vars and per-DP-rank control port (#47636) 
Signed-off-by: Liran Schour <lirans@il.ibm.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-07-15 15:22:56 +03:00
Matthew BonanniandGitHub 313d01f507 [CI][Bugfix] Fix FlashAttention reported MLA dimension support (#48631) 
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
 2026-07-14 21:33:02 +00:00
tomerg-nvidiaGitHubNickLucche
 		7a74a9662b [NIXL] Avoid reading expired blocks in bidirectional turn-2 read (#47021) 
Signed-off-by: Tomer Gilad <tgilad@nvidia.com>
Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai>
Co-authored-by: NickLucche <nicolo.lucchesi@mistral.ai>
 2026-07-14 13:03:41 +00:00
karthikandGitHub b6754f536e [Model] Enable LoRA support for tower and connector in LlavaNextVideo (#48594) 
Signed-off-by: gangula-karthik <gkarthik923@gmail.com>
 2026-07-14 20:09:38 +08:00
adsridharGitHubBartosz Stefaniak
 		894ebb27f5 Add Cosmos3 Edge Reasoner model (#48291) 
Signed-off-by: Bartosz Stefaniak <bstefaniak@nvidia.com>
Co-authored-by: Bartosz Stefaniak <bstefaniak@nvidia.com>
 2026-07-14 08:14:50 +00:00
Matthew BonanniGitHubClaude Opus 4.8
 		c4f5cd60da [1/N] Add dense MHA path for sparse MLA short sequences (#47327) 
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
 2026-07-14 00:29:56 +00:00
Pavani MajetyGitHubJingyi Yang
 		7fc97042c3 Add DCP + Eagle support for Tokenspeed MLA backends (#48180) 
Signed-off-by: Pavani Majety <pmajety@nvidia.com>
Signed-off-by: Jingyi Yang <girasoleyang@gmail.com>
Co-authored-by: Jingyi Yang <girasoleyang@gmail.com>
 2026-07-13 11:46:02 -07:00
Gavin MorrisandGitHub 5c342876a6 [Doc] Add DeepseekV32ForCausalLM to supported_models.md (#48293) 
Signed-off-by: Gavin Morris <gmorriscs@gmail.com>
 2026-07-13 17:43:59 +00:00
aoshen02GitHubClaude Opus 4.8mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 		83762b77b0 [Frontend] Add /abort_requests to the RLHF dev API router (#47173) 
Signed-off-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-07-12 14:21:02 +08:00
vx120GitHubcrp0128aoshen02Claude Opus 4.8
 		fc1c548093 Runtime Draft Weight Update for Speculative Decoding (#46725) 
Signed-off-by: vx120 <893600387@qq.com>
Signed-off-by: vx120 <57470515+vx120@users.noreply.github.com>
Signed-off-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: crp0128 <191679376@qq.com>
Co-authored-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
 2026-07-11 22:51:53 -07:00
ViranjanPagarGitHubClaude Opus 4.8Isotr0pyIsotr0pyRoger Wang
 		e23b19309b Deepstream video backend (#42424) 
Signed-off-by: Viranjan Pagar <vpagar@nvidia.com>
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
 2026-07-10 02:23:30 -07:00
Andrey TalmanGitHubAndrey TalmanKevin H. Luu
 		f36284a8d2 [CI] Add TORCH_NIGHTLY=1 build mode (run full suite on torch nightly) (#47180) 
Co-authored-by: Andrey Talman <atalman@users.noreply.github.com>
Co-authored-by: Kevin H. Luu <khluu000@gmail.com>
 2026-07-10 01:38:35 -07:00
Mingfei GuoandGitHub 424df4f65d [Model][CI/Build] Cosmos3: enable registry tests and register Cosmos3-Super (#48211) 
Signed-off-by: Mingfei Guo <1800012773@pku.edu.cn>
 2026-07-10 16:35:15 +08:00
albertoGitHubChauncey
 		5715fde12c [Feature][Parser] Support include_reasoning param for non-Harmony models (#44301) 
Signed-off-by: Alberto Perdomo <aperdomo@redhat.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
 2026-07-10 15:34:02 +08:00
Chang GuoGitHubClaude Fable 5Or Ozeri
 		2d814a0082 [kv_offload] Emit tier-owned BlockStored events from FS/OBJ secondary tiers (#47923) 
Signed-off-by: Change72 <changg@nvidia.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: Or Ozeri <oro@il.ibm.com>
 2026-07-10 06:17:23 +03:00
Harry MellorandGitHub b83be00cdd Migrate Olmo and Olmo2 to the Transformers modeling backend (#48100) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-07-09 05:00:23 -07:00
Tiezhen WANGGitHubHarry MellorCyrus Leung
 		412414d8e0 Remove PersimmonForCausalLM and FuyuForCausalLM model architectures (#48096) 
Signed-off-by: Xianbao QIAN <xianbao.qian@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
 2026-07-09 04:59:08 -07:00
Tiezhen WANGGitHubmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>Harry Mellor
 		ab7961a14a Remove TeleChatForCausalLM (#47989) 
Signed-off-by: Xianbao QIAN <xianbao.qian@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-07-09 00:34:54 -07:00
Canlin GuoandGitHub 285c08c036 [Model] Support MOSS-Transcribe-Diarize (#47729) 
Signed-off-by: gcanlin <canlinguosdu@gmail.com>
 2026-07-08 04:05:45 -07:00
Nicolò LucchesiandGitHub bd3bb4eb26 [Misc][Docs] Add human-readable integer support for more cli-args (#47608) 
Signed-off-by: NickLucche <nicolo.lucchesi@mistral.ai>
 2026-07-08 09:43:34 +00:00
Martin HickeyandGitHub f7fc0ca993 [Frontend] Add endpoint plugins framework (#47454) 
Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com>
 2026-07-08 10:00:41 +08:00
Nils MattesonGitHubNils Mattesonmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 		dd0d74cd92 [Doc] Surface the --kv-cache-memory suggestion at INFO and document fast-startup knobs (#47374) 
Signed-off-by: Nils Matteson <nils@thaw.sh>
Signed-off-by: Nils Matteson <nilsmatteson@icloud.com>
Co-authored-by: Nils Matteson <nils@thaw.sh>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-07-07 15:05:07 -07:00
Nick CaoandGitHub 47c40bfe8a [Doc] Fix manylinux tag in installation guide (#47913) 
Signed-off-by: Nick Cao <ncao@redhat.com>
 2026-07-07 20:34:05 +00:00
Tyler Michael SmithGitHubmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>Claude Opus 4.6
 		93e2ab7111 Disable dynamic speculative decoding when DP is enabled (#45963) 
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
 2026-07-07 12:52:41 +00:00
Harry MellorandGitHub dd94484577 Bump Transformers version to 5.10.4 (#41359) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-07-07 05:13:28 -07:00
Andreas KaratzasGitHubRohan138CodexMicah WilliamsonMatthew Wong
 		cbb5f045be [ROCm][CI] Refresh ROCm base images when docker rocm_base changes (#46904) 
Signed-off-by: Rohan138 <rohanpotdar138@gmail.com>
Signed-off-by: Codex <codex@example.invalid>
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
Signed-off-by: Matthew Wong <Matthew.Wong2@amd.com>
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: Rohan138 <rohanpotdar138@gmail.com>
Co-authored-by: Codex <codex@example.invalid>
Co-authored-by: Micah Williamson <micah.williamson@amd.com>
Co-authored-by: Matthew Wong <Matthew.Wong2@amd.com>
 2026-07-07 03:10:50 -07:00
Aritra Roy GosthipatyandGitHub 1e823dc01d [docs update] Update usage of hf cli for cache list and removal (#47830) 
Signed-off-by: Aritra Roy Gosthipaty <aritra.born2fly@gmail.com>
 2026-07-07 07:09:18 +00:00
Nicolas HugGitHubClaudeIsotr0py
 		700e882eab Add TorchCodec as a video decoding backend (#46609) 
Signed-off-by: Nicolas Hug <contact@nicolas-hug.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
 2026-07-06 19:58:51 -07:00
nv-nedelman-1GitHubSimon MoGPT-5.5
 		86db6c3070 [Frontend] add per-request timing metrics field to response body of Chat/Completions APIs (#46768) 
Signed-off-by: Nicholas Edelman <nedelman@nvidia.com>
Signed-off-by: Simon Mo <simon@inferact.ai>
Co-authored-by: Simon Mo <simon@inferact.ai>
Co-authored-by: GPT-5.5 <noreply@cursor.com>
 2026-07-06 17:48:29 -07:00
Harry MellorGitHubmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 		5bce653e09 Make the Transformers modeling backend as fast as native vLLM (#47187) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-07-06 16:59:14 +01:00
LiJzdGitHubOpenAI Codex
 		641cb59592 [Doc] Clarify fastokens availability (#45813) 
Signed-off-by: LjjJzd <3542531707@qq.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
 2026-07-06 13:33:05 +00:00
Sungjae LeeandGitHub 3d7f357ebf [Doc] docs: fix note formatting for pooling models (#47701) 
Signed-off-by: Sungjae Lee <33976427+llsj14@users.noreply.github.com>
Signed-off-by: Sungjae Lee <sung-jae.lee@navercorp.com>
 2026-07-06 09:01:10 +00:00