karylab_agents/vllm
1
0
Fork 0
forked from Karylab-cklius/vllm
Code Pull Requests 2 Actions 2 Packages Activity
18,636 Commits 354 Branches 175 Tags
longcat-2.0
Commit Graph
388 Commits
Author SHA1 Message Date
mgoinandClaude Fable 5 62a0750892 [Model] Add LongCat-2.0 (sparse attention, MTP, n-gram fixes) 
Support meituan-longcat/LongCat-2.0-FP8: the LongCat-Flash-Lite backbone
plus a DeepSeek-V3.2-style sparse attention indexer, reusing vLLM's
existing DSA infrastructure.

- Resolve the checkpoint's null model_type via a registered config class
  (arch LongcatCausalLM); alias the oe_* n-gram config fields.
- Wire the indexer into the dual-attention layer: only the first
  attention of each layer computes top-k indices (cli_factor), the
  second reuses them via the shared buffer. Adds a generic skip_topk
  override to DeepseekV2MLAAttention; the schedule lives in the model.
- Streaming-aware indexing: force the first index_init_tokens and last
  index_local_tokens into the top-k set (sparse_attn_indexer).
- MTP speculative decoding (one module iterated up to 3 draft steps,
  plain token embedding, FP8 indexer weights).
- Fix a latent LongCat weight-loading bug: the post-load
  mla_scale_q_lora/kv_lora fold breaks under incremental load_weights
  calls; fold at weight-load time instead.
- Fix two n-gram embedding bugs (also affect LongCat-Flash-Lite):
  rebuild the left-context from the accepted-token history so rejected
  draft tokens don't pollute it, and hash EOS-current positions with
  full look-back per the HF reference (unit test included).
- Add --reasoning-parser longcat (<longcat_think> tags) and docs rows.
- Add longcat model types to the DeepGEMM Blackwell blocklist (non-ue8m0
  scales; measured GSM8K-neutral on vLLM but matches SGLang's guard).

Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
 2026-07-11 02:12:49 +00:00
Mingfei GuoandGitHub 424df4f65d [Model][CI/Build] Cosmos3: enable registry tests and register Cosmos3-Super (#48211) 
Signed-off-by: Mingfei Guo <1800012773@pku.edu.cn>
 2026-07-10 16:35:15 +08:00
Harry MellorandGitHub b83be00cdd Migrate Olmo and Olmo2 to the Transformers modeling backend (#48100) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-07-09 05:00:23 -07:00
Tiezhen WANGGitHubHarry MellorCyrus Leung
 		412414d8e0 Remove PersimmonForCausalLM and FuyuForCausalLM model architectures (#48096) 
Signed-off-by: Xianbao QIAN <xianbao.qian@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
 2026-07-09 04:59:08 -07:00
Tiezhen WANGGitHubmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>Harry Mellor
 		ab7961a14a Remove TeleChatForCausalLM (#47989) 
Signed-off-by: Xianbao QIAN <xianbao.qian@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-07-09 00:34:54 -07:00
Canlin GuoandGitHub 285c08c036 [Model] Support MOSS-Transcribe-Diarize (#47729) 
Signed-off-by: gcanlin <canlinguosdu@gmail.com>
 2026-07-08 04:05:45 -07:00
Aritra Roy GosthipatyandGitHub 1e823dc01d [docs update] Update usage of hf cli for cache list and removal (#47830) 
Signed-off-by: Aritra Roy Gosthipaty <aritra.born2fly@gmail.com>
 2026-07-07 07:09:18 +00:00
Harry MellorGitHubmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 		5bce653e09 Make the Transformers modeling backend as fast as native vLLM (#47187) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-07-06 16:59:14 +01:00
Sungjae LeeandGitHub 3d7f357ebf [Doc] docs: fix note formatting for pooling models (#47701) 
Signed-off-by: Sungjae Lee <33976427+llsj14@users.noreply.github.com>
Signed-off-by: Sungjae Lee <sung-jae.lee@navercorp.com>
 2026-07-06 09:01:10 +00:00
chengzheng345GitHubchengzheng345mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 		b0b8a286dd [Model] Add LLaVA-OneVision-2 (LlavaOnevision2ForConditionalGeneration) (#44785) 
Signed-off-by: chengzheng345 <209475443+chengzheng345@users.noreply.github.com>
Co-authored-by: chengzheng345 <209475443+chengzheng345@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-07-02 16:41:49 +08:00
Harry MellorandGitHub a78c15616f Migrate GPTBigCode and Starcoder2 to the Transformers modeling backend (#30966) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-07-01 13:41:36 +00:00
Harry MellorandGitHub a22e0dfc69 [Model] Remove AyaVision, MusicFlamingo (#47263) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-07-01 10:39:33 +00:00
Tiezhen WANGGitHubClaude
 		4470ae84de Remove mantis (#46806) 
Signed-off-by: Xianbao QIAN <xianbao.qian@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
 2026-07-01 07:13:58 +00:00
Harry MellorandGitHub 5dc36a4fa5 [Model] Remove Tarsier, Tarsier2 (#47143) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-06-30 13:20:33 +00:00
linitra24GitHubJee Jee Li
 		b5c9e1ac33 [LoRA] Add language-backbone LoRA support for MiniCPM-V 4.6 (#46740) 
Signed-off-by: linitra24 <Joy25810@foxmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
 2026-06-30 04:19:31 +00:00
Fabian JoswigGitHubwang.yuqiTyler Michael Smith
 		4dfbf1503b [Model] Add support for openai/privacy-filter (#41026) 
Signed-off-by: Fabian Joswig <fjosw@users.noreply.github.com>
Co-authored-by: wang.yuqi <yuqi.wang@daocloud.io>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
 2026-06-28 16:18:22 -07:00
Tianyu GuoGitHubIsotr0pyRoger Wang
 		c6741b2ad4 [Model] Support Unlimited OCR (#46564) 
Signed-off-by: Tianyu Guo <guoty9@mail2.sysu.edu.cn>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Roger Wang <hey@rogerw.io>
 2026-06-27 23:09:18 -07:00
Tiezhen WANGandGitHub c7645bce04 Remove grok model arch from vllm (#46706) 
Signed-off-by: Xianbao QIAN <xianbao.qian@gmail.com>
 2026-06-25 23:02:10 -07:00
Tiezhen WANGGitHubClaude
 		72adb20a6a [Model] Remove AquilaForCausalLM, AquilaModel (#46605) 
Signed-off-by: Xianbao QIAN <xianbao.qian@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
 2026-06-25 08:08:26 +00:00
soaringkandGitHub d7c1821b5a [Model][MiniMax-M3] Add pipeline parallelism support (#45810) 
Signed-off-by: soaringk <k3vin.zhang@gmail.com>
 2026-06-24 08:23:03 +00:00
Tiezhen WANGGitHubClaude
 		4cd1a84c88 [Model] Remove BaiChuanForCausalLM and BaichuanForCausalLM (#46362) 
Signed-off-by: Xianbao QIAN <xianbao.qian@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
 2026-06-24 16:13:57 +08:00
hurukawaGitHubOpenAI CodexRoger Wangmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 		489abadfb8 feat: support to OpenMOSS-Team (#44124) 
Signed-off-by: nagisa-kun <1434936049@qq.com>
Signed-off-by: nagisa19 <1434936049@qq.com>
Signed-off-by: nagisa <1434936049@qq.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-06-24 00:08:13 -07:00
Sunny YuanandGitHub a04654da23 Doc: fix missing GLM-5.x in supported models (#46452) 
Signed-off-by: Sunny Yuan <y.zichen@wustl.edu>
 2026-06-23 07:42:27 +00:00
MichaelCaooGitHubClaude
 		33f50773cb [Doc] Fix typos, grammar, and broken commands across docs (#46398) 
Signed-off-by: MichaelCaoo <a992033227@163.com>
Co-authored-by: Claude <noreply@anthropic.com>
 2026-06-23 02:01:22 +00:00
Athrael SojuGitHubClaude Opus 4.8
 		3c8e49596c [Model] ColQwen3.5: fix retrieval correctness (bias + bidirectional) (#46108) 
Signed-off-by: Athrael Soju <athrael.soju@gmail.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
 2026-06-22 17:25:54 +08:00
Jee Jee LiGitHubJiangyun ZhuRoger Wang
 		2e2c47928b [Doc] Update MiniMax-M3 (#45940) 
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Jiangyun Zhu <riverclouds.zhu@qq.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
 2026-06-22 01:23:27 -07:00
Tiezhen WANGGitHubClaudemergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 		d14e551a53 [Model] Remove MiniMaxText01, MiniMaxVL01, MiniMaxForCausalLM (#45993) 
Signed-off-by: Xianbao QIAN <xianbao.qian@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-06-22 15:20:46 +08:00
Tiezhen WANGGitHubClaude
 		d682968aa9 [Model] Remove BambaForCausalLM (#45990) 
Signed-off-by: Xianbao QIAN <xianbao.qian@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
 2026-06-18 06:51:00 -07:00
Tiezhen WANGGitHubClaude
 		89e8645a9e [Model] Remove Dots1ForCausalLM (#45637) 
Signed-off-by: Xianbao QIAN <xianbao.qian@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
 2026-06-17 00:32:18 +08:00
yifei wuGitHubHarry Mellor
 		a52205bccf [Model] Add HrmTextForCausalLM (Hierarchical Reasoning Model — Text) (#43098) 
Signed-off-by: Wuyifei <wuyifei@me.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-06-16 22:41:41 +08:00
Lalithnarayan CGitHubTyler Michael SmithClaudeTyler Michael Smith
 		405c7cf283 [ZenCPU] Add zencpu Platform Runtime Logging and Docs (#42726) 
Signed-off-by: Lalithnarayan C <Lalithnarayan.C@amd.com>
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
 2026-06-16 08:23:12 -04:00
wang.yuqiandGitHub 1d88c4dadd [Docs] Update the online serving docs. (#45676) 
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
 2026-06-15 17:23:36 +08:00
Tiezhen WANGGitHubClaude
 		7df4fe1bd7 [Model] Remove XverseForCausalLM (#45638) 
Signed-off-by: Xianbao QIAN <xianbao.qian@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
 2026-06-14 22:09:00 -07:00
Tiezhen WANGGitHubClaudeIsotr0py
 		f1e13f7df9 [Model] Remove Mono-InternVL (InternLM2VEForCausalLM) (#45129) 
Signed-off-by: Xianbao QIAN <xianbao.qian@gmail.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
 2026-06-12 10:41:09 +00:00
Tiezhen WANGGitHubClaude
 		c9340e6f35 [Model] Remove InternLMForCausalLM registry alias (#45128) 
Signed-off-by: Xianbao QIAN <xianbao.qian@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
 2026-06-11 20:02:51 +00:00
Harry MellorandGitHub 03878d1c22 Deprecations for v0.23 and v0.24 (#44992) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-06-11 14:35:38 +00:00
Harry MellorandGitHub 3cc9fecd58 Deprecated 1st generation Qwen and QwenVL models (#45131) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-06-10 14:55:33 +00:00
Tiezhen WANGGitHubClaude
 		77f42d9725 [Model] Remove obsolete ERNIE models (#45127) 
Signed-off-by: Xianbao QIAN <xianbao.qian@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
 2026-06-10 20:54:30 +08:00
Terrence ZhaoGitHubmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 		1505b3d8a1 [Cohere] Enable Cohere Mini Code model and update Command A-plus test registry (#44707) 
Signed-off-by: Terrencezzj <terrence@cohere.ai>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-06-06 22:44:16 -07:00
Zvi KonsGitHubClaude Opus 4.7
 		b21443e23c Add model support for granite speech plus (#43519) 
Signed-off-by: Zvi Kons[WSL] <zvi@il.ibm.com>
Signed-off-by: Zvi Kons (BlueVela) <zvi@il.ibm.com>
Co-authored-by: Claude Opus 4.7 <noreply@anthropic.com>
 2026-06-04 14:47:48 +00:00
Luciano MartinsGitHubLuciano Martins
 		a248b45d05 [Model] Add Gemma4 Unified (encoder-free) support (#44429) 
Signed-off-by: Luciano Martins <lucianommartins@users.noreply.github.com>
Co-authored-by: Luciano Martins <lucianommartins@users.noreply.github.com>
 2026-06-03 12:01:39 -07:00
Madeesh KannanGitHubRobert Shaw
 		023808c23d [Feature] Add support for JetBrains' Mellum v2 code generation model (#43992) 
Signed-off-by: Madeesh Kannan <madeeswaran.kannan@jetbrains.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
 2026-06-01 10:11:35 -04:00
ltd0924GitHubluotingdanIsotr0pyYu HuangJee Jee Li
 		b690b2bb67 [Model]Support Step-3.7-Flash (#43859) 
Signed-off-by: luotingdan <luotingdan@stepfun.com>
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>
Co-authored-by: luotingdan <luotingdan@stepfun.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: Yu Huang <yuhuang@nvidia.com>
Co-authored-by: Jee Jee Li <jeejeelee@inferact.ai>
 2026-05-28 17:01:48 -07:00
Harry MellorandGitHub 085ac221a3 Deprecate JAISLMHeadModel (#43784) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-05-28 18:29:12 +00:00
MaciejBalaNVGitHubIsotr0pyIsotr0pymergify[bot] <37929162+mergify[bot]@users.noreply.github.com>Roger Wang
 		9aa131f944 Add Cosmos3 Reasoner model (#43356) 
Signed-off-by: Maciej Bala <mbala@nvidia.com>
Signed-off-by: MaciejBalaNV <mbala@nvidia.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
 2026-05-28 09:43:55 -07:00
Wentao YeGitHubmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 		c02c758ea4 [Deprecation] Deprecate functions as scheduled for v0.21.0 (#43358) 
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2026-05-26 19:56:21 -07:00
HolegotsandGitHub 8737e4a857 [Docs] Fix stale version number in token_classify.md (#43489) 
Signed-off-by: holegots <ikun3.1415927@gmail.com>
 2026-05-23 10:42:20 -07:00
HolegotsandGitHub 7c2ff1f819 [Docs] Fix stale version number in token_embed.md (#43488) 
Signed-off-by: holegots <ikun3.1415927@gmail.com>
 2026-05-23 10:06:56 -07:00
wang.yuqiGitHubgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 		2380bfc210 [Docs] Note image preprocessing difference between qwen_vl_utils and vllm. (#43393) 
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-05-22 01:43:14 -07:00
Terrence ZhaoandGitHub 5774aaed0c [Cohere] Enable Cohere MoE (#43143) 
Signed-off-by: Terrencezzj <terrence@cohere.ai>
 2026-05-19 19:32:06 -07:00