|
fa1fa968c4
|
[Misc] Forward request-level prompt extras for cross-encoder scoring (#46939)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
|
2026-07-04 10:18:36 -04:00 |
|
|
|
6eac8e0070
|
[Misc] Preserve cross-encoder pooling extra kwargs (#47082)
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-07-04 08:14:13 -04:00 |
|
|
|
1a308c449c
|
[XPU] Add W8A8 FP8 linear kernel with multi-granularity quant support (#43645)
Signed-off-by: Chaojun,Zhang <chaojun.zhang@intel.com>
Signed-off-by: Chaojun Zhang <chaojun.zhang@intel.com>
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
|
2026-07-04 18:10:01 +08:00 |
|
|
|
e7c9df9449
|
[Bugfix][Structured Output][Spec Decode] Constrain bitmask and trim grammar advance at the reasoning boundary (#44297)
Signed-off-by: Allen.Yu <yuyue0225sc@163.com>
Signed-off-by: yue.yu <yuyue0225sc@163.com>
Co-authored-by: Benjamin Chislett <chislett.ben@gmail.com>
|
2026-07-04 09:08:45 +00:00 |
|
|
gausah01andGitHub
|
26eb87204d
|
[Bugfix] Fix CPU split-KV scratchpad sizing (#45844)
Signed-off-by: Gauri Sahnan <gauri.sahnan@arm.com>
|
2026-07-04 06:47:23 +00:00 |
|
|
|
4c3c17d43b
|
[ROCm] Disable persistent sparse-MLA kernel for chunked-prefill continuations (#47567)
Signed-off-by: Rohan Potdar <rohan.potdar@amd.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-07-04 01:21:43 -05:00 |
|
|
|
f329ce405b
|
[ROCm][CI][Bugfix] Use VllmRunner for voxtral_realtime tests to avoid OOM on AMD GPU (#47536)
Signed-off-by: Shanshan Shen <87969357+shen-shanshan@users.noreply.github.com>
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-07-04 12:26:10 +08:00 |
|
|
|
07516fda67
|
[MRV2][SD] Make Dynamic SD comatible with Full Cuda Graphs (#45953)
Signed-off-by: Ekagra Ranjan <3116519+ekagra-ranjan@users.noreply.github.com>
Co-authored-by: Benjamin Chislett <chislett.ben@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
|
2026-07-03 23:58:27 -04:00 |
|
|
|
67ff0ae30f
|
Support nvfp4 kv with kv-cache-dtype-skip-layers sliding_window (#42890)
Signed-off-by: Shiyang Chen <shiychen@nvidia.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-07-04 02:29:13 +00:00 |
|
|
Bugen ZhaoandGitHub
|
ab3b6d97aa
|
[Frontend] Limit SO_REUSEPORT to multi-worker serving (#47529)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-07-04 01:26:24 +00:00 |
|
|
Ben BrowningandGitHub
|
fb5291b35b
|
[Frontend] [Parser] Port DeepSeek V4 to streaming parser engine framework (#45877)
Signed-off-by: Ben Browning <bbrownin@redhat.com>
|
2026-07-03 20:55:23 -04:00 |
|
|
labAxiaomingandGitHub
|
d6d39c111e
|
[GLM4V] Avoid GLM4V processor init during startup metadata reads (#47155)
Signed-off-by: xiaoming <1259730330@qq.com>
|
2026-07-03 15:03:16 -07:00 |
|
|
|
379950191f
|
[Bugfix][Multimodal] Normalize direct PIL image inputs (#47566)
Signed-off-by: Ting Sun <suntcrick@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
|
2026-07-03 14:27:14 -07:00 |
|
|
|
576bf75d0e
|
[AMD][EPLB] Enable EPLB for Quark OCP MXFP4 MoE (#47220)
Signed-off-by: okorzh-amd <okorzh-amd@users.noreply.github.com>
Co-authored-by: okorzh-amd <okorzh-amd@users.noreply.github.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-07-03 14:41:52 -05:00 |
|
|
TresandGitHub
|
f006e5a24c
|
[CI][AMD] Allow git operations on previously created work trees (#47554)
Signed-off-by: Tres Popp <tres.popp@amd.com>
|
2026-07-03 14:41:01 -05:00 |
|
|
|
f63dca6838
|
[ROCm] Fix encoder-decoder cross-attention KV layout aliasing (#47035)
Signed-off-by: Djordje Ramic <djoramic@amd.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
|
2026-07-03 13:53:29 -05:00 |
|
|
Bugen ZhaoandGitHub
|
8651f043b8
|
[Rust Frontend] Speed up chat roundtrip tests (#47523)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-07-03 19:25:06 +01:00 |
|
|
Andreas KaratzasandGitHub
|
3775d5fcab
|
[ROCm][CI] Adding test groups for parity with upstream (#47479)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
|
2026-07-03 19:15:01 +04:00 |
|
|
|
d7192cfccf
|
[CI Bugfix] Lazily import Qwen warmup dependencies (#47539)
Signed-off-by: LopezCastroRoberto <rocastro@redhat.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-07-03 23:10:49 +08:00 |
|
|
AgenticSparkandGitHub
|
978de83353
|
[Bugfix][CPU] Ship examples/ in the CPU release image (#47447)
Signed-off-by: liejiang <jianglie2023@gmail.com>
|
2026-07-03 11:46:24 +00:00 |
|
|
wang.yuqiandGitHub
|
a14f57a3ac
|
[Frontend] Refine the entrypoint class's inheritance hierarchy. (#47498)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
|
2026-07-03 10:50:06 +00:00 |
|
|
|
18f658bb31
|
[Bugfix][Frontend] Fix batch chat endpoint corrupting logprobs when return_token_ids is set (#47384)
Signed-off-by: David Feng <fenghourun@meta.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-07-03 03:01:34 -07:00 |
|
|
Isotr0pyandGitHub
|
400a9c386d
|
[Rust Frontend] Bump llm-multimodal version (#47530)
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
|
2026-07-03 09:48:36 +00:00 |
|
|
Max de BayserandGitHub
|
bbdcbe4686
|
Move Roberta remaining nn.Embedding to VocabParallelEmbedding (#47452)
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
|
2026-07-03 09:47:50 +00:00 |
|
|
Kalyanam DewriandGitHub
|
4875b4456b
|
[Doc] Fix VLM2Vec benchmark chat template path (#47517)
Signed-off-by: kalyanamdewri <kalyanampriyam@gmail.com>
|
2026-07-03 08:24:45 +00:00 |
|
|
Dakai AnandGitHub
|
1f486d96a1
|
Add Triton Backend for Unlimited-OCR R-SWA (#47102)
Signed-off-by: Dakai An <dakaian108@gmail.com>
|
2026-07-03 00:11:50 -07:00 |
|
|
Bugen ZhaoandGitHub
|
b790c84cde
|
[CI] Enable sccache for Rust build under CUDA/ROCm (#45246)
|
2026-07-02 23:45:41 -07:00 |
|
|
|
6429d5f527
|
[Rust Frontend] add repetition_detection support to sampling params (#46684)
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-07-03 14:06:23 +08:00 |
|
|
Chris LeonardandGitHub
|
fbc9ba6d30
|
New stable abi cleanup (#46656)
Signed-off-by: Chris Leonard <chleonar@redhat.com>
|
2026-07-03 14:02:26 +08:00 |
|
|
xiangdongandGitHub
|
2dfaae752b
|
[XPU][CI]Fix dependency typo in Intel GPU CI (#47510)
Signed-off-by: zengxian <xiangdong.zeng@intel.com>
|
2026-07-03 04:11:47 +00:00 |
|
|
Evgeny ParshutinandGitHub
|
bd8d9021ce
|
[CPU][Build] Enable oneDNN ITT task collection by default for CPU primitive-level profiling (#47467)
Signed-off-by: Evgeny Parshutin <eugeny.parshutin@intel.com>
|
2026-07-03 04:00:19 +00:00 |
|
|
xiangdongandGitHub
|
3f0b773b30
|
[XPU][CI]Mv huggingface cache to larger disk in Intel GPU CI (#47405)
Signed-off-by: zengxian <xiangdong.zeng@intel.com>
|
2026-07-03 11:56:17 +08:00 |
|
|
ReidandGitHub
|
9b8e76589d
|
[Rust Frontend] Recover buffered text from incomplete tool calls at EOS (#47289)
Signed-off-by: reidliu41 <reid201711@gmail.com>
|
2026-07-03 03:45:03 +00:00 |
|
|
|
1aeabec355
|
[Bugfix][Rust Frontend] Tolerate out-of-vocab prompt ids in detokenizer (#44682)
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Signed-off-by: Ting Sun <suntcrick@gmail.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-07-03 03:41:53 +00:00 |
|
|
|
979f5511d7
|
[Bugfix][Gemma4] Keep image bidirectional attention within the sliding window (#47217)
Signed-off-by: Luciano Martins <lucianommartins@users.noreply.github.com>
Co-authored-by: Luciano Martins <lucianommartins@users.noreply.github.com>
|
2026-07-02 19:57:41 -07:00 |
|
|
|
41de1380c2
|
[BugFix] Derive FlashInfer Q dtype from resolved per-group builder state (#47485)
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-07-02 19:33:28 -07:00 |
|
|
Nick HillandGitHub
|
d85601c20f
|
[CI] Pin modelscope version to fix test breakage (#47465)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
|
2026-07-02 19:33:08 -07:00 |
|
|
Nick HillandGitHub
|
276b837dc4
|
[ModelRunner V2][BugFix] Free all model refs on shutdown (#47483)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
|
2026-07-02 19:32:48 -07:00 |
|
|
|
34bf7b45a0
|
[CI] intel CI: add quantization and awq case for xpu (#46456)
Signed-off-by: wenjun.liu <wenjun.liu@intel.com>
Signed-off-by: zengxian <xiangdong.zeng@intel.com>
Co-authored-by: zengxian <xiangdong.zeng@intel.com>
|
2026-07-03 09:51:56 +08:00 |
|
|
adamkbaranowskiandGitHub
|
4c3c64fcf7
|
Add Laguna XS.2.1 DFlash drafter support (#46853)
Signed-off-by: Adam Baranowski <adam.baranowski@poolside.ai>
|
2026-07-02 18:09:27 -07:00 |
|
|
Andreas KaratzasandGitHub
|
442ccc6098
|
[ROCm][CI] Adding extract hs 2gpu (#47482)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
|
2026-07-02 17:59:38 -07:00 |
|
|
Andreas KaratzasandGitHub
|
6768fbc76f
|
[ROCm][CI] Adding qwen3 dp4 eplb (#47480)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
|
2026-07-02 17:58:56 -07:00 |
|
|
Andreas KaratzasandGitHub
|
407f406300
|
[ROCm][CI] Adding metadata (#47477)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
|
2026-07-02 17:45:23 -07:00 |
|
|
Harry MellorandGitHub
|
e24d1b24fe
|
Fix Transformers modeling backend usage stats (#47472)
|
2026-07-02 12:51:23 -07:00 |
|
|
|
d29125c085
|
Xqa decode kernels (#43232)
Signed-off-by: Dan Blanaru <48605845+DanBlanaru@users.noreply.github.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
|
2026-07-02 12:32:05 -07:00 |
|
|
Michael GoinandGitHub
|
d715b3aa1e
|
Delete PagedAttention (#47361)
Signed-off-by: mgoin <mgoin64@gmail.com>
|
2026-07-02 12:31:26 -07:00 |
|
|
Joe RowellandGitHub
|
258f8de91f
|
[Bugfix][Tool Parser] poolside_v1: accept tool calls without newline after function name (#47311)
Signed-off-by: Joe Rowell <joerowell4@gmail.com>
|
2026-07-02 12:08:37 -07:00 |
|
|
Nick HillandGitHub
|
e392bf7a68
|
[BugFix][MRV2] Ensure all req slots are accounted for when scheduling (#46974)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
|
2026-07-02 10:19:24 -07:00 |
|
|
Nick HillandGitHub
|
443e68cfa6
|
[Bugfix] Fix pooled Whisper encoder sliding-window kernel size (#47437)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
|
2026-07-02 10:19:11 -07:00 |
|
|
ChaunceyandGitHub
|
320ee285c9
|
[Model Runner V2][Perf] Warm up GLM-5.2 DSA indexer prefill metadata kernel (#47285)
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
|
2026-07-02 16:31:31 +00:00 |
|