|
8df14cfc8c
|
[EC Connector] Add EC Transfer Params (#42433)
Signed-off-by: omerpaz95 <omerpaz95@gmail.com>
Co-authored-by: Or Ozeri <oro@il.ibm.com>
|
2026-07-12 14:35:33 +03:00 |
|
|
|
83762b77b0
|
[Frontend] Add /abort_requests to the RLHF dev API router (#47173)
Signed-off-by: aoshen02 <aoshen@inferact.ai>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-07-12 14:21:02 +08:00 |
|
|
|
c241c7a2b0
|
[Rust Frontend] Add roundtrip fixtures for more chat parsers (#47883)
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Signed-off-by: reidliu41 <reid201711@gmail.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-07-10 10:03:58 +00:00 |
|
|
Bugen ZhaoandGitHub
|
074bdd0d99
|
[Rust Frontend] Integrate MM video support (#47959)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-07-10 08:15:33 +00:00 |
|
|
|
dcdd756d75
|
[CI] GSM8K eval integration test for KV offloading (#46893)
Signed-off-by: Tyler Michael Smith <tyler@tylermsmith.com>
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Signed-off-by: Itay Etelis <itay.etelis@ibm.com>
Signed-off-by: Itay Etelis <92247226+Etelis@users.noreply.github.com>
Signed-off-by: Or Ozeri <oro@il.ibm.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Co-authored-by: Itay Etelis <92247226+Etelis@users.noreply.github.com>
Co-authored-by: Itay Etelis <itay.etelis@ibm.com>
Co-authored-by: Or Ozeri <oro@il.ibm.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-07-08 17:59:48 -04:00 |
|
|
Bugen ZhaoandGitHub
|
2cae98dfa5
|
[Rust Frontend] Handle continue_final_message with renderer sentinel (#47844)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-07-08 12:57:04 +01:00 |
|
|
Harry MellorandGitHub
|
dd94484577
|
Bump Transformers version to 5.10.4 (#41359)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2026-07-07 05:13:28 -07:00 |
|
|
|
e55cc59e52
|
[Rust Frontend][CI] Unblock more end-to-end test cases (#47735)
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-07-07 08:27:20 +00:00 |
|
|
Tahsin TunanandGitHub
|
34e6dfced8
|
[Rust Frontend] Stamp arrival_time at the frontend entry (#47787)
Signed-off-by: Tahsin Tunan <tahsintunan@gmail.com>
|
2026-07-07 03:27:10 +00:00 |
|
|
ReidandGitHub
|
39a1d32b59
|
[Rust Frontend] Avoid extra copies for multimodal tensors (#47581)
Signed-off-by: reidliu41 <reid201711@gmail.com>
|
2026-07-07 03:09:55 +00:00 |
|
|
ReidandGitHub
|
a46c9329e5
|
[Rust Frontend] Add DeepSeek V3.2 roundtrip fixture (#47619)
Signed-off-by: reidliu41 <reid201711@gmail.com>
|
2026-07-07 10:47:02 +08:00 |
|
|
|
8f4c69b222
|
[Rust Frontend] Cache metric handles for scheduler & request stats (#47444)
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-07-06 13:02:59 +00:00 |
|
|
Bugen ZhaoandGitHub
|
8651f043b8
|
[Rust Frontend] Speed up chat roundtrip tests (#47523)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-07-03 19:25:06 +01:00 |
|
|
Isotr0pyandGitHub
|
400a9c386d
|
[Rust Frontend] Bump llm-multimodal version (#47530)
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
|
2026-07-03 09:48:36 +00:00 |
|
|
|
6429d5f527
|
[Rust Frontend] add repetition_detection support to sampling params (#46684)
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-07-03 14:06:23 +08:00 |
|
|
ReidandGitHub
|
9b8e76589d
|
[Rust Frontend] Recover buffered text from incomplete tool calls at EOS (#47289)
Signed-off-by: reidliu41 <reid201711@gmail.com>
|
2026-07-03 03:45:03 +00:00 |
|
|
|
1aeabec355
|
[Bugfix][Rust Frontend] Tolerate out-of-vocab prompt ids in detokenizer (#44682)
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Signed-off-by: Ting Sun <suntcrick@gmail.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-07-03 03:41:53 +00:00 |
|
|
Bugen ZhaoandGitHub
|
ec0ffaacc8
|
[Rust Frontend] Improve scheduler stats logging parity (#47435)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-07-02 15:55:25 +01:00 |
|
|
Bugen ZhaoandGitHub
|
25fcb65d51
|
[Rust Frontend] Use enum-backed domain types for engine outputs and structured outputs (#47283)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-07-02 10:41:46 +01:00 |
|
|
|
08a8a4af3f
|
feat(rust): expose profiler control routes in Rust frontend (#46306)
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-07-02 08:46:07 +00:00 |
|
|
Bugen ZhaoandGitHub
|
c638f9216a
|
[Rust Frontend] Split engine core DTOs into separate modules (#47265)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-07-01 15:28:21 +01:00 |
|
|
Blas Rodriguez IrizarandGitHub
|
5b431b905c
|
[Rust Frontend] Coerce completion max_tokens: null to default (#47166)
Signed-off-by: Blas Rodriguez Irizar <rodrigblas@gmail.com>
|
2026-07-01 06:41:33 +00:00 |
|
|
Maria GuevaraandGitHub
|
aeb35b90f0
|
[Rust Frontend] Add error context in tool parser failures (#46512)
Signed-off-by: Maria Guevara <kawaiiplush14@gmail.com>
|
2026-07-01 12:48:55 +08:00 |
|
|
Bugen ZhaoandGitHub
|
7a327f0b4f
|
[Rust Frontend] Simplify unit tests with shared TestTokenizer (#47125)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-06-30 15:34:43 +01:00 |
|
|
Bugen ZhaoandGitHub
|
3675bcff67
|
[Rust Frontend] Refactor TLS serve path with unified MaybeTlsListener (#47101)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-06-30 14:31:58 +01:00 |
|
|
Bugen ZhaoandGitHub
|
bdbd7278b6
|
[Rust Frontend] Extend renderer/parser roundtrip tests to support token ids (#47110)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-06-30 14:27:45 +01:00 |
|
|
Blas Rodriguez IrizarandGitHub
|
e45c8a9f4b
|
[Rust Frontend] Start current wave for a stale DP FirstRequest (#46833)
Signed-off-by: Blas Rodriguez Irizar <rodrigblas@gmail.com>
|
2026-06-30 05:13:09 +00:00 |
|
|
ReidandGitHub
|
930f8dc0a1
|
[Bugfix][Rust Frontend] Reject prompt_logprobs for streaming generate (#46839)
Signed-off-by: reidliu41 <reid201711@gmail.com>
|
2026-06-30 05:10:07 +00:00 |
|
|
ReidandGitHub
|
a16dbd5b85
|
[Rust Frontend] Avoid LoRA registry scans without active LoRA requests (#47040)
Signed-off-by: reidliu41 <reid201711@gmail.com>
|
2026-06-30 04:58:19 +00:00 |
|
|
|
b8cb75b149
|
[Rust Frontend] Add static HTTPS and mTLS support for HTTP and gRPC (#45890)
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Signed-off-by: Tahsin Tunan <tahsintunan@gmail.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-06-30 01:45:59 +00:00 |
|
|
Blas Rodriguez IrizarandGitHub
|
6185d73882
|
[Rust Frontend] Keep literal "null" string for string-typed tool params (#46827)
Signed-off-by: Blas Rodriguez Irizar <rodrigblas@gmail.com>
|
2026-06-29 13:46:33 +00:00 |
|
|
Bugen ZhaoandGitHub
|
5274c1181d
|
[Rust Frontend] Add Harmony Renderer for GPT-OSS (#46800)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-06-29 03:39:04 +00:00 |
|
|
Bugen ZhaoandGitHub
|
e71bc6da85
|
[Rust Frontend] Use oss-harmony for Harmony output processing (#46799)
|
2026-06-26 08:24:13 -07:00 |
|
|
ReidandGitHub
|
e312c5cb25
|
[Rust Frontend] Make Granite4 string argument scanning incremental (#46507)
Signed-off-by: reidliu41 <reid201711@gmail.com>
|
2026-06-26 03:54:03 +00:00 |
|
|
|
d350fa8ddd
|
[Bugfix][Rust Frontend] Reject min_tokens above max_tokens (#46733)
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Signed-off-by: reidliu41 <reid201711@gmail.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-06-26 03:41:33 +00:00 |
|
|
Bugen ZhaoandGitHub
|
ae7c8ec223
|
[Rust Frontend] Switch rustls to native-tls/OpenSSL (#46696)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-06-25 17:19:44 -07:00 |
|
|
Bugen ZhaoandGitHub
|
1d3f4cb3a4
|
[Rust Frontend] Extract renderer fixture test utilities (#46719)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-06-25 17:12:38 -07:00 |
|
|
Bugen ZhaoandGitHub
|
f9e684499f
|
[Rust Frontend] Migrate gemma4 to unified parser (#46602)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-06-25 16:59:57 -07:00 |
|
|
Bugen ZhaoandGitHub
|
4d3b4b9b01
|
[Rust Frontend] Make ToolParserOutput a seq of ToolParserEvent to preserve order (#46584)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-06-25 06:27:07 +00:00 |
|
|
Bugen ZhaoandGitHub
|
76c3c4ff63
|
[Rust Frontend] Introduce unified parser interface & combined parser (#46583)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-06-25 03:17:31 +00:00 |
|
|
Roy WangandGitHub
|
160c80a34c
|
[Rust Frontend] Raise frontend JSON body limit (#46582)
Signed-off-by: esmeetu <jasonailu87@gmail.com>
|
2026-06-24 12:15:31 +00:00 |
|
|
|
4cd1a84c88
|
[Model] Remove BaiChuanForCausalLM and BaichuanForCausalLM (#46362)
Signed-off-by: Xianbao QIAN <xianbao.qian@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-06-24 16:13:57 +08:00 |
|
|
|
ce9f64020b
|
[Rust Frontend] Pass effective reasoning_parser_kwargs for structured output (#46360)
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-06-24 03:13:44 +00:00 |
|
|
|
4ed8eaafb0
|
[Rust Frontend] Integrate xgrammar-structural-tag for strict and required tool calling (#46057)
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-06-24 10:46:49 +08:00 |
|
|
|
2d721ab5d8
|
[Rust Frontend] Align Rust allowed_token_ids validation with Python (#46348)
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Signed-off-by: reidliu41 <reid201711@gmail.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-06-23 08:32:33 +00:00 |
|
|
|
accaa434f3
|
[Rust Frontend] Support echo for token-ID completion prompts (#46219)
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Signed-off-by: reidliu41 <reid201711@gmail.com>
|
2026-06-23 08:04:41 +00:00 |
|
|
Bugen ZhaoandGitHub
|
25bc3be49c
|
[Rust Frontend] Correct --reasoning-parser semantics (#46359)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-06-23 15:38:39 +08:00 |
|
|
|
a8481be7a9
|
[Rust Frontend][Perf] Use dedicated runtime for HTTP/request-processing/ZMQ (#46051)
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-06-23 04:03:20 +00:00 |
|
|
|
80abe0de7d
|
[Rust Frontend] Support thinking_token_budget for chat and completions (#46137)
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Signed-off-by: RickyChen / 陳昭儒 <ricky.chen@infinirc.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-06-22 16:00:02 +08:00 |
|
|
|
d14e551a53
|
[Model] Remove MiniMaxText01, MiniMaxVL01, MiniMaxForCausalLM (#45993)
Signed-off-by: Xianbao QIAN <xianbao.qian@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-06-22 15:20:46 +08:00 |
|