 Bugen ZhaoandGitHub
|
eb44b3aaa4
|
[Rust][Benchmark] Use async HTTP clients (#49295)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-07-21 16:53:57 +08:00 |
|
|
Bugen ZhaoandGitHub
|
8688a06d67
|
[Rust][Benchmark] Use tracing for logs (#48937)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-07-21 05:18:13 +00:00 |
|
|
|
1940c8441e
|
[Rust Frontend][gRPC] Add engine-aware health reporting (#48992)
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Signed-off-by: Connor Carpenter <connorc@nvidia.com>
|
2026-07-21 10:54:39 +08:00 |
|
|
Bugen ZhaoandGitHub
|
e2d7adeb64
|
[Rust Frontend] Bump xgrammar-structural-tag and enable local extension (#49161)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-07-20 16:22:24 +01:00 |
|
|
|
c01618fdc8
|
[Rust][Benchmark] Integrate vllm-bench to vllm-rs & vllm CLI (#48930)
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-07-20 09:31:25 +00:00 |
|
|
|
9354f22204
|
[Rust][Benchmark] Port in vllm-bench (#48107)
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Signed-off-by: esmeetu <jasonailu87@gmail.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-07-17 14:25:29 +08:00 |
|
|
+1
|
6570c9800c
|
[Model] Add Inkling model support [1/N] (#48799)
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Giancarlo Delfin <32987265+TheEpicDolphin@users.noreply.github.com>
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: Isotr0py <mozf@inferact.ai>
Co-authored-by: Jee Jee Li <jeejeelee@inferact.ai>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Yifan Qiao <yifanqiao@inferact.ai>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
|
2026-07-15 23:40:07 -07:00 |
|
|
|
e281ac663a
|
[Rust Frontend] Integrate MM audio support (#48554)
Co-authored-by: Isotr0py <Isotr0py@outlook.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
|
2026-07-15 15:00:17 +08:00 |
|
|
Bugen ZhaoandGitHub
|
074bdd0d99
|
[Rust Frontend] Integrate MM video support (#47959)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-07-10 08:15:33 +00:00 |
|
|
Isotr0pyandGitHub
|
400a9c386d
|
[Rust Frontend] Bump llm-multimodal version (#47530)
Signed-off-by: Isotr0py <Isotr0py@outlook.com>
|
2026-07-03 09:48:36 +00:00 |
|
|
Bugen ZhaoandGitHub
|
7a327f0b4f
|
[Rust Frontend] Simplify unit tests with shared TestTokenizer (#47125)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-06-30 15:34:43 +01:00 |
|
|
|
b8cb75b149
|
[Rust Frontend] Add static HTTPS and mTLS support for HTTP and gRPC (#45890)
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Signed-off-by: Tahsin Tunan <tahsintunan@gmail.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-06-30 01:45:59 +00:00 |
|
|
Bugen ZhaoandGitHub
|
5274c1181d
|
[Rust Frontend] Add Harmony Renderer for GPT-OSS (#46800)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-06-29 03:39:04 +00:00 |
|
|
Bugen ZhaoandGitHub
|
e71bc6da85
|
[Rust Frontend] Use oss-harmony for Harmony output processing (#46799)
|
2026-06-26 08:24:13 -07:00 |
|
|
Bugen ZhaoandGitHub
|
ae7c8ec223
|
[Rust Frontend] Switch rustls to native-tls/OpenSSL (#46696)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-06-25 17:19:44 -07:00 |
|
|
Bugen ZhaoandGitHub
|
1d3f4cb3a4
|
[Rust Frontend] Extract renderer fixture test utilities (#46719)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-06-25 17:12:38 -07:00 |
|
|
Bugen ZhaoandGitHub
|
76c3c4ff63
|
[Rust Frontend] Introduce unified parser interface & combined parser (#46583)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-06-25 03:17:31 +00:00 |
|
|
|
4ed8eaafb0
|
[Rust Frontend] Integrate xgrammar-structural-tag for strict and required tool calling (#46057)
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-06-24 10:46:49 +08:00 |
|
|
Bugen ZhaoandGitHub
|
25bc3be49c
|
[Rust Frontend] Correct --reasoning-parser semantics (#46359)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-06-23 15:38:39 +08:00 |
|
|
Tahsin TunanandGitHub
|
7299e6509e
|
[Rust Frontend] Return model metadata fields in /v1/models (#45950)
Signed-off-by: Tahsin Tunan <tahsintunan@gmail.com>
|
2026-06-18 10:29:21 +00:00 |
|
|
Sahil SinghandGitHub
|
64833f8158
|
[Rust Frontend] Add external→internal request-id map for abort() (#45137)
Signed-off-by: Sahil Singh <sahiilsiingh37@gmail.com>
|
2026-06-15 06:51:24 +00:00 |
|
|
|
cc640ee8bc
|
[Rust Frontend][Metrics] Export vllm:lora_requests_info from frontend (#45030)
Signed-off-by: Will Eaton <weaton@redhat.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-06-11 06:45:03 -07:00 |
|
|
Bugen ZhaoandGitHub
|
43914dd743
|
[Rust Frontend] Add Python bridge for Rust tool parsers (#44624)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-06-11 04:51:06 +00:00 |
|
|
|
d841386d27
|
[Rust Frontend] Support API key authentication (#44321)
Signed-off-by: RickyChen / 陳昭儒 <ricky.chen@infinirc.com>
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
|
2026-06-09 10:15:20 +00:00 |
|
|
Bugen ZhaoandGitHub
|
449be4f934
|
[Rust Frontend] Fix several hf chat template rendering issues (#44311)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-06-03 01:04:43 -07:00 |
|
|
Bugen ZhaoandGitHub
|
c87f62ccf8
|
[Rust Frontend] Introduce mock engine for benchmark baseline (#43469)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-05-28 01:40:35 +00:00 |
|
|
Bugen ZhaoandGitHub
|
396c8fee50
|
[Rust Frontend] Align tool parser fallback behavior between streaming & non-streaming paths (#43662)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-05-27 10:13:12 +00:00 |
|
|
Bugen ZhaoandGitHub
|
0b68f21e7c
|
[Rust Frontend] Add reasoning/tool parser & renderer roundtrip tests (#43582)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
|
2026-05-27 00:49:30 +00:00 |
|
|
|
39910f2b25
|
[Rust Frontend] Move code from vllm-frontend-rs (#43283)
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Signed-off-by: Eric Curtin <eric.curtin@docker.com>
Signed-off-by: Dev-X25874 <283057883+Dev-X25874@users.noreply.github.com>
Signed-off-by: Will.hou <1205157517@qq.com>
Signed-off-by: Will.hou <willamhou@ceresman.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Eric Curtin <eric.curtin@docker.com>
Co-authored-by: Dev-X25874 <283057883+Dev-X25874@users.noreply.github.com>
Co-authored-by: Will.hou <1205157517@qq.com>
Co-authored-by: Will.hou <willamhou@ceresman.com>
Please see https://github.com/Inferact/vllm-frontend-rs for full original commit history.
|
2026-05-21 17:21:48 -07:00 |
|