 Change72andGitHub
|
320c52b134
|
[Bench] benchmark_serving_multi_turn: make non-standard conversation_id payload opt-in (#43756)
Signed-off-by: Change72 <cguo51@asu.edu>
|
2026-06-09 19:41:56 -07:00 |
|
|
|
1c2ffc6f88
|
feat(multi-turn-bench): add api_key and custom headers for multi turn benchmark (#44516)
Signed-off-by: Jimmy <jinmingyi1998@sina.cn>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: simon-mo <simon.mo@hey.com>
|
2026-06-09 14:00:07 -07:00 |
|
|
Tyko NiemiandGitHub
|
cad4ca12b8
|
[Bugfix] Add X-Session-ID from conversation_id in multi-turn benchmark (#44663)
Signed-off-by: Tyko Niemi <tyko.niemi@amd.com>
|
2026-06-09 08:57:00 -07:00 |
|
|
|
4845aee6b7
|
[Benchmark] Add --trust-remote-code flag to multi-turn benchmark (#41661)
Signed-off-by: Dao Le <daole@inferact.ai>
Signed-off-by: Dao Le <Dao007forever@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-05-05 01:00:37 -07:00 |
|
|
snadampalandGitHub
|
3179e53135
|
[P/D] Prefill compute optimizations with bi-directional KV cache transfers between P and D nodes (#32553)
Signed-off-by: Sunita Nadampalli <nadampal@amazon.com>
|
2026-04-30 10:14:20 +00:00 |
|
|
Nicolò LucchesiandGitHub
|
8625ec267b
|
[Misc] Multi-turn benchmark output performance json (#39572)
Signed-off-by: NickLucche <nlucches@redhat.com>
|
2026-04-13 18:15:23 +00:00 |
|
|
Cyrus LeungandGitHub
|
792a74b973
|
[Doc] Improve UX of --enable-log-requests (#35723)
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
|
2026-03-02 08:24:09 -08:00 |
|
|
Ido SegevandGitHub
|
49a986ecd4
|
[Benchmark] multi_turn: Report warmup-inclusive runtime (#28937)
Signed-off-by: Ido Segev <idos@pliops.com>
|
2025-11-18 16:38:22 +00:00 |
|
|
ai-jzandGitHub
|
d231876ce3
|
[Benchmark] Fix client seed synchronization in multi-turn benchmark (#28512)
Signed-off-by: ai-jz <aijz.xplr@gmail.com>
|
2025-11-16 15:04:32 +08:00 |
|
|
ai-jzandGitHub
|
f31419ed8b
|
[Benchmark] Add retry support to fix workload bias in multi-turn benchmark (#28493)
|
2025-11-12 05:00:45 +00:00 |
|
|
Ido SegevandGitHub
|
3380543b20
|
Add request timeout override for multi-turn benchmarks (#28386)
Signed-off-by: Ido Segev <idos@pliops.com>
|
2025-11-11 13:41:18 +00:00 |
|
|
Ido SegevandGitHub
|
d381eb967f
|
Multi turn benchmark progress bar for synthetic conversation generation (#28394)
Signed-off-by: Ido Segev <idos@pliops.com>
|
2025-11-11 11:06:04 +00:00 |
|
|
ai-jzandGitHub
|
2c0c7c39bd
|
feat(benchmarks): support HF model names in multi-turn benchmark (#27850)
|
2025-11-01 08:04:52 +00:00 |
|
|
Harry MellorandGitHub
|
6c9fdbf725
|
[Docs] Replace rst style double-backtick with md single-backtick (#27091)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2025-10-17 02:47:34 -07:00 |
|
|
Harry MellorandGitHub
|
8fcaaf6a16
|
Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2025-10-12 09:51:31 -07:00 |
|
|
Harry MellorandGitHub
|
e09d1753ec
|
Remove Python 3.9 support ahead of PyTorch 2.9 in v0.11.1 (#26416)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2025-10-08 10:40:42 -07:00 |
|
|
Daniel SerebrenikandGitHub
|
43a62c51be
|
Add more documentation and improve usability of lognormal dist (benchmark_serving_multi_turn) (#23255)
Signed-off-by: daniels <daniels@pliops.com>
|
2025-09-17 05:53:17 +00:00 |
|
|
|
83609ca91d
|
[Doc]: fix typos in Python comments (#24173)
Signed-off-by: Didier Durand <durand.didier@gmail.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
|
2025-09-04 08:52:17 -07:00 |
|
|
Daniel SerebrenikandGitHub
|
3c8a787247
|
[Benchmark] Add flag --served-model-name to benchmark_serving_multi_turn (#22889)
Signed-off-by: daniels <daniels@pliops.com>
|
2025-08-19 07:48:07 +00:00 |
|
|
Daniel SerebrenikandGitHub
|
e5d3d63c42
|
[Benchmark] Fix terminal colors in benchmark_serving_multi_turn (python 3.12) (#22730)
Signed-off-by: daniels <daniels@pliops.com>
|
2025-08-12 14:41:37 +00:00 |
|
|
Daniel SerebrenikandGitHub
|
f0964e29cb
|
[Benchmark] Add benchmark tool for multi turn conversations (#20267)
|
2025-08-08 10:28:50 -07:00 |
|