c4cd2bd544
[Bugfix] MoRIIO toy P/D proxy: fix DP-rank index aliasing + harden for high-concurrency bursts ( #46115 )
...
Signed-off-by: Edwin Lim <edwin.lim@mangoboost.io >
Co-authored-by: Claude <noreply@anthropic.com >
Co-authored-by: QinPR <1905873179@qq.com >
Co-authored-by: Peiran Qin <66068739+QinPR@users.noreply.github.com >
2026-07-17 12:35:04 -07:00
520a20ba4e
[Bugfix] MoRIIO toy P/D proxy: add /health ( #45222 )
...
Signed-off-by: Chaemin Lim <chaemin.lim@mangoboost.io >
Signed-off-by: Edwin Lim <edwinlim0919@gmail.com >
Co-authored-by: Edwin Lim <edwin.lim@mangoboost.io >
Co-authored-by: Jaeyoun Kim <jaeyoun.kim@mangoboost.io >
Co-authored-by: Edwin Lim <edwinlim0919@gmail.com >
2026-07-14 22:56:46 +00:00
7802c20c4e
[KVConnector][NIXL] Support pipeline-parallel prefill in push mode ( #45880 )
...
Signed-off-by: zixi-qi <zixi@inferact.ai >
Co-authored-by: Nick Hill <nickhill123@gmail.com >
2026-07-08 16:49:23 -07:00
Chaitanya Sri Krishna Lolla and GitHub
5fd442187c
[ROCm][P/D] MoRIIO toy proxy: support JSON Content-Type for OpenAI clients. ( #46482 )
...
Signed-off-by: lcskrishna <lollachaitanya@gmail.com >
2026-07-01 19:17:05 +00:00
wang.yuqi and GitHub
3483240b7e
[Frontend] Consolidate scale out entrypoints ( #44512 )
...
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io >
2026-06-29 03:18:53 -07:00
Samuel Shen and GitHub
c9135db27c
[Docs] Update stale LMCache examples ( #45762 )
...
Signed-off-by: Samuel Shen <slshen@tensormesh.ai >
2026-06-19 03:21:36 +00:00
88ed636218
[KV Connector]: Support KV push from Prefill to Decode node using Nixl KV Connector ( #35264 )
...
Signed-off-by: Sunita Nadampalli <nadampal@amazon.com >
Signed-off-by: NickLucche <nlucches@redhat.com >
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com >
2026-06-12 10:38:41 +00:00
Change72 and GitHub
320c52b134
[Bench] benchmark_serving_multi_turn: make non-standard conversation_id payload opt-in ( #43756 )
...
Signed-off-by: Change72 <cguo51@asu.edu >
2026-06-09 19:41:56 -07:00
Nicolò Lucchesi and GitHub
5add018beb
[Connector] Remove P2pNcclConnector ( #44854 )
...
Signed-off-by: NickLucche <nlucches@redhat.com >
2026-06-08 18:58:29 +08:00
Wentao Ye and GitHub
ea0e501bb1
[KV Connector] Remove compat support for pre-v0.12.0 constructor signatures without KVCacheConfig ( #39832 )
...
The v0.12.0 release contained initial support for HMA in KV Connectors. As part
of these changes, a KVCacheConfig argument was added to KV connector
constructors. Backwards compatibility support for out-of-tree connectors was
included in this change, with a very prominent warning. See #25712 and #27887 .
Since the warning has been around for over 5 months, we can safely remove
the support of it.
Signed-off-by: yewentao256 <zhyanwentao@126.com >
2026-05-09 23:39:46 +00:00
1d694e78c9
[Examples][last/6] Resettle examples. ( #41084 )
...
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io >
Signed-off-by: wang.yuqi <noooop@126.com >
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2026-05-07 19:42:12 -07:00
tej and GitHub
8a4888be21
[ROCm] Profiler api support for ROCm MORI toy proxy server in PD Disaggregation ( #40264 )
...
Signed-off-by: Tej Kiran <kiran.tej@amd.com >
2026-05-07 16:58:38 +08:00
51c1ee9b7c
[Examples] Resettle Disaggregated examples. ( #40759 )
...
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io >
Signed-off-by: wang.yuqi <noooop@126.com >
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2026-05-06 01:20:38 -07:00
