Compare commits

...
Author SHA1 Message Date
Cyrus LeungandGitHub 423ff4ebaa Merge branch 'main' into zhuohan/remove-unnecessary-instance_id-setup 2026-03-12 15:52:39 +08:00
Zhuohan LiandGitHub 72ee63dd34 Remove instance ID initialization logic
Remove instance ID assignment if not set. This logic is never run since we set instance id at https://github.com/vllm-project/vllm/blob/4e95ec111cd179f2ab0f6931bf57663f828a51ec/vllm/config/vllm.py#L661-L662

Signed-off-by: Zhuohan Li <zhuohan123@gmail.com>
2026-03-09 19:51:38 -07:00
-3
View File
@@ -1114,9 +1114,6 @@ class VllmConfig:
self.model_config.disable_cascade_attn = True
logger.warning_once("Disabling cascade attention when DBO is enabled.")
if not self.instance_id:
self.instance_id = random_uuid()[:5]
# Hybrid KV cache manager (HMA) runtime rules:
# - Explicit enable (--no-disable-kv-cache-manager): error if runtime
# disables it