forked from Karylab-cklius/vllm
[Bugfix][KV Offloading] Fix stale transfer_jobs after reset_cache + harden job completion (#48102)
Signed-off-by: Alex <alex.tech.lab@outlook.com>
This commit is contained in:
@@ -1310,6 +1310,7 @@ class OffloadingConnectorScheduler:
|
||||
for status in self._req_status.values():
|
||||
for group_state in status.group_states:
|
||||
group_state.next_stored_block_idx = 0
|
||||
status.transfer_jobs.clear()
|
||||
|
||||
# Discard jobs and save job_counter to be able to discard worker responses
|
||||
self._stale_job_threshold = self._job_counter
|
||||
|
||||
Reference in New Issue
Block a user