forked from Karylab-cklius/vllm
Signed-off-by: Andreas Karatzas <akaratza@amd.com> (cherry picked from commit4c078fa546) (cherry picked from commita976961fb7)
Signed-off-by: Andreas Karatzas <akaratza@amd.com> (cherry picked from commit4c078fa546) (cherry picked from commita976961fb7)