vllm/tests/async_engine at a62de9ecfdc6bfc80db3d0d1136124c74c94ea04 - vllm - Gitea: Git with a cup of macha paffe

karylab_agents/vllm

forked from Karylab-cklius/vllm

Files

T

History

080438477f Start background task in AsyncLLMEngine.generate (#988 )

Co-authored-by: Zhuohan Li <zhuohan123@gmail.com>

2023-09-08 00:03:39 -07:00

..

api_server_async_engine.py

Start background task in AsyncLLMEngine.generate (#988 )

2023-09-08 00:03:39 -07:00

test_api_server.py

Make AsyncLLMEngine more robust & fix batched abort (#969 )

2023-09-07 13:43:45 -07:00

test_request_tracker.py

Make AsyncLLMEngine more robust & fix batched abort (#969 )

2023-09-07 13:43:45 -07:00