Zhuohan LiandGitHub 4858f3bb45 Add an option to launch cacheflow without ray (#51)

2023-04-30 15:42:17 +08:00

..

cache_engine.py

Implement block copy kernel to optimize beam search (#32)

2023-04-07 17:45:07 -07:00

controller.py

Add an option to launch cacheflow without ray (#51)

2023-04-30 15:42:17 +08:00

worker.py

Add an option to use dummy model weights (#33)

2023-04-08 23:36:12 -07:00