Woosuk KwonandGitHub c9d5b6d4a8 Replace FlashAttention with xformers (#70)

2023-05-05 02:01:08 -07:00

..

block_manager.py

Support various block sizes & Change default block size to 16 (#38)

2023-04-15 09:03:24 -07:00

policy.py

Implement preemption via recomputation & Refactor scheduling logic (#12)

2023-03-30 14:51:46 -07:00

scheduler.py

Support various block sizes & Change default block size to 16 (#38)

2023-04-15 09:03:24 -07:00

server.py

Replace FlashAttention with xformers (#70)

2023-05-05 02:01:08 -07:00

simple_frontend.py

Collect system stats in scheduler & Add scripts for experiments (#30)

2023-04-12 15:03:49 -07:00