Zhuohan LiandGitHub 057daef778 OpenAI Compatible Frontend (#116)

2023-05-23 21:39:50 -07:00

..

arg_utils.py

Introduce LLM class for offline inference (#115)

2023-05-21 17:04:18 -07:00

async_llm_server.py

OpenAI Compatible Frontend (#116)

2023-05-23 21:39:50 -07:00

llm_server.py

OpenAI Compatible Frontend (#116)

2023-05-23 21:39:50 -07:00

ray_utils.py

Add contributing guideline and mypy config (#122)

2023-05-23 17:58:51 -07:00

tokenizer_utils.py

Incrementally decode output tokens (#121)

2023-05-23 20:46:32 -07:00