4 people 9090bf02e7 Support FP8-E5M2 KV Cache (#2279) ...

Co-authored-by: zhaoyang <zhao.yang16@zte.com.cn>
Co-authored-by: Zhuohan Li <zhuohan123@gmail.com>

2024-01-28 16:43:54 -08:00

..

assets/logos

Update README.md (#1292)

2023-10-08 23:15:50 -07:00

dev/engine

[DOC] Add additional comments for LLMEngine and AsyncLLMEngine (#1011)

2024-01-11 19:26:49 -08:00

getting_started

[ROCm] add support to ROCm 6.0 and MI300 (#2274)

2024-01-26 12:41:10 -08:00

models

fix names and license for Qwen2 (#2589)

2024-01-24 22:37:51 -08:00

quantization

Support FP8-E5M2 KV Cache (#2279)

2024-01-28 16:43:54 -08:00

serving

[Docs] Fix broken links (#2222)

2023-12-20 12:43:42 -08:00

conf.py

[DOC] Add additional comments for LLMEngine and AsyncLLMEngine (#1011)

2024-01-11 19:26:49 -08:00

index.rst

[DOC] Add additional comments for LLMEngine and AsyncLLMEngine (#1011)

2024-01-11 19:26:49 -08:00