4 people 9090bf02e7 Support FP8-E5M2 KV Cache (#2279) ...

Co-authored-by: zhaoyang <zhao.yang16@zte.com.cn>
Co-authored-by: Zhuohan Li <zhuohan123@gmail.com>

2024-01-28 16:43:54 -08:00

..

awq

AWQ: Up to 2.66x higher throughput (#2566)

2024-01-26 23:53:17 -08:00

fp8_e5m2_kvcache

Support FP8-E5M2 KV Cache (#2279)

2024-01-28 16:43:54 -08:00

gptq

Enable CUDA graph for GPTQ & SqueezeLLM (#2318)

2024-01-03 09:52:29 -08:00

squeezellm

Enable CUDA graph for GPTQ & SqueezeLLM (#2318)

2024-01-03 09:52:29 -08:00