Antoni BaumandGitHub a10d3056da [Core] Set linear_weights directly on the layer (#3977)

2024-04-11 16:35:51 -04:00

..

awq

Refactor 2 awq gemm kernels into m16nXk32 (#2723)

2024-02-12 11:02:17 -08:00

fp8/amd_detail

Enable scaled FP8 (e4m3fn) KV cache on ROCm (AMD GPU) (#3290)

2024-04-03 14:15:55 -07:00

fp8_e5m2_kvcache

Fix compile error when using rocm (#2648)

2024-02-01 09:35:09 -08:00

gptq

[Core] Set linear_weights directly on the layer (#3977)

2024-04-11 16:35:51 -04:00

marlin

Integrate Marlin Kernels for Int4 GPTQ inference (#2497)

2024-03-01 12:47:51 -08:00

squeezellm

Enable CUDA graph for GPTQ & SqueezeLLM (#2318)

2024-01-03 09:52:29 -08:00