Tristan LeclercqandGitHub 4285e423a6 [Misc] Auto detect bitsandbytes pre-quantized models (#16027) ...

Signed-off-by: Tristan Leclercq <tristanleclercq@gmail.com>

2025-04-04 23:30:45 -07:00

..

auto_awq.md

[Docs] Add GPTQModel (#14056)

2025-03-03 21:59:09 +00:00

bnb.md

[Misc] Auto detect bitsandbytes pre-quantized models (#16027)

2025-04-04 23:30:45 -07:00

fp8.md

[Doc] Convert docs to use colon fences (#12471)

2025-01-29 11:38:29 +08:00

gguf.md

[Model] Deepseek GGUF support (#13167)

2025-02-27 02:08:35 -08:00

gptqmodel.md

[Docs] Add GPTQModel (#14056)

2025-03-03 21:59:09 +00:00

index.md

[Doc] Quark quantization documentation (#15861)

2025-04-01 08:32:45 -07:00

int4.md

[Doc] int4 w4a16 example (#12585)

2025-01-31 15:38:48 -08:00

int8.md

[Doc] int4 w4a16 example (#12585)

2025-01-31 15:38:48 -08:00

quantized_kvcache.md

[FP8][Kernel] Dynamic kv cache scaling factors computation (#11906)

2025-01-23 18:04:03 +00:00

quark.md

[Doc] Quark quantization documentation (#15861)

2025-04-01 08:32:45 -07:00

supported_hardware.md

[Doc]: Improve feature tables (#13224)

2025-02-18 18:52:39 +08:00