Michael GoinandGitHub b3f4e17935 [Doc] Add docs for llmcompressor INT8 and FP8 checkpoints (#7444)

2024-08-16 13:59:16 -07:00

..

auto_awq.rst

[Docs] Update the AWQ documentation to highlight performance issue (#1883)

2023-12-02 15:52:47 -08:00

bnb.rst

[bitsandbytes]: support read bnb pre-quantized model (#5753)

2024-07-23 23:45:09 +00:00

fp8_e4m3_kvcache.rst

[Core/Bugfix] Add FP8 K/V Scale and dtype conversion for prefix/prefill Triton Kernel (#7208)

2024-08-12 22:47:41 +00:00

fp8_e5m2_kvcache.rst

[Core/Bugfix] Add FP8 K/V Scale and dtype conversion for prefix/prefill Triton Kernel (#7208)

2024-08-12 22:47:41 +00:00

fp8.rst

[Doc] Add docs for llmcompressor INT8 and FP8 checkpoints (#7444)

2024-08-16 13:59:16 -07:00

int8.rst

[Doc] Add docs for llmcompressor INT8 and FP8 checkpoints (#7444)

2024-08-16 13:59:16 -07:00

supported_hardware.rst

Revert "[Doc] Update supported_hardware.rst (#7276)" (#7467)

2024-08-13 01:37:08 -07:00