Logo
Explore Help
Sign In
karylab_agents/vllm
Watch 1
Star 0
Fork 0
forked from Karylab-cklius/vllm
Code Pull Requests 2 Actions 1 Packages Activity
Files
de24046fcd24e8faa81de34b17351887bcdfbe51
vllm/docs/source/quantization
T
History
Jee Jee LiandGitHub 13f9f7a3d0 [[Misc]Upgrade bitsandbytes to the latest version 0.44.0 (#8768)
2024-09-24 17:08:55 -07:00
..
auto_awq.rst
[Doc] fix the autoAWQ example (#7937)
2024-08-28 12:12:32 +00:00
bnb.rst
[[Misc]Upgrade bitsandbytes to the latest version 0.44.0 (#8768)
2024-09-24 17:08:55 -07:00
fp8_e4m3_kvcache.rst
[Core/Bugfix] Add FP8 K/V Scale and dtype conversion for prefix/prefill Triton Kernel (#7208)
2024-08-12 22:47:41 +00:00
fp8_e5m2_kvcache.rst
[Core/Bugfix] Add FP8 K/V Scale and dtype conversion for prefix/prefill Triton Kernel (#7208)
2024-08-12 22:47:41 +00:00
fp8.rst
[Doc] Add docs for llmcompressor INT8 and FP8 checkpoints (#7444)
2024-08-16 13:59:16 -07:00
gguf.rst
[Doc] Add documentation for GGUF quantization (#8618)
2024-09-19 13:15:55 -06:00
int8.rst
[Doc] Add docs for llmcompressor INT8 and FP8 checkpoints (#7444)
2024-08-16 13:59:16 -07:00
supported_hardware.rst
[Misc] Remove SqueezeLLM (#8220)
2024-09-06 16:29:03 -06:00
Powered by Gitea Version: 1.27.1 Page: 62ms Template: 1ms
Auto
English
Bahasa Indonesia Deutsch English Español Français Gaeilge Italiano Latviešu Magyar nyelv Nederlands Polski Português de Portugal Português do Brasil Suomi Svenska Türkçe Čeština Ελληνικά Български Русский Українська فارسی മലയാളം 日本語 简体中文 繁體中文(台灣) 繁體中文(香港) 한국어
Licenses API