Logo
Explore Help
Sign In
karylab_agents/vllm
Watch 1
Star 0
Fork 0
forked from Karylab-cklius/vllm
Code Pull Requests 2 Actions 1 Packages Activity
Files
5d2248d81ab1f83a2874bfa726f0a1933ef2d048
vllm/docs/source/quantization
T
History
Jee Jee LiandGitHub 15859f2357 [[Misc]Upgrade bitsandbytes to the latest version 0.45.0 (#11201)
2024-12-15 03:03:06 +00:00
..
auto_awq.rst
[Doc] fix the autoAWQ example (#7937)
2024-08-28 12:12:32 +00:00
bnb.rst
[[Misc]Upgrade bitsandbytes to the latest version 0.45.0 (#11201)
2024-12-15 03:03:06 +00:00
fp8_e4m3_kvcache.rst
[Core/Bugfix] Add FP8 K/V Scale and dtype conversion for prefix/prefill Triton Kernel (#7208)
2024-08-12 22:47:41 +00:00
fp8_e5m2_kvcache.rst
Super tiny little typo fix (#10633)
2024-11-25 13:08:30 +00:00
fp8.rst
[Doc] Installed version of llmcompressor for int8/fp8 quantization (#11103)
2024-12-11 15:43:24 +00:00
gguf.rst
[Doc] Add documentation for GGUF quantization (#8618)
2024-09-19 13:15:55 -06:00
int8.rst
[Doc] Installed version of llmcompressor for int8/fp8 quantization (#11103)
2024-12-11 15:43:24 +00:00
supported_hardware.rst
[Hardware][XPU] AWQ/GPTQ support for xpu backend (#10107)
2024-11-18 11:18:05 -07:00
Powered by Gitea Version: 1.27.1 Page: 104ms Template: 2ms
Auto
English
Bahasa Indonesia Deutsch English Español Français Gaeilge Italiano Latviešu Magyar nyelv Nederlands Polski Português de Portugal Português do Brasil Suomi Svenska Türkçe Čeština Ελληνικά Български Русский Українська فارسی മലയാളം 日本語 简体中文 繁體中文(台灣) 繁體中文(香港) 한국어
Licenses API