Logo
Explore Help
Sign In
karylab_agents/vllm
Watch 1
Star 0
Fork 0
forked from Karylab-cklius/vllm
Code Pull Requests 2 Actions 1 Packages Activity
Files
b877031d806e3d9ebc834e0191ae64de40c4ddc2
vllm/docs/source/features/quantization
T
History
Jee Jee LiandGitHub 10f55fe6c5 [Misc] Clean up the BitsAndBytes arguments (#15140)
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
2025-03-20 19:17:12 -07:00
..
auto_awq.md
[Docs] Add GPTQModel (#14056)
2025-03-03 21:59:09 +00:00
bnb.md
[Misc] Clean up the BitsAndBytes arguments (#15140)
2025-03-20 19:17:12 -07:00
fp8.md
[Doc] Convert docs to use colon fences (#12471)
2025-01-29 11:38:29 +08:00
gguf.md
[Model] Deepseek GGUF support (#13167)
2025-02-27 02:08:35 -08:00
gptqmodel.md
[Docs] Add GPTQModel (#14056)
2025-03-03 21:59:09 +00:00
index.md
[Docs] Add GPTQModel (#14056)
2025-03-03 21:59:09 +00:00
int4.md
[Doc] int4 w4a16 example (#12585)
2025-01-31 15:38:48 -08:00
int8.md
[Doc] int4 w4a16 example (#12585)
2025-01-31 15:38:48 -08:00
quantized_kvcache.md
[FP8][Kernel] Dynamic kv cache scaling factors computation (#11906)
2025-01-23 18:04:03 +00:00
supported_hardware.md
[Doc]: Improve feature tables (#13224)
2025-02-18 18:52:39 +08:00
Powered by Gitea Version: 1.27.1 Page: 69ms Template: 2ms
Auto
English
Bahasa Indonesia Deutsch English Español Français Gaeilge Italiano Latviešu Magyar nyelv Nederlands Polski Português de Portugal Português do Brasil Suomi Svenska Türkçe Čeština Ελληνικά Български Русский Українська فارسی മലയാളം 日本語 简体中文 繁體中文(台灣) 繁體中文(香港) 한국어
Licenses API