Logo
Explore Help
Sign In
Karylab-cklius/vllm
Watch 1
Star 0
Fork 1
Code Issues Pull Requests 1 Actions Packages Projects Releases Wiki Activity
Files
197473c4e71c99025a0fd3925d0f130bdbfa1e42
vllm/csrc/quantization/w8a8
T
History
czhu-cohereandGitHub f6227c22ab [Kernel]Support W4A8 Grouped GEMM on Hopper (#29691)
Signed-off-by: czhu-cohere <conway.zhu@cohere.com>
2025-12-08 19:29:06 -08:00
..
cutlass
[Kernel]Support W4A8 Grouped GEMM on Hopper (#29691)
2025-12-08 19:29:06 -08:00
fp8
[Perf] Deepgemm fused layout kernel for activations, 4.3% throughput improvement, 10.7% TTFT improvement. (#29546)
2025-12-07 20:31:14 +08:00
int8
[Bugfix] Fix test fused quant layernorm tests (#27865)
2025-11-08 14:31:33 -08:00
per_token_group_quant_8bit.h
[Refactor] Refactor FP8 & INT8 Quant Folder inside w8a8 (#25293)
2025-10-08 10:20:48 -04:00
Powered by Gitea Version: 1.27.1 Page: 179ms Template: 2ms
Auto
English
Bahasa Indonesia Deutsch English Español Français Gaeilge Italiano Latviešu Magyar nyelv Nederlands Polski Português de Portugal Português do Brasil Suomi Svenska Türkçe Čeština Ελληνικά Български Русский Українська فارسی മലയാളം 日本語 简体中文 繁體中文(台灣) 繁體中文(香港) 한국어
Licenses API