Logo
Explore Help
Sign In
karylab_agents/vllm
Watch 1
Star 0
Fork 0
forked from Karylab-cklius/vllm
Code Pull Requests 2 Actions 1 Packages Activity
Files
87aee9ed2b65b9ef7cdb83cc69dc1fc15f39ff36
vllm/csrc/quantization/w8a8
T
History
Wentao YeandGitHub 541a2ef892 [Perf] Deepgemm fused layout kernel for activations, 4.3% throughput improvement, 10.7% TTFT improvement. (#29546)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
2025-12-07 20:31:14 +08:00
..
cutlass
[Kernel] Add NVFP4 MoE CUTLASS support for SM120 (#29242)
2025-11-25 06:59:07 -08:00
fp8
[Perf] Deepgemm fused layout kernel for activations, 4.3% throughput improvement, 10.7% TTFT improvement. (#29546)
2025-12-07 20:31:14 +08:00
int8
[Bugfix] Fix test fused quant layernorm tests (#27865)
2025-11-08 14:31:33 -08:00
per_token_group_quant_8bit.h
[Refactor] Refactor FP8 & INT8 Quant Folder inside w8a8 (#25293)
2025-10-08 10:20:48 -04:00
Powered by Gitea Version: 1.27.1 Page: 173ms Template: 2ms
Auto
English
Bahasa Indonesia Deutsch English Español Français Gaeilge Italiano Latviešu Magyar nyelv Nederlands Polski Português de Portugal Português do Brasil Suomi Svenska Türkçe Čeština Ελληνικά Български Русский Українська فارسی മലയാളം 日本語 简体中文 繁體中文(台灣) 繁體中文(香港) 한국어
Licenses API