Logo
Explore Help
Sign In
karylab_agents/vllm
Watch 1
Star 0
Fork 0
forked from Karylab-cklius/vllm
Code Pull Requests 2 Actions 1 Packages Activity
Files
415f19474dedc69934cab79cfb8f5bdc19e2ae0d
vllm/csrc/quantization/fp8
T
History
Luka GovedičGitHubVarun Sundar Rabindranath
30870b4f66 [torch.compile] Dynamic fp8 + rms_norm fusion (#10906)
Signed-off-by: luka <luka@neuralmagic.com>
Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
2024-12-13 03:19:23 +00:00
..
amd
[Kernel] Squash a few more warnings (#6914)
2024-07-30 13:50:42 -04:00
nvidia
[CI/Build] Suppress divide-by-zero and missing return statement warnings (#7001)
2024-08-05 16:00:01 -04:00
common.cu
[torch.compile] Fuse RMSNorm with quant (#9138)
2024-11-08 21:20:08 +00:00
common.cuh
[torch.compile] Dynamic fp8 + rms_norm fusion (#10906)
2024-12-13 03:19:23 +00:00
fp8_marlin.cu
[CI/Build] Per file CUDA Archs (improve wheel size and dev build times) (#8845)
2024-10-03 22:55:25 -04:00
Powered by Gitea Version: 1.27.1 Page: 73ms Template: 1ms
Auto
English
Bahasa Indonesia Deutsch English Español Français Gaeilge Italiano Latviešu Magyar nyelv Nederlands Polski Português de Portugal Português do Brasil Suomi Svenska Türkçe Čeština Ελληνικά Български Русский Українська فارسی മലയാളം 日本語 简体中文 繁體中文(台灣) 繁體中文(香港) 한국어
Licenses API