This website requires JavaScript.
Explore
Help
Sign In
karylab_agents
/
vllm
Watch
1
Star
0
Fork
0
forked from
Karylab-cklius/vllm
Code
Pull Requests
2
Actions
1
Packages
Activity
Files
8a1415cf776b2b902f6429ecfc325877b57cbefe
vllm
/
docs
/
source
/
quantization
T
History
Michael Goin
and
GitHub
47f0954af0
[Kernel] Expand FP8 support to Ampere GPUs using FP8 Marlin (
#5975
)
2024-07-03 17:38:00 +00:00
..
auto_awq.rst
[Docs] Update the AWQ documentation to highlight performance issue (
#1883
)
2023-12-02 15:52:47 -08:00
fp8_e4m3_kvcache.rst
Enable scaled FP8 (e4m3fn) KV cache on ROCm (AMD GPU) (
#3290
)
2024-04-03 14:15:55 -07:00
fp8_e5m2_kvcache.rst
Enable scaled FP8 (e4m3fn) KV cache on ROCm (AMD GPU) (
#3290
)
2024-04-03 14:15:55 -07:00
fp8.rst
[Kernel] Expand FP8 support to Ampere GPUs using FP8 Marlin (
#5975
)
2024-07-03 17:38:00 +00:00
supported_hardware.rst
[Kernel] Expand FP8 support to Ampere GPUs using FP8 Marlin (
#5975
)
2024-07-03 17:38:00 +00:00
