karylab_agents/vllm
1
0
Fork 0
forked from Karylab-cklius/vllm
Code Pull Requests 2 Actions 1 Packages Activity

Apply suggestion from @ProExpertProg

Browse Source 
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
This commit is contained in:
Luka Govedič
2026-04-29 16:03:22 -04:00
committed by GitHub
parent dc444a16b4
commit bdb3b45e02
1 changed files with 2 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files
vllm/config/kernel.py
+2 -2
View File
@@ -145,8 +145,8 @@ class KernelConfig:
- "cutlass": Use vLLM CUTLASS kernels
- "flashinfer_trtllm": Use FlashInfer with TRTLLM-GEN kernels (BF16 input)
- "flashinfer_trtllm_afp8": Use FlashInfer with TRTLLM-GEN kernels (FP8 input)
- "flashinfer_cutlass": Use FlashInfer with CUTLASS kernels (BF16 output)
- "flashinfer_cutlass_afp8": Use FlashInfer with CUTLASS kernels (FP8 output)
- "flashinfer_cutlass": Use FlashInfer with CUTLASS kernels (BF16 input)
- "flashinfer_cutlass_afp8": Use FlashInfer with CUTLASS kernels (FP8 input)
- "flashinfer_cutedsl": Use FlashInfer with CuteDSL kernels (FP4 only)
- "marlin": Use Marlin kernels (weight-only quantization)
- "aiter": Use AMD AITer kernels (ROCm only)