vllm/csrc/libtorch_stable/quantization/marlin at main - vllm

karylab_agents/vllm

Fork 0

forked from Karylab-cklius/vllm

Files

T

History

0d9210a502 Fixes non-coalesced HBM access in marlin_int4_fp8_preprocess_kernel_awq (#47268 )

Signed-off-by: xjx <493337577@qq.com>
Signed-off-by: flutist-alibaba <30485581+flutist@users.noreply.github.com>
Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>
Co-authored-by: Shengqi Chen <harry-chen@outlook.com>

2026-07-20 18:30:38 -07:00

.gitignore

[11a/n] Migrate Marlin kernels to torch stable ABI (#45176 )

2026-06-11 21:22:37 -07:00

awq_marlin_repack.cu

[11a/n] Migrate Marlin kernels to torch stable ABI (#45176 )

2026-06-11 21:22:37 -07:00

dequant.h

[11a/n] Migrate Marlin kernels to torch stable ABI (#45176 )

2026-06-11 21:22:37 -07:00

generate_kernels.py

[11a/n] Migrate Marlin kernels to torch stable ABI (#45176 )