Wentao YeandGitHub 0d453e2336 [Perf] Batch invariance with Cutlass fp8 support, 28.9% E2E latency improvement (#40408) ...

Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

2026-05-11 12:20:58 -04:00

..

cutlass

[Perf] Batch invariance with Cutlass fp8 support, 28.9% E2E latency improvement (#40408)

2026-05-11 12:20:58 -04:00

fp8

Faster per-token fp8 group quant packed kernel for blackwell (#41326)

2026-04-30 18:09:55 -07:00

int8

[2/n] Migrate per_token_group_quant to torch stable ABI (#36058)

2026-03-25 10:15:13 -07:00

per_token_group_quant_8bit.h

Faster per-token fp8 group quant packed kernel for blackwell (#41326)

2026-04-30 18:09:55 -07:00