3 people cb21972a97 [Kernel] Integrate SM100 MXFP8 blockscaled grouped MM and quant kernels (#34448) ...

Signed-off-by: EdalatiAli <aliedalati@cohere.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

2026-03-01 23:31:19 -08:00

..

marlin_moe_wna16

[Bugfix]: Fix display errors in TORCH_CHECK messages (#32942)

2026-01-31 09:48:48 -08:00

mxfp8_moe

[Kernel] Integrate SM100 MXFP8 blockscaled grouped MM and quant kernels (#34448)

2026-03-01 23:31:19 -08:00

permute_unpermute_kernels

[Refactor] Remove align block size logic in moe_permute (#33449)

2026-02-06 10:57:06 -08:00

dsv3_router_gemm_bf16_out.cu

[ModelBash][DSV3] Add TRTLLM DSV3 Router GEMM kernel (6% B1 Speedup) (#34302)

2026-02-23 14:02:26 +00:00

dsv3_router_gemm_entry.cu

[Bugfix] Fix DSV3 kernels breaking _C and _moe_C on unsupported arches (#35123)

2026-02-23 17:11:27 -08:00

dsv3_router_gemm_float_out.cu

[ModelBash][DSV3] Add TRTLLM DSV3 Router GEMM kernel (6% B1 Speedup) (#34302)

2026-02-23 14:02:26 +00:00

dsv3_router_gemm_utils.h

[ModelBash][DSV3] Add TRTLLM DSV3 Router GEMM kernel (6% B1 Speedup) (#34302)

2026-02-23 14:02:26 +00:00

dynamic_4bit_int_moe_cpu.cpp

[CPU]Parallelize over tokens in int4 moe (#29600)

2025-12-02 06:21:39 +00:00

grouped_topk_kernels.cu

[Kernel] Optimize grouped topk kernel (#34206)

2026-02-20 01:34:45 -08:00

moe_align_sum_kernels.cu

[Bugfix] Fix expert_ids padding values in moe_align_block_size kernel (#35161)

2026-02-24 17:14:24 -08:00

moe_ops.h

[Performance] Cublas Bf16 Gate with Fp32 Output (#35121)

2026-02-26 16:51:28 -08:00

moe_permute_unpermute_op.cu

[Refactor] Remove align block size logic in moe_permute (#33449)

2026-02-06 10:57:06 -08:00

moe_wna16_utils.h

pre-commit autoupdate (#17380)

2025-04-29 06:46:55 -07:00

moe_wna16.cu

[BugFix] Accuracy fix for llama4 int4 - improperly casted scales (#16801)

2025-04-17 22:13:29 -07:00

moeTopKFuncs.cuh

[Kernel] Optimize grouped topk kernel (#34206)

2026-02-20 01:34:45 -08:00

router_gemm.cu

[Performance] Cublas Bf16 Gate with Fp32 Output (#35121)

2026-02-26 16:51:28 -08:00

topk_softmax_kernels.cu

[Kernel] Add topk_sigmoid kernel (#31246)

2026-01-21 22:49:51 +00:00

torch_bindings.cpp

[Performance] Cublas Bf16 Gate with Fp32 Output (#35121)

2026-02-26 16:51:28 -08:00