HumphreyandGitHub 4583630b56 [Bugfix][Kernel] Check output alignment in vectorize_with_alignment (fixes misaligned-address crash for non-multiple-of-8 head sizes) (#45466) ...

Signed-off-by: HumphreySun98 <humphreysun98@gmail.com>

2026-06-18 16:58:22 +00:00

..

attention

[9/n] Migrate attention and cache kernels to torch stable ABI (continued) (#43717)

2026-05-29 04:44:45 +00:00

cutlass_extensions

[10/n] Migrate cuda_view and silu_and_mul_per_block_quant kernels to torch stale ABI. (#44334)

2026-06-04 20:14:43 -07:00

mamba

[8/n] Migrate merge_attn_states, mamba, sampler to torch stable ABI (continued) (#43361)

2026-05-27 09:35:24 -07:00

moe

[Refactor] Remove dead cutlass mxfp8 code (#44681)

2026-06-17 21:18:25 -07:00

quantization

[Bugfix][Kernel] Check output alignment in vectorize_with_alignment (fixes misaligned-address crash for non-multiple-of-8 head sizes) (#45466)

2026-06-18 16:58:22 +00:00

activation_kernels.cu

[Model] Add MiniMax M3 support (#45381)

2026-06-16 01:01:25 +08:00

async_util.cuh

Migrate header files to torch stable abi (#44013)

2026-06-02 08:09:52 -07:00

cache_kernels_fused.cu

[9/n] Migrate attention and cache kernels to torch stable ABI (continued) (#43717)

2026-05-29 04:44:45 +00:00

cache_kernels.cu

[9/n] Migrate attention and cache kernels to torch stable ABI (continued) (#43717)

2026-05-29 04:44:45 +00:00

concat_mla_q.cuh

[ROCm][MLA] Replace torch.cat in sparse-MLA forward_mqa with fused concat_mla_q (#42838)

2026-06-06 18:20:50 -05:00

cuda_utils_kernels.cu

[10/n] Migrate cuda_view and silu_and_mul_per_block_quant kernels to torch stale ABI. (#44334)

2026-06-04 20:14:43 -07:00

cuda_vec_utils.cuh

[Build] Fix CUDA arch build coverage gaps (#45277)

2026-06-13 22:09:20 -07:00

cuda_view.cu

[10/n] Migrate cuda_view and silu_and_mul_per_block_quant kernels to torch stale ABI. (#44334)

2026-06-04 20:14:43 -07:00

custom_all_reduce.cu

[10b/n] Migrate custom all-reduce, DeepSeek V4 fused MLA, MiniMax reduce-RMS, and MXFP8 MoE to libtorch stable ABI (#44365)

2026-06-04 00:29:46 +08:00

dispatch_utils.h

[10c/n] Migrate MoE kernels to torch stable ABI (#44565)

2026-06-10 23:02:26 -07:00

dsv3_fused_a_gemm.cu

[5/n] Migrate CUTLASS MLA, hadamard, awq, allspark and DSV3 fused a gemm to torch stable ABI (continued) (#42339)

2026-05-13 07:24:39 +00:00

fp32_router_gemm_entry.cu

[Model] Add MiniMax M3 support (#45381)

2026-06-16 01:01:25 +08:00

fp32_router_gemm.cu

[Model] Add MiniMax M3 support (#45381)

2026-06-16 01:01:25 +08:00

fused_deepseek_v4_qnorm_rope_kv_insert_kernel.cu

[ROCm][DSv4] Functional fixes for DeepSeek V4 on MI300X/MI325X (#45681)

2026-06-18 12:21:14 +00:00

fused_minimax_m3_qknorm_rope_kv_insert_kernel.cu

[M3] Enable FP8 sparse GQA (#45744)

2026-06-16 21:38:03 -07:00

fused_qknorm_rope_kernel.cu

Migrate header files to torch stable abi (#44013)

2026-06-02 08:09:52 -07:00

launch_bounds_utils.h

Migrate header files to torch stable abi (#44013)

2026-06-02 08:09:52 -07:00

layernorm_kernels.cu

[Kernel] Add weightless RMSNorm CUDA kernels for has_weight=False (#41430) (#44109)

2026-06-16 23:45:55 -07:00

layernorm_quant_kernels.cu

[Bugfix] Fix RMSNorm kernels to multiply in weight's native dtype (#42379)

2026-05-29 23:16:53 -07:00

minimax_reduce_rms_kernel.cu

[10b/n] Migrate custom all-reduce, DeepSeek V4 fused MLA, MiniMax reduce-RMS, and MXFP8 MoE to libtorch stable ABI (#44365)

2026-06-04 00:29:46 +08:00

nvfp4_kv_cache_kernels.cu

[9/n] Migrate attention and cache kernels to torch stable ABI (continued) (#43717)

2026-05-29 04:44:45 +00:00

ops.h

[Kernel] Add weightless RMSNorm CUDA kernels for has_weight=False (#41430) (#44109)

2026-06-16 23:45:55 -07:00

permute_cols.cu

[1/n] Migrate permute_cols to libtorch stable ABI (#31509)

2026-03-19 11:27:26 -04:00

persistent_topk.cuh

Migrate header files to torch stable abi (#44013)

2026-06-02 08:09:52 -07:00

pos_encoding_kernels.cu

[7/n] Migrate pos_encoding and norm kernels to libtorch stable ABI (continued) (#43209)

2026-05-23 13:20:00 +08:00

sampler.cu

[8/n] Migrate merge_attn_states, mamba, sampler to torch stable ABI (continued) (#43361)

2026-05-27 09:35:24 -07:00

topk.cu

Migrate header files to torch stable abi (#44013)

2026-06-02 08:09:52 -07:00

torch_bindings.cpp

[Refactor] Remove dead cutlass mxfp8 code (#44681)

2026-06-17 21:18:25 -07:00

torch_utils.h

Enable perf_token_group_quant/_C_stable_libtorch for ROCm (#42758)

2026-06-02 23:23:28 -07:00