Wentao YeandGitHub b41f7d8ffd Merge branch 'main' into wentao-optimize-per-token-group-quant

2026-06-29 17:37:43 -04:00

..

attention

[Attention] Re-enable cross-layer KV cache layout for MLA via stride-aware kernels (#45111)

2026-06-22 06:57:02 -07:00

core

[12/n] final _C library kernel migration (#45415)

2026-06-19 06:57:26 -07:00

cutlass_extensions

[10/n] Migrate cuda_view and silu_and_mul_per_block_quant kernels to torch stale ABI. (#44334)

2026-06-04 20:14:43 -07:00

mamba

[8/n] Migrate merge_attn_states, mamba, sampler to torch stable ABI (continued) (#43361)

2026-05-27 09:35:24 -07:00

moe

[Kernel] Vectorized fp32 moe_sum reduction and support any topk (#46643)

2026-06-25 14:02:28 -07:00

quantization

fix bug

2026-06-25 20:23:15 +00:00

activation_kernels.cu

[Model] Add MiniMax M3 support (#45381)

2026-06-16 01:01:25 +08:00

async_util.cuh

Migrate header files to torch stable abi (#44013)

2026-06-02 08:09:52 -07:00

cache_kernels_fused.cu

[9/n] Migrate attention and cache kernels to torch stable ABI (continued) (#43717)

2026-05-29 04:44:45 +00:00

cache_kernels.cu

[Bugfix][KV Offload] Fix swap_blocks_batch on the default stream (#46379)

2026-06-23 05:45:27 -07:00

concat_mla_q.cuh

[ROCm][MLA] Replace torch.cat in sparse-MLA forward_mqa with fused concat_mla_q (#42838)

2026-06-06 18:20:50 -05:00

cooperative_topk.cu

[Perf][DSv4/DSv3.2] Add cluster-cooperative topK kernel for low-latency scenarios (#43008)

2026-06-23 16:11:00 -07:00

cooperative_topk.cuh

[Perf][DSv4/DSv3.2] Add cluster-cooperative topK kernel for low-latency scenarios (#43008)

2026-06-23 16:11:00 -07:00

cuda_utils_kernels.cu

[10/n] Migrate cuda_view and silu_and_mul_per_block_quant kernels to torch stale ABI. (#44334)

2026-06-04 20:14:43 -07:00

cuda_vec_utils.cuh

[Build] Fix CUDA arch build coverage gaps (#45277)

2026-06-13 22:09:20 -07:00

cuda_view.cu

[10/n] Migrate cuda_view and silu_and_mul_per_block_quant kernels to torch stale ABI. (#44334)

2026-06-04 20:14:43 -07:00

custom_all_reduce.cu

[10b/n] Migrate custom all-reduce, DeepSeek V4 fused MLA, MiniMax reduce-RMS, and MXFP8 MoE to libtorch stable ABI (#44365)

2026-06-04 00:29:46 +08:00

dispatch_utils.h

[10c/n] Migrate MoE kernels to torch stable ABI (#44565)

2026-06-10 23:02:26 -07:00

dsv3_fused_a_gemm.cu

[5/n] Migrate CUTLASS MLA, hadamard, awq, allspark and DSV3 fused a gemm to torch stable ABI (continued) (#42339)

2026-05-13 07:24:39 +00:00

fp32_router_gemm_entry.cu

[Model] Add MiniMax M3 support (#45381)

2026-06-16 01:01:25 +08:00

fp32_router_gemm.cu

[Model] Add MiniMax M3 support (#45381)

2026-06-16 01:01:25 +08:00

fused_deepseek_v4_qnorm_rope_kv_insert_kernel.cu

[ROCm][DSv4] Functional fixes for DeepSeek V4 on MI300X/MI325X (#45681)

2026-06-18 12:21:14 +00:00

fused_minimax_m3_qknorm_rope_kv_insert_kernel.cu

[Minimax-M3] BF16/FP8 Indexer using MSA (#45892)

2026-06-23 10:28:49 -07:00

fused_qknorm_rope_kernel.cu

Migrate header files to torch stable abi (#44013)

2026-06-02 08:09:52 -07:00

launch_bounds_utils.h

Migrate header files to torch stable abi (#44013)

2026-06-02 08:09:52 -07:00

layernorm_kernels.cu

[Hardware][AMD][CI] Fix AMD CI image build (#46792)

2026-06-25 22:05:12 -07:00

layernorm_quant_kernels.cu

[CI Bug] Revert #42379 to fix CI Multi-Modal Models (Extended Generation 1) (#46070)

2026-06-18 12:37:39 -07:00

minimax_reduce_rms_kernel.cu

[10b/n] Migrate custom all-reduce, DeepSeek V4 fused MLA, MiniMax reduce-RMS, and MXFP8 MoE to libtorch stable ABI (#44365)

2026-06-04 00:29:46 +08:00

nvfp4_kv_cache_kernels.cu

[9/n] Migrate attention and cache kernels to torch stable ABI (continued) (#43717)

2026-05-29 04:44:45 +00:00

ops.h

[Perf][DSv4/DSv3.2] Add cluster-cooperative topK kernel for low-latency scenarios (#43008)

2026-06-23 16:11:00 -07:00

permute_cols.cu

[1/n] Migrate permute_cols to libtorch stable ABI (#31509)

2026-03-19 11:27:26 -04:00

persistent_topk.cuh

[Perf][DSv4/DSv3.2] Add cluster-cooperative topK kernel for low-latency scenarios (#43008)

2026-06-23 16:11:00 -07:00

pos_encoding_kernels.cu

[7/n] Migrate pos_encoding and norm kernels to libtorch stable ABI (continued) (#43209)

2026-05-23 13:20:00 +08:00

sampler.cu

[8/n] Migrate merge_attn_states, mamba, sampler to torch stable ABI (continued) (#43361)

2026-05-27 09:35:24 -07:00

topk_histogram_4096.cuh

[CI/Build] Fix topk histogram build on SM75 (#46550)

2026-06-24 00:51:11 -07:00

topk.cu

Migrate header files to torch stable abi (#44013)

2026-06-02 08:09:52 -07:00

torch_bindings.cpp

[Perf][DSv4/DSv3.2] Add cluster-cooperative topK kernel for low-latency scenarios (#43008)

2026-06-23 16:11:00 -07:00

torch_utils.h

Enable perf_token_group_quant/_C_stable_libtorch for ROCm (#42758)

2026-06-02 23:23:28 -07:00