4 people 0d9210a502 Fixes non-coalesced HBM access in marlin_int4_fp8_preprocess_kernel_awq (#47268) ...

Signed-off-by: xjx <493337577@qq.com>
Signed-off-by: flutist-alibaba <30485581+flutist@users.noreply.github.com>
Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>
Co-authored-by: Shengqi Chen <harry-chen@outlook.com>

2026-07-20 18:30:38 -07:00

..

attention

Delete PagedAttention (#47361)

2026-07-02 12:31:26 -07:00

core

[12/n] final _C library kernel migration (#45415)

2026-06-19 06:57:26 -07:00

cutlass_extensions

New stable abi cleanup (#46656)

2026-07-03 14:02:26 +08:00

mamba

[8/n] Migrate merge_attn_states, mamba, sampler to torch stable ABI (continued) (#43361)

2026-05-27 09:35:24 -07:00

moe

[Perf] Optimize dsv4 routing using specialized kernel, 2.94% E2E TPOT improvement (#48660)

2026-07-17 13:35:06 -07:00

quantization

Fixes non-coalesced HBM access in marlin_int4_fp8_preprocess_kernel_awq (#47268)

2026-07-20 18:30:38 -07:00

activation_kernels.cu

[Kernel] Implement CUDA kernel for ReLUSquaredActivation (relu^2) (#39058)

2026-07-12 19:18:03 -07:00

async_util.cuh

Migrate header files to torch stable abi (#44013)

2026-06-02 08:09:52 -07:00

cache_kernels_fused.cu

[9/n] Migrate attention and cache kernels to torch stable ABI (continued) (#43717)

2026-05-29 04:44:45 +00:00

cache_kernels.cu

[Bugfix] Sparse MLA: enable fp8_ds_mla dense prefill (#48642)

2026-07-16 22:44:04 +00:00

concat_mla_q.cuh

[ROCm][MLA] Replace torch.cat in sparse-MLA forward_mqa with fused concat_mla_q (#42838)

2026-06-06 18:20:50 -05:00

cooperative_topk.cu

[Perf][DSv4/DSv3.2] Add cluster-cooperative topK kernel for low-latency scenarios (#43008)

2026-06-23 16:11:00 -07:00

cooperative_topk.cuh

[Perf][DSv4/DSv3.2] Add cluster-cooperative topK kernel for low-latency scenarios (#43008)

2026-06-23 16:11:00 -07:00

cub_helpers.h

New stable abi cleanup (#46656)

2026-07-03 14:02:26 +08:00

cuda_utils_kernels.cu

[10/n] Migrate cuda_view and silu_and_mul_per_block_quant kernels to torch stale ABI. (#44334)

2026-06-04 20:14:43 -07:00

cuda_vec_utils.cuh

[Build] Fix CUDA arch build coverage gaps (#45277)

2026-06-13 22:09:20 -07:00

cuda_view.cu

[10/n] Migrate cuda_view and silu_and_mul_per_block_quant kernels to torch stale ABI. (#44334)

2026-06-04 20:14:43 -07:00

custom_all_reduce.cu

[10b/n] Migrate custom all-reduce, DeepSeek V4 fused MLA, MiniMax reduce-RMS, and MXFP8 MoE to libtorch stable ABI (#44365)

2026-06-04 00:29:46 +08:00

dispatch_utils.h

add pad-aware reduce path (#48385)

2026-07-14 18:05:50 -07:00

dsv3_fused_a_gemm.cu

New stable abi cleanup (#46656)

2026-07-03 14:02:26 +08:00

fp32_router_gemm_entry.cu

FP32 router GEMV optimization (#48335)

2026-07-11 13:07:48 +00:00

fp32_router_gemm.cu

FP32 router GEMV optimization (#48335)

2026-07-11 13:07:48 +00:00

fused_deepseek_v4_qnorm_rope_kv_insert_kernel.cu

[ROCm][DSv4] Functional fixes for DeepSeek V4 on MI300X/MI325X (#45681)

2026-06-18 12:21:14 +00:00

fused_minimax_m3_qknorm_rope_kv_insert_kernel.cu

[ROCm][MiniMax-M3] Add AITER sparse paged attention (#47287)

2026-07-12 19:27:29 -07:00

fused_qknorm_rope_kernel.cu

New stable abi cleanup (#46656)

2026-07-03 14:02:26 +08:00

launch_bounds_utils.h

Migrate header files to torch stable abi (#44013)

2026-06-02 08:09:52 -07:00

layernorm_kernels.cu

New stable abi cleanup (#46656)

2026-07-03 14:02:26 +08:00

layernorm_quant_kernels.cu

New stable abi cleanup (#46656)

2026-07-03 14:02:26 +08:00

minimax_reduce_rms_kernel.cu

[Misc] Use functions instead of PTX for the PDL instruction (#46984)

2026-07-01 19:38:35 -07:00

minimax_reduce_rms_kernel.h

New stable abi cleanup (#46656)

2026-07-03 14:02:26 +08:00

ngram_embedding_kernels.cu

[Model] Add LongCat-Flash-Lite (n-gram embedding) (#47857)

2026-07-10 07:17:50 -07:00

nvfp4_kv_cache_kernels.cu

[9/n] Migrate attention and cache kernels to torch stable ABI (continued) (#43717)

2026-05-29 04:44:45 +00:00

ops.h

[Bugfix] Sparse MLA: enable fp8_ds_mla dense prefill (#48642)

2026-07-16 22:44:04 +00:00

permute_cols.cu

[1/n] Migrate permute_cols to libtorch stable ABI (#31509)

2026-03-19 11:27:26 -04:00

persistent_topk.cuh

[Perf][DSv4/DSv3.2] Add cluster-cooperative topK kernel for low-latency scenarios (#43008)

2026-06-23 16:11:00 -07:00

pos_encoding_kernels.cu

[7/n] Migrate pos_encoding and norm kernels to libtorch stable ABI (continued) (#43209)

2026-05-23 13:20:00 +08:00

sampler.cu

New stable abi cleanup (#46656)

2026-07-03 14:02:26 +08:00

topk_histogram_4096.cuh

[CI/Build] Fix topk histogram build on SM75 (#46550)

2026-06-24 00:51:11 -07:00

topk.cu

New stable abi cleanup (#46656)

2026-07-03 14:02:26 +08:00

torch_bindings.cpp

[Bugfix] Sparse MLA: enable fp8_ds_mla dense prefill (#48642)

2026-07-16 22:44:04 +00:00

torch_utils.h

Enable perf_token_group_quant/_C_stable_libtorch for ROCm (#42758)

2026-06-02 23:23:28 -07:00

type_convert.cuh

New stable abi cleanup (#46656)

2026-07-03 14:02:26 +08:00