6 people 78e7a7b9b0 Refactor AWQ Marlin MoE onto modular WNA16 oracle (#42483) ...

Signed-off-by: Siddharth Bedekar <bedeksid@gmail.com>
Signed-off-by: Siddharth Bedekar <104613085+bedeks@users.noreply.github.com>
Co-authored-by: Robert Shaw <robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: OpenAI Codex <codex@openai.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>

2026-05-18 08:02:43 -07:00

..

attention

[FlashAttn] Fix supports_kv_cache_dtype() accepting unhandled fp8 kv-cache dtype variants (#42685)

2026-05-15 15:34:59 -04:00

core

[CI] fix test_rotary_embedding_opcheck format error (#41202)

2026-04-29 00:32:37 -07:00

helion

[Kernel][Helion] Optimize Helion config parsing latency (#40850)

2026-05-07 20:27:34 -07:00

ir

[vLLM IR] 2/N fused_add_rms_norm and maybe_inplace overload (#36823)

2026-05-01 23:41:15 -04:00

mamba

[Misc] Replace mamba_type string literals with MambaAttentionBackendEnum (#41188)

2026-05-11 03:59:36 +00:00

moe

Refactor AWQ Marlin MoE onto modular WNA16 oracle (#42483)

2026-05-18 08:02:43 -07:00

quantization

[Bugfix] Fix SM121 (DGX Spark) exclusion from Marlin/CUTLASS FP8 paths (#35568)

2026-05-15 10:59:00 -07:00

__init__.py

[CI/Build] Move test_utils.py to tests/utils.py (#4425)

2024-05-13 23:50:09 +09:00

allclose_default.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

quant_utils.py

[Perf] Create TMA-aligned input scale tensor for DeepGemm on Hopper (#32619)

2026-01-22 15:47:04 -05:00

test_apply_repetition_penalties.py

[Platform] Deprecate seed_everything (#31659)

2026-01-04 18:34:04 -08:00

test_awq_int4_to_int8.py

[CPU] Bump up to the latest CPU kernels (#41924)

2026-05-07 05:45:59 -07:00

test_cache_kernels.py

[Hardware] Replace torch.cuda.device_count/current_device/set_device API (#36145)

2026-03-12 07:57:47 -07:00

test_compressor_kv_cache.py

[DSv4] Improved dequant gather K cache kernel (#42236)

2026-05-11 10:41:12 -04:00

test_concat_mla_q.py

[Attention][Perf][Kernel] Replace torch.cat with vectorized CUDA kernel MLA query concat - DeepSeek-V3.2 (#34917)

2026-03-09 09:50:36 -07:00

test_cp_gather_fp8.py

[Attention][Perf] Optimize cp_gather_and_upconvert_fp8_kv_cache - DeepSeek-v3.2 (#35290)

2026-03-09 09:46:57 -07:00

test_fla_layernorm_guard.py

[Bugfix] Fix dtype mismatch in RMSNormGated.forward_native() during torch.compile (#35256)

2026-03-01 15:14:46 -05:00

test_flex_attention.py

full cudagraph for flex-attn (#36298)

2026-04-02 21:15:01 -07:00

test_fused_deepseek_v4_qnorm_rope_kv_insert.py

[Feat] DeepSeek V4 Rebased (#40860)

2026-04-26 18:31:08 -07:00

test_fused_gdn_post_conv.py

[Perf] fuse kernels in gdn (#37813)

2026-04-02 11:52:18 +00:00

test_fused_indexer_q_rope_quant.py

[DSv4] Improved fused Indexer Q quant kernel (#41428)

2026-05-09 01:20:32 -07:00

test_fused_inv_rope_fp8_quant.py

[Feat] DeepSeek V4 Rebased (#40860)

2026-04-26 18:31:08 -07:00

test_fused_quant_activation.py

Add platform manual_seed_all API (#38468)

2026-04-10 13:43:50 +08:00

test_fused_recurrent_packed_decode.py

[Bugfix] fix main branch pre-commit error (1 line change) (#36897)

2026-03-12 09:08:37 -07:00

test_fused_sigmoid_gating_delta_rule.py

[Kernel] Add fused_sigmoid_gating_delta_rule_update kernel for Qwen3 Next (#35777)

2026-03-08 23:41:01 -07:00

test_kda.py

[Bugfix] correct h matrix layout in chunk_kda output kernel (#40956)

2026-04-30 16:22:41 +08:00

test_mhc_kernels.py

[Bugfix] [ROCm] [DSV4] [Perf] Add aiter mhc support (#41946)

2026-05-13 21:43:15 +08:00

test_onednn.py

[CPU] Refactor CPU attention backend (#27954)

2025-11-12 09:43:06 +08:00

test_shuffle_rows.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_top_k_per_row.py

[Feat] DeepSeek V4 Rebased (#40860)

2026-04-26 18:31:08 -07:00

utils.py

[ROCm] Fix MoE kernel test failures on gfx950 (#37833)

2026-03-25 13:46:40 -05:00