vllm/tests/kernels at a9531edfa63197dc083cf60be85e777c64fbfb60 - vllm

attention

[ROCm][MiniMax-M3][Spec Decode] Support speculative decode with AITER sparse PA (#47984 )

2026-07-14 04:12:53 +00:00

core

[Kernel] Implement CUDA kernel for ReLUSquaredActivation (relu^2) (#39058 )

2026-07-12 19:18:03 -07:00

helion

[Kernel][Helion][1/N] Add Helion kernel for silu_and_mul_per_block_quant (#43994 )

2026-07-07 00:19:01 +08:00

ir

[ROCm][CI] Fix ROCm LoRA Transformers fallback with full CUDA graphs (#41577 )

2026-05-23 04:31:32 +00:00

mamba

[CPU][Bugfix] Fix flaky ShortConv prefill test on ARM (uninitialized weights) (#47848 )

2026-07-07 18:20:09 -07:00

moe

[Perf] Optimize fused_topk_bias for DSv4, 1.5~2x kernel performance improvement (#47463 )

2026-07-15 23:40:55 +00:00

quantization

[feature]Add int4 quantization support for emulation moe backend (#48451 )

2026-07-16 02:00:12 +00:00

__init__.py

[CI/Build] Move test_utils.py to tests/utils.py (#4425 )

2024-05-13 23:50:09 +09:00

allclose_default.py

Convert formatting to use ruff instead of yapf + isort (#26247 )

2025-10-05 07:06:22 -07:00

quant_utils.py

[Perf] Create TMA-aligned input scale tensor for DeepGemm on Hopper (#32619 )

2026-01-22 15:47:04 -05:00

test_apply_repetition_penalties.py

[Platform] Deprecate seed_everything (#31659 )

2026-01-04 18:34:04 -08:00

test_awq_int4_to_int8.py

[CPU] Bump up to the latest CPU kernels (#41924 )

2026-05-07 05:45:59 -07:00

test_bf16x3_router_gemm_cutedsl.py

BF16x3 router GEMM (#47973 )

2026-07-16 17:04:20 +08:00

test_cache_kernels.py

[Hardware] Replace torch.cuda.device_count/current_device/set_device API (#36145 )

2026-03-12 07:57:47 -07:00

test_compressor_kv_cache.py

[ROCm][Perf] DSv4 two-stage compressor kernel for HCA prefill (#47718 )

2026-07-15 23:31:51 +00:00

test_concat_mla_q.py

[Attention][Perf][Kernel] Replace torch.cat with vectorized CUDA kernel MLA query concat - DeepSeek-V3.2 (#34917 )

2026-03-09 09:50:36 -07:00

test_cp_gather_fp8.py

[Attention][Perf] Optimize cp_gather_and_upconvert_fp8_kv_cache - DeepSeek-v3.2 (#35290 )

2026-03-09 09:46:57 -07:00

test_fla_layernorm_guard.py

[Bugfix] Fix dtype mismatch in RMSNormGated.forward_native() during torch.compile (#35256 )

2026-03-01 15:14:46 -05:00

test_flex_attention.py

[FlexAttention] make custom mask mods fully cudagraphable (#45232 )

2026-06-17 11:53:12 +08:00

test_fp32_router_gemm.py

FP32 router GEMV optimization (#48335 )

2026-07-11 13:07:48 +00:00

test_fused_deepseek_v4_qnorm_rope_kv_insert.py

[ROCm][CI] Relax fused layernorm quant test tolerances for one-ULP outliers (#46658 )

2026-06-27 10:44:29 +08:00

test_fused_deepseek_v32_norm_rope.py

[GLM5] Support FlashMLA FP8 KV cache (Hopper & Blackwell) (#47090 )

2026-06-30 18:13:21 -07:00

test_fused_gdn_post_conv.py

[Perf] fuse kernels in gdn (#37813 )

2026-04-02 11:52:18 +00:00

test_fused_indexer_q_rope_quant.py

[Model Refactoring] Move deepseek_v4_ops to models/deepseek_v4 [3/N] (#43073 )

2026-05-19 00:52:54 -07:00

test_fused_inv_rope_fp8_quant.py

[Feat][DSV4] Fuse q pad into deepseek v4 fused kernel (#43162 )

2026-05-26 05:12:54 -10:00

test_fused_minimax_m3_qknorm_rope_kv_insert.py

[ROCm][MiniMax-M3] Add AITER sparse paged attention (#47287 )

2026-07-12 19:27:29 -07:00

test_fused_qk_norm_rope_gate.py

[Perf] fuse qk rmsnorm rope gate for qwen3.5 (#44176 )

2026-06-09 22:12:17 +08:00

test_fused_quant_activation.py

Add platform manual_seed_all API (#38468 )

2026-04-10 13:43:50 +08:00

test_fused_recurrent_packed_decode.py

[Bugfix] fix main branch pre-commit error (1 line change) (#36897 )

2026-03-12 09:08:37 -07:00

test_fused_sigmoid_gating_delta_rule.py

[Kernel] Add fused_sigmoid_gating_delta_rule_update kernel for Qwen3 Next (#35777 )

2026-03-08 23:41:01 -07:00

test_kda.py

[Perf][KDA] Fuse gate softplus, chunk-local cumsum, and RCP_LN2 scaling (#43667 )

2026-05-28 13:47:08 +00:00

test_ll_bf16_gemm.py

[Model] Add Inkling model support [1/N] (#48799 )

2026-07-15 23:40:07 -07:00

test_mhc_kernels.py

[ROCm][DSV4] Disable TileLang MHC dispatch on gfx942 (#45931 )

2026-06-22 09:26:54 +00:00

test_minimax_m3_amd_ops.py

[ROCm] fixed aiter master flag and expert parallelism compatibility on minimax-m3-mxfp8 (#47158 )

2026-07-08 15:26:17 +08:00

test_minimax_m3_sparse_attn_fp8_scale.py

[ROCm][MiniMax-M3] Add AITER sparse paged attention (#47287 )

2026-07-12 19:27:29 -07:00

test_onednn.py

[CPU] Refactor CPU attention backend (#27954 )

2025-11-12 09:43:06 +08:00

test_shuffle_rows.py

Convert formatting to use ruff instead of yapf + isort (#26247 )

2025-10-05 07:06:22 -07:00

test_top_k_per_row.py

[Perf][DSv4/DSv3.2] Add cluster-cooperative topK kernel for low-latency scenarios (#43008 )

2026-06-23 16:11:00 -07:00

utils.py

[ROCm][CI] Relax fused layernorm quant test tolerances for one-ULP outliers (#46658 )

2026-06-27 10:44:29 +08:00