3 people 363fc84407 Integrate flashinfer b12x MoE and FP4 GEMM kernels for SM120/121 (#40082) ...

Signed-off-by: Meenakshi Venkataraman <meenakshiv@nvidia.com>
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-05-20 17:21:11 +00:00

..

modular_kernel_tools

[MoE Refactor] Move remaining experts classes to experts directory (#42334)

2026-05-12 09:19:46 -04:00

__init__.py

[Kernel] DeepEP dispatch-combine kernel integration (#18434)

2025-06-03 12:30:02 -07:00

conftest.py

[MoE Refactor][Test] FusedMoE layer test (#24675)

2026-04-06 17:17:23 +00:00

parallel_utils.py

[MoE] Move PF Methods to Folder (#35927)

2026-03-22 02:42:59 -06:00

test_batched_deepgemm.py

[MoE Refactor] Move remaining experts classes to experts directory (#42334)

2026-05-12 09:19:46 -04:00

test_batched_moe.py

[MoE Refactor] Move remaining experts classes to experts directory (#42334)

2026-05-12 09:19:46 -04:00

test_block_fp8.py

[MoE Refactor] Move remaining experts classes to experts directory (#42334)

2026-05-12 09:19:46 -04:00

test_block_int8.py

[Misc] Make SchedulerConfig.max_model_len init-only (#28733)

2025-11-15 01:59:31 -08:00

test_count_expert_num_tokens.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

test_cpu_fused_moe.py

[CPU] Support gelu act in cpu_fused_moe (#38770)

2026-04-02 14:14:32 +08:00

test_cpu_quant_fused_moe.py

[CPU] Add MXFP4 W4A16 MoE support (#41922)

2026-05-18 03:04:45 -07:00

test_cutedsl_moe.py

[CI/Build] Bump flashinfer to v0.6.11.post2 (#41711)

2026-05-16 14:55:12 -07:00

test_cutlass_moe.py

[MoE] Move cutlass moe to fused_moe/experts/ (#40574)

2026-04-24 06:05:49 +00:00

test_cutlass_mxfp8_grouped_mm.py

[Kernel] Integrate SM100 MXFP8 blockscaled grouped MM and quant kernels (#34448)

2026-03-01 23:31:19 -08:00

test_deepep_deepgemm_moe.py

[MoE Refactor] Remove MoE DP chunking (#39107)

2026-04-14 09:48:05 -04:00

test_deepep_moe.py

[MoE Refactor] Move remaining experts classes to experts directory (#42334)

2026-05-12 09:19:46 -04:00

test_deepgemm.py

[MoE Refactor] Move remaining experts classes to experts directory (#42334)

2026-05-12 09:19:46 -04:00

test_flashinfer_b12x_moe.py

Integrate flashinfer b12x MoE and FP4 GEMM kernels for SM120/121 (#40082)

2026-05-20 17:21:11 +00:00

test_flashinfer_moe.py

[MoE] Move various experts classes to fused_moe/experts/ (#41979)

2026-05-11 07:54:33 +08:00

test_flashinfer.py

[MoE] Move various experts classes to fused_moe/experts/ (#41979)

2026-05-11 07:54:33 +08:00

test_fused_topk.py

test: add nan/inf clamp regression test for fused_topk_bias (#40553)

2026-04-22 00:46:53 +00:00

test_gemma4router.py

[FEAT] [Perf] [Gemma4] Fused Gemma4 Routing Function Triton (#39083)

2026-04-19 09:57:39 +00:00

test_gpt_oss_triton_kernels.py

[MoE] Move GPT OSS Triton kernel experts into fused_moe/experts/ (#39007)

2026-04-14 19:27:39 +00:00

test_grouped_topk.py

[Bugfix] Register VLLM_BATCH_INVARIANT in envs.py to fix spurious unknown env var warning (#35007)

2026-03-23 18:31:14 -04:00

test_marlin_vs_trtllm_mxint4.py

[MoE] Move various experts classes to fused_moe/experts/ (#41979)

2026-05-11 07:54:33 +08:00

test_modular_kernel_combinations.py

replace cuda_device_count_stateless() to current_platform.device_count() (#37841)

2026-03-31 22:32:54 +08:00

test_modular_oai_triton_moe.py

[MoE] Move GPT OSS Triton kernel experts into fused_moe/experts/ (#39007)

2026-04-14 19:27:39 +00:00

test_moe_align_block_size.py

[Bugfix] Fix expert_ids padding values in moe_align_block_size kernel (#35161)

2026-02-24 17:14:24 -08:00

test_moe_layer.py

[MoE Refactor] Add sequence parallel tests to test_moe_layer.py (#41299)

2026-05-12 21:52:19 -04:00

test_moe_permute_unpermute.py

[MoE Refactor] Move expert map related code into ExpertMapManager class (#41046)

2026-05-12 09:18:27 -04:00

test_moe_weight_loading_padded.py

[fix][MOE] Fix MOE experts intermediate_size dimension not being narrowed before weight loading (#39688)

2026-04-14 09:35:28 +00:00

test_moe.py

Refactor AWQ Marlin MoE onto modular WNA16 oracle (#42483)

2026-05-18 08:02:43 -07:00

test_mxfp4_moe.py

[Kernel] Add MXFP4 W4A4 CUTLASS MoE kernel for SM100 (#37463)

2026-04-17 16:42:32 -07:00

test_nvfp4_moe.py

[MoE] Move cutlass moe to fused_moe/experts/ (#40574)

2026-04-24 06:05:49 +00:00

test_ocp_mx_moe.py

[ROCm][Quantization][2/N] Refactor quark_moe w4a8 w/ oracle (#39136)

2026-05-04 19:50:38 -07:00

test_rocm_aiter_topk.py

[MoE] Move various experts classes to fused_moe/experts/ (#41979)

2026-05-11 07:54:33 +08:00

test_routing_simulator.py

[ROCm][CI] Fix AITER state leak in shared_fused_moe_routed_transform test (#38137)

2026-03-26 09:26:46 -07:00

test_routing.py

[MoE Refactor] EPLB refactoring for FusedMoE (#41055)

2026-05-12 14:16:31 -04:00

test_shared_fused_moe_routed_transform.py

[MoE Refactor] Remove SharedFusedMoE class (#35782)

2026-04-21 18:12:12 -04:00

test_silu_mul_fp8_quant_deep_gemm.py

[UX] Integrate DeepGEMM into vLLM wheel via CMake (#37980)

2026-04-08 18:56:32 -07:00

test_silu_mul_per_token_group_quant_fp8_colmajor.py

[Bugfix] Add swiglu limits to deepgemm fp8 methods (#41986)

2026-05-14 15:43:13 -07:00

test_topk_softplus_sqrt.py

[New Model][ROCm] Add AMD support for DeepSeek V4 (#40871)

2026-05-05 08:55:37 -07:00

test_triton_moe_no_act_mul.py

[MoE] Move various experts classes to fused_moe/experts/ (#41979)

2026-05-11 07:54:33 +08:00

test_triton_moe_ptpc_fp8.py

[CI/Build] Only use supported types and features on ROCm in MoE kernel tests (#29149)

2025-11-21 20:34:33 -07:00

test_trtllm_nvfp4_moe.py

[Bugfix] Fix FlashInfer CUTLASS MXFP4-MXFP8 MoE by restoring swizzled scale (#42089)

2026-05-08 15:59:06 -07:00

test_unquantized_backend_selection.py

[MoE] Move various experts classes to fused_moe/experts/ (#41979)

2026-05-11 07:54:33 +08:00

test_zero_expert_moe.py

[MoE Refactor] Introduce RoutedExperts alias for FusedMoE and don't store SharedExperts in MK (#40735)

2026-05-12 13:37:44 -04:00

utils.py

[MoE Refactor] Move remaining experts classes to experts directory (#42334)

2026-05-12 09:19:46 -04:00