3 people 363fc84407 Integrate flashinfer b12x MoE and FP4 GEMM kernels for SM120/121 (#40082) ...

Signed-off-by: Meenakshi Venkataraman <meenakshiv@nvidia.com>
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-05-20 17:21:11 +00:00

..

basic_correctness

[Test] Refactor hard coded device string in test files under compile/quantization/models/model_executor folders (#38901)

2026-04-15 11:02:35 +08:00

benchmarks

[Bench] Forward --seed to CustomDataset and CustomMMDataset shuffle (#40788)

2026-05-04 00:39:10 +00:00

compile

[CI][ROCm] Remove unsupported cases in test_fusion.py (#38680)

2026-05-14 17:37:18 -04:00

config

[Perf] FP8 FlashInfer Attn for ViT (#38065)

2026-04-27 13:44:15 +08:00

cuda

[Hardware] Replace torch.cuda.device_count/current_device/set_device API (#36145)

2026-03-12 07:57:47 -07:00

detokenizer

[CI/Build] Remove use of skip_v1 (#34699)

2026-02-18 12:19:11 +08:00

distributed

[bug] fix WeightTransferConfig.backend to allow for all strings (#43121)

2026-05-19 21:01:29 -04:00

engine

[Attention] Remove deprecated MLA prefill arguments (#42555)

2026-05-14 10:34:06 -07:00

entrypoints

[R3] Add routed experts to openai entrypoint (#38939)

2026-05-20 09:07:59 -07:00

evals

[CI] Add DSV4-Flash to gsm8k moe-refactor/config-b200.txt (#42111)

2026-05-19 20:21:01 -07:00

ir

[Perf] Set IR Op Priority Once at Worker Init (#42631)

2026-05-15 15:56:13 +00:00

kernels

Integrate flashinfer b12x MoE and FP4 GEMM kernels for SM120/121 (#40082)

2026-05-20 17:21:11 +00:00

lora

[LoRA] Support 2D and 3D MoE LoRA adapter at the same time (#42242)

2026-05-18 15:22:26 +08:00

model_executor

[UX] Add a persistent cache for FlashInfer autotuning (#42537)

2026-05-18 20:25:37 -07:00

models

[Cohere] Enable Cohere MoE (#43143)

2026-05-19 19:32:06 -07:00

multimodal

[Bugfix][Multimodal] PyAV video backend returns keyframes labeled as targets (#42586)

2026-05-14 08:56:59 -07:00

parser

Fix Qwen3 streaming content routing (#40820)

2026-05-06 17:22:01 -04:00

plugins

[Misc] Reorganize inputs (#35182)

2026-03-25 10:22:54 -07:00

plugins_tests

[CI/Build] Skip Prithvi/Terratorch model-registry tests when terratorch is missing (#41389)

2026-04-30 12:47:55 -07:00

prompts

[BugFix] Fix input positions for long context with sliding window (#2088)

2023-12-13 12:28:13 -08:00

quantization

Remove additional dead code as a follow-up to #42889 (#43144)

2026-05-20 10:01:45 -04:00

reasoning

[Bugfix] KimiK2ReasoningParser: guard against buffered end-token in streaming (#41068)

2026-05-04 17:42:05 +00:00

renderers

[Bugfix] Fix incorrect chat template format for Qwen3.5 (#42660)

2026-05-14 20:52:52 -07:00

rocm/aiter

[ROCm][CI] Cleaning and restructuring amd-ci legacy pipeline (#34839)

2026-03-19 14:30:58 -05:00

samplers

[Frontend] Add Support for MM Encoder/Decoder Beam Search (Offline) (#36153)

2026-03-06 01:16:56 -08:00

spec_decode

[Feature] Support custom callable proposer backend for speculative decoding (#39487)

2026-05-13 16:53:01 +00:00

standalone_tests

Add structure to requirements/ directory (#39024)

2026-04-10 13:46:41 -07:00

system_messages

[V1] Implement Cascade Attention (#11635)

2025-01-01 21:56:46 +09:00

tokenizers_

[Mistral Tokenizer] allow more leniency in apply_chat_template (#41658)

2026-05-05 19:56:15 -07:00

tool_parsers

[Bugfix] Use shared coerce_to_schema_type in DeepSeekV32 tool parser (#43019)

2026-05-20 10:21:00 -04:00

tool_use

[Refactor] Consolidate required/named tool_choice streaming into DelegatingParser (#41876)

2026-05-07 09:50:59 -07:00

tools

build: embed image provenance metadata in vLLM containers (#40653)

2026-04-29 03:07:41 -07:00

tracing

[CI][Tracing] Fix race condition by adding server readiness check (#34364)

2026-02-16 12:57:39 +00:00

transformers_utils

[Bugfix] Fix _CONFIG_REGISTRY types getting wrong config class when on-disk model_type differs (#39554)

2026-04-20 19:04:48 -07:00

utils_

[Bugfix] Fix spawn_new_process_for_each_test silently swallowing test failures (#41423)

2026-05-06 11:17:15 -04:00

v1

[CI] Lower granite-4.0-h-tiny gsm8k threshold for Hybrid SSM NixlConnector PD accuracy tests (4 GPUs) (#43186)

2026-05-20 17:00:24 +00:00

vllm_test_utils

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

weight_loading

[Quant] Consolidate GPTQ: rename gptq_marlin.py to auto_gptq.py (#38288)

2026-05-15 08:25:52 +08:00

__init__.py

[Small] Formatter only checks lints in changed files (#1528)

2023-10-31 15:39:38 -07:00

ci_envs.py

[Model][0/N] Improve all pooling task | clean up (#25817)

2025-10-13 16:44:50 +08:00

conftest.py

[MLA Attention Backend] Add TOKENSPEED_MLA backend for DSR1/Kimi K25 prefill + decode on Blackwell (#41778)

2026-05-13 23:48:02 -07:00

test_access_log_filter.py

[Logging] add --disable-access-log-for-endpoints CLI option (#30011)

2026-01-26 21:49:03 +00:00

test_attention_backend_registry.py

[1/N][Attention] Restructure attention: move files (#31916)

2026-01-09 13:10:24 -08:00

test_config.py

[Bugfix][MRV2] Fix KVCache tensor explicit kernel_block_size dim (#42766)

2026-05-18 20:25:41 -07:00

test_embedded_commit.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_envs.py

fix nixl side-channel host selection (#41806)

2026-05-11 07:40:37 +00:00

test_fxgraphcache_pickle_patch.py

[ZenCPU] Make PT Backport Patch Accessible to vLLM (#38205)

2026-04-10 08:29:35 +00:00

test_inputs.py

[Refactor] Pass full VllmConfig to Renderer (#34485)

2026-02-12 22:48:38 -08:00

test_jit_monitor.py

[Feature] Add Triton kernel JIT compilation monitor for inference (#40137)

2026-05-05 14:08:57 +04:00

test_logger.py

[BugFix] respect VLLM_LOGGING_LEVEL in logger (#29761)

2025-12-02 07:49:16 +00:00

test_logprobs.py

[Core] Switch Flat logprob control from environment variable to SamplingParams (#28914)

2025-11-19 02:10:02 +00:00

test_outputs.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_pooling_params.py

[Model] Deprecate the score task (this will not affect users). (#37537)

2026-03-20 08:07:56 +00:00

test_ray_env_utils.py

[Feat][Executor] Introduce RayExecutorV2 (#36836)

2026-04-01 14:34:29 -07:00

test_ray_env.py

fix nixl side-channel host selection (#41806)

2026-05-11 07:40:37 +00:00

test_regression.py

[CI/Build] Use modelscope's international site for regression test (#42176)

2026-05-09 19:47:09 -07:00

test_scalartype.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_seed_behavior.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_sequence.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_triton_utils.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_version.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_vllm_port.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_zen_cpu_platform_detection.py

In-Tree AMD Zen CPU Backend via zentorch [1/N] (#35970)

2026-03-15 23:35:35 +00:00

utils.py

[Bugfix] Fix LOGITPROC_SOURCE_ENTRYPOINT test to use spawn-compatible dist-info registration for XPU/ROCm (#42040)

2026-05-09 12:32:04 +08:00