4 people 8521175db9 fix: migrate gpt_oss_20b moe_backend from env var to model kwargs ...

- Add `flashinfer_trtllm_afp8` and `flashinfer_cutlass_afp8` to MoEBackend
  Literal in vllm/config/kernel.py so they are valid kernel_config values
- Attach `moe_backend="flashinfer_trtllm_afp8"` to the gpt_oss_20b model
  object in models.py (conditionally on Blackwell) instead of setting the
  env var in the test runner
- Remove the TODO env var block from conftest.py

Co-authored-by: GitHub Copilot

Agent-Logs-Url: https://github.com/vllm-project/vllm/sessions/8abf6884-3fc2-45fb-b5c8-1ba82b14c841

Co-authored-by: ProExpertProg <11367180+ProExpertProg@users.noreply.github.com>

2026-04-29 18:15:03 +00:00

..

basic_correctness

[Test] Refactor hard coded device string in test files under compile/quantization/models/model_executor folders (#38901)

2026-04-15 11:02:35 +08:00

benchmarks

feat: add TxtSlicesDataset to allow sampling slices from txt file for benchmarking (#30156)

2026-04-14 09:20:03 +00:00

compile

fix: migrate gpt_oss_20b moe_backend from env var to model kwargs

2026-04-29 18:15:03 +00:00

config

[Perf] FP8 FlashInfer Attn for ViT (#38065)

2026-04-27 13:44:15 +08:00

cuda

[Hardware] Replace torch.cuda.device_count/current_device/set_device API (#36145)

2026-03-12 07:57:47 -07:00

detokenizer

[CI/Build] Remove use of skip_v1 (#34699)

2026-02-18 12:19:11 +08:00

distributed

[Examples] Resettle features examples. (#40995)

2026-04-28 00:33:41 -07:00

engine

[Misc] Support Human-readable (k/K/m/M..) json cli arg (#40473)

2026-04-23 09:42:23 +02:00

entrypoints

[DSV4] Support max reasoning effort (#40982)

2026-04-29 11:03:47 +00:00

evals

[TurboQuant] enable FA3/FA4 for prefill paths (#40092)

2026-04-23 07:35:24 +03:00

ir

[vLLM IR] Add IR op testing and benchmarking infrastructure (#40167)

2026-04-21 00:23:03 +00:00

kernels

[Feat] CPU fp8 attn for AMX/AVX-512 (#39445)

2026-04-29 20:43:21 +08:00

lora

Fix timeout when using LoRA adapters with Nemotron Super (#40916)

2026-04-30 01:39:49 +08:00

model_executor

[Feat] DeepSeek V4 Rebased (#40860)

2026-04-26 18:31:08 -07:00

models

[Models] Cohere MoE (#40817)

2026-04-29 15:54:54 +00:00

multimodal

[Bugfix] use served_model_name for multimodal error message (#41003)

2026-04-27 08:22:35 -07:00

plugins

[Misc] Reorganize inputs (#35182)

2026-03-25 10:22:54 -07:00

plugins_tests

[Misc] Reorganize inputs (#35182)

2026-03-25 10:22:54 -07:00

prompts

[BugFix] Fix input positions for long context with sliding window (#2088)

2023-12-13 12:28:13 -08:00

quantization

[ROCm][CI] Add missing quantization methods and fix online quant test failures (#39801)

2026-04-27 15:08:57 -05:00

reasoning

[Bugfix] Remove tokenizer encode/decode calls from Olmo3 reasoning parser (#40855)

2026-04-27 19:36:54 -07:00

renderers

[Feature] Warm up readonly multimodal processor during renderer startup (#40797)

2026-04-25 03:57:41 +00:00

rocm/aiter

[ROCm][CI] Cleaning and restructuring amd-ci legacy pipeline (#34839)

2026-03-19 14:30:58 -05:00

samplers

[Frontend] Add Support for MM Encoder/Decoder Beam Search (Offline) (#36153)

2026-03-06 01:16:56 -08:00

standalone_tests

Add structure to requirements/ directory (#39024)

2026-04-10 13:46:41 -07:00

system_messages

[V1] Implement Cascade Attention (#11635)

2025-01-01 21:56:46 +09:00

tokenizers_

[DSV4] Support max reasoning effort (#40982)

2026-04-29 11:03:47 +00:00

tool_parsers

[Bugfix] DSV32/V4 add missing type conversion for non-streaming tool calls (#41198)

2026-04-29 09:55:07 +00:00

tool_use

[Responses] Add tool_choice/tools validation to match OpenAI behavior (#40399)

2026-04-22 22:46:10 -07:00

tools

build: embed image provenance metadata in vLLM containers (#40653)

2026-04-29 03:07:41 -07:00

tracing

[CI][Tracing] Fix race condition by adding server readiness check (#34364)

2026-02-16 12:57:39 +00:00

transformers_utils

[Bugfix] Fix _CONFIG_REGISTRY types getting wrong config class when on-disk model_type differs (#39554)

2026-04-20 19:04:48 -07:00

utils_

[Frontend] Add multimodal support to /inference/v1/generate endpoint (#38405)

2026-04-17 20:31:56 -07:00

v1

[Perf] Enable FlashInfer top-k/top-p sampler by default (#40376)

2026-04-29 19:10:34 +04:00

vllm_test_utils

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

weight_loading

[Sparse24] [Deprecation] Remove Sparse24 CT integration and kernels (#36799)

2026-03-23 16:03:29 -04:00

__init__.py

[Small] Formatter only checks lints in changed files (#1528)

2023-10-31 15:39:38 -07:00

ci_envs.py

[Model][0/N] Improve all pooling task | clean up (#25817)

2025-10-13 16:44:50 +08:00

conftest.py

[Deprecate] Deprecate LLM.reward offline api, use LLM.encode instead. (#40688)

2026-04-24 05:37:50 +00:00

test_access_log_filter.py

[Logging] add --disable-access-log-for-endpoints CLI option (#30011)

2026-01-26 21:49:03 +00:00

test_attention_backend_registry.py

[1/N][Attention] Restructure attention: move files (#31916)

2026-01-09 13:10:24 -08:00

test_config.py

[Test] Refactor hard coded device string in test files under compile/quantization/models/model_executor folders (#38901)

2026-04-15 11:02:35 +08:00

test_embedded_commit.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_envs.py

fix(security): Add VLLM_MAX_N_SEQUENCES environment variable and enforce limit (#37952)

2026-03-27 09:02:10 -04:00

test_fxgraphcache_pickle_patch.py

[ZenCPU] Make PT Backport Patch Accessible to vLLM (#38205)

2026-04-10 08:29:35 +00:00

test_inputs.py

[Refactor] Pass full VllmConfig to Renderer (#34485)

2026-02-12 22:48:38 -08:00

test_logger.py

[BugFix] respect VLLM_LOGGING_LEVEL in logger (#29761)

2025-12-02 07:49:16 +00:00

test_logprobs.py

[Core] Switch Flat logprob control from environment variable to SamplingParams (#28914)

2025-11-19 02:10:02 +00:00

test_outputs.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_pooling_params.py

[Model] Deprecate the score task (this will not affect users). (#37537)

2026-03-20 08:07:56 +00:00

test_ray_env_utils.py

[Feat][Executor] Introduce RayExecutorV2 (#36836)

2026-04-01 14:34:29 -07:00

test_ray_env.py

[Ray] Propagate third-party env vars to Ray workers via prefix matching (#34383)

2026-02-17 01:08:42 -08:00

test_regression.py

Remove outdated tests test_mixtral_moe and test_duplicated_ignored_sequence_group (#40175)

2026-04-17 16:49:43 -07:00

test_scalartype.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_seed_behavior.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_sequence.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_triton_utils.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_version.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_vllm_port.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_zen_cpu_platform_detection.py

In-Tree AMD Zen CPU Backend via zentorch [1/N] (#35970)

2026-03-15 23:35:35 +00:00

utils.py

[Bugfix] Fix RMS norm + quant fusion on DeepGEMM UE8M0 path for B200 (#40552)

2026-04-22 22:04:42 +00:00