Greg Pereiraandkhluu a6ac49a33b [Bugfix] Fix invalid JSON in Gemma 4 streaming tool calls by stripping partial delimiters (#38992) ...

Signed-off-by: greg pereira <grpereir@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
(cherry picked from commit f53fa26e05)
(cherry picked from commit 10a26d1d9a)

2026-04-15 17:50:31 -07:00

..

basic_correctness

Make Gemma and Gemma 2 accept inputs_embeds like Gemma 3 (#36787)

2026-03-11 18:12:43 +00:00

benchmarks

[Chore] Replace all base64 usages with faster pybase64 package (#37290)

2026-03-17 14:44:19 +00:00

compile

[ROCm][CI] Fix flaky GPTQ compile correctness test (#38161)

2026-03-26 19:57:00 +08:00

config

[Bugfix] Exclude language_model_only key from MM AOT compile hash but include in model one (#34508)

2026-02-13 13:59:00 +00:00

cuda

[Hardware] Replace torch.cuda.device_count/current_device/set_device API (#36145)

2026-03-12 07:57:47 -07:00

detokenizer

[CI/Build] Remove use of skip_v1 (#34699)

2026-02-18 12:19:11 +08:00

distributed

[EPLB] Cleanup the transfer logic for the various eplb maps (#34520)

2026-03-27 10:18:46 +01:00

engine

Turn @config into a dataclass_transform (#31541)

2026-02-03 17:40:59 +00:00

entrypoints

[CI] Add temperature=0.0, reduce max_tokens, and add debug prints to audio_in_video tests (#38492)

2026-03-30 05:36:45 +00:00

evals

[CI] fix LM Eval Qwen3.5 Models (B200) (#38632)

2026-04-01 01:02:20 -07:00

kernels

[ROCm][CI] Fix AITER state leak in shared_fused_moe_routed_transform test (#38137)

2026-03-26 09:26:46 -07:00

lora

[Bugfix][ROCm][MoE] Fix mxfp4 oracle regressions from #37128 (#37787)

2026-03-25 08:17:33 +08:00

model_executor

[QeRL] Fix online quantized reloading (#38442)

2026-03-29 14:56:41 -06:00

models

feat(models): implement Google Gemma 4 architecture support (MoE, Multimodal, Reasoning, Tool-Use) (#38826)

2026-04-02 11:49:53 -07:00

multimodal

(security) Enforce frame limit in VideoMediaIO (#38636)

2026-04-01 12:10:40 -07:00

plugins

[Misc] Reorganize inputs (#35182)

2026-03-25 10:22:54 -07:00

plugins_tests

[Misc] Reorganize inputs (#35182)

2026-03-25 10:22:54 -07:00

prompts

[BugFix] Fix input positions for long context with sliding window (#2088)

2023-12-13 12:28:13 -08:00

quantization

enable skipping of SW attention layers when using FP8 KV cache (#33695)

2026-03-27 07:25:02 -06:00

reasoning

feat(models): implement Google Gemma 4 architecture support (MoE, Multimodal, Reasoning, Tool-Use) (#38826)

2026-04-02 11:49:53 -07:00

renderers

[Bugfix] Offload blocking tokenizer ops to shared thread pool to unblock event loop (#34789)

2026-03-26 22:17:00 -07:00

rocm/aiter

[ROCm][CI] Cleaning and restructuring amd-ci legacy pipeline (#34839)

2026-03-19 14:30:58 -05:00

samplers

[Frontend] Add Support for MM Encoder/Decoder Beam Search (Offline) (#36153)

2026-03-06 01:16:56 -08:00

standalone_tests

[CI][BugFix] ShellCheck cleanup to remove baseline and preserve runtime behavior (#34514)

2026-02-17 12:22:56 +00:00

system_messages

[V1] Implement Cascade Attention (#11635)

2025-01-01 21:56:46 +09:00

tokenizers_

[Bugfix] Fix Qwen-VL tokenizer implementation (#36140)

2026-03-05 08:07:19 -08:00

tool_parsers

[Bugfix] Fix invalid JSON in Gemma 4 streaming tool calls by stripping partial delimiters (#38992)

2026-04-15 17:50:31 -07:00

tool_use

[CI] Fix flaky tool_use chat completion tests with deterministic seed (#37027)

2026-03-17 03:24:34 +00:00

tools

Turn @config into a dataclass_transform (#31541)

2026-02-03 17:40:59 +00:00

tracing

[CI][Tracing] Fix race condition by adding server readiness check (#34364)

2026-02-16 12:57:39 +00:00

transformers_utils

[Feature] Add Azure Blob Storage support for RunAI Model Streamer (#34614)

2026-03-15 19:38:21 +08:00

utils_

[Refactor] Remove unused utils (#38153)

2026-03-26 17:08:19 +08:00

v1

[Misc] Rename think_start_str/think_end_str to reasoning_start_str/reasoning_end_str (#38242)

2026-04-01 12:10:53 -07:00

vllm_test_utils

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

weight_loading

[Sparse24] [Deprecation] Remove Sparse24 CT integration and kernels (#36799)

2026-03-23 16:03:29 -04:00

__init__.py

…

ci_envs.py

[Model][0/N] Improve all pooling task | clean up (#25817)

2025-10-13 16:44:50 +08:00

conftest.py

[Refactor] Relocate tests from tests/v1/entrypoints/ to tests/entrypoints/ (#37500)

2026-03-20 02:50:34 -07:00

test_access_log_filter.py

[Logging] add --disable-access-log-for-endpoints CLI option (#30011)

2026-01-26 21:49:03 +00:00

test_attention_backend_registry.py

[1/N][Attention] Restructure attention: move files (#31916)

2026-01-09 13:10:24 -08:00

test_config.py

[Bugfix] Disallow renderer_num_workers > 1 with mm processor cache (#38418)

2026-03-28 06:32:52 -07:00

test_embedded_commit.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_envs.py

fix(security): Add VLLM_MAX_N_SEQUENCES environment variable and enforce limit (#37952)

2026-03-27 09:02:10 -04:00

test_inputs.py

[Refactor] Pass full VllmConfig to Renderer (#34485)

2026-02-12 22:48:38 -08:00

test_logger.py

[BugFix] respect VLLM_LOGGING_LEVEL in logger (#29761)

2025-12-02 07:49:16 +00:00

test_logprobs.py

[Core] Switch Flat logprob control from environment variable to SamplingParams (#28914)

2025-11-19 02:10:02 +00:00

test_outputs.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_pooling_params.py

[Model] Deprecate the score task (this will not affect users). (#37537)

2026-03-20 08:07:56 +00:00

test_ray_env.py

[Ray] Propagate third-party env vars to Ray workers via prefix matching (#34383)

2026-02-17 01:08:42 -08:00

test_regression.py

[ROCm][CI] Add large_gpu_mark to test_max_tokens_none for ROCm (#37717)

2026-03-22 12:25:16 +08:00

test_scalartype.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_seed_behavior.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_sequence.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_triton_utils.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_version.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_vllm_port.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_zen_cpu_platform_detection.py

In-Tree AMD Zen CPU Backend via zentorch [1/N] (#35970)

2026-03-15 23:35:35 +00:00

utils.py

[CI] Fix GPU memory leak when RemoteOpenAIServer fails to start in __init__ (#37230)

2026-03-17 09:08:08 -07:00