khluuandClaude Opus 4.6 c0be8b1f82 [CI] Fix model swap test failures ...

- Responses API: Qwen3-1.7B too small for reasoning + tool calling,
  bump to Qwen3-4B (~8 GiB, fits on 17GB MIG slice)
- MM cache stats: llava-onevision produces more multimodal tokens per
  image than llava-1.5, increase max_model_len from 4096 to 8192

Signed-off-by: Kevin H. Luu <khluu000@gmail.com>
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

2026-03-26 20:18:50 -07:00

..

anthropic

[Refactor] Relocate endpoint tests to mirror serving code directory structure (#37504)

2026-03-19 07:19:36 +00:00

llm

[CI] Fix model swap test failures

2026-03-26 20:18:50 -07:00

offline_mode

Various Transformers v5 fixes (#38127)

2026-03-26 00:10:08 +00:00

openai

[CI] Fix model swap test failures

2026-03-26 20:18:50 -07:00

pooling

[CI] Reorganize scoring tests (#38207)

2026-03-26 12:07:01 +00:00

rpc

[Refactor] [4/N] Move VLLM_SERVER_DEV endpoints into the serve directory (#30749)

2025-12-17 02:27:30 -08:00

sagemaker

[openapi server] log exception in exception handler(2/N) (#36201)

2026-03-10 20:16:30 -07:00

serve

[Misc] Reorganize inputs (#35182)

2026-03-25 10:22:54 -07:00

weight_transfer

[Hardware] Replace torch.cuda.device_count/current_device/set_device API (#36145)

2026-03-12 07:57:47 -07:00

__init__.py

[CI/Build] Move test_utils.py to tests/utils.py (#4425)

2024-05-13 23:50:09 +09:00

conftest.py

[Feat] allow inplace loading lora (#31326)

2026-01-20 10:15:20 +08:00

test_api_server_process_manager.py

[Frontend] Move APIServerProcessManager target server fn (#38115)

2026-03-25 18:14:41 +00:00

test_chat_utils.py

[Misc] Reorganize inputs (#35182)

2026-03-25 10:22:54 -07:00

test_context.py

[Bugfix] Fix Harmony preamble visibility in Responses API (#32114)

2026-02-25 08:08:16 -08:00

test_launch_cli.py

[Frontend] Add vllm launch command for GPU-less preprocessing serving (#34551)

2026-03-04 18:41:52 +00:00

test_ssl_cert_refresher.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_utils.py

[Bugfix] Force continuous usage stats when CLI override is enabled (#37923)

2026-03-24 10:29:50 -07:00