4 people 68dd7db810 [Reasoning] Support for speculative decoding with thinking budget (#34668) ...

Signed-off-by: rishitdholakia13 <rishit+github@cohere.com>
Signed-off-by: rishitdholakia13 <123388671+rishitdholakia13@users.noreply.github.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

2026-04-29 06:14:52 +00:00

..

anthropic

[Refactor] Relocate endpoint tests to mirror serving code directory structure (#37504)

2026-03-19 07:19:36 +00:00

llm

feat(multimodal): support externally processed mm_kwargs with cache injection (#39502)

2026-04-21 11:31:09 +00:00

offline_mode

Various Transformers v5 fixes (#38127)

2026-03-26 00:10:08 +00:00

openai

[Reasoning] Support for speculative decoding with thinking budget (#34668)

2026-04-29 06:14:52 +00:00

pooling

[Deprecate] Deprecate LLM.reward offline api, use LLM.encode instead. (#40688)

2026-04-24 05:37:50 +00:00

rpc

[Refactor] [4/N] Move VLLM_SERVER_DEV endpoints into the serve directory (#30749)

2025-12-17 02:27:30 -08:00

sagemaker

[openapi server] log exception in exception handler(2/N) (#36201)

2026-03-10 20:16:30 -07:00

serve

[Feature] Warm up readonly multimodal processor during renderer startup (#40797)

2026-04-25 03:57:41 +00:00

weight_transfer

[Hardware] Replace torch.cuda.device_count/current_device/set_device API (#36145)

2026-03-12 07:57:47 -07:00

__init__.py

[CI/Build] Move test_utils.py to tests/utils.py (#4425)

2024-05-13 23:50:09 +09:00

conftest.py

[Feat] allow inplace loading lora (#31326)

2026-01-20 10:15:20 +08:00

test_api_server_process_manager.py

[Frontend] Move APIServerProcessManager target server fn (#38115)

2026-03-25 18:14:41 +00:00

test_chat_utils.py

[Misc] Reorganize inputs (#35182)

2026-03-25 10:22:54 -07:00

test_context.py

[Bugfix] Fix Harmony preamble visibility in Responses API (#32114)

2026-02-25 08:08:16 -08:00

test_grpc_health.py

[gRPC] Add standard gRPC health checking (grpc.health.v1) for Kubernetes native probes (#38016)

2026-04-22 21:31:00 +00:00

test_launch_cli.py

[Frontend] Add vllm launch command for GPU-less preprocessing serving (#34551)

2026-03-04 18:41:52 +00:00

test_ssl_cert_refresher.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_utils.py

[Bugfix] Force continuous usage stats when CLI override is enabled (#37923)

2026-03-24 10:29:50 -07:00