Krish GuptaandGitHub 70c00163ff [Feature] Add instruction support for score/rerank chat templates (#42412) ...

Signed-off-by: KrxGu <krishom70@gmail.com>

2026-05-14 09:41:22 +08:00

..

anthropic

[Frontend] Add defer_loading and tool_reference support for Anthropic and OpenAI APIs (#40190)

2026-04-29 04:35:50 -07:00

cli

[Frontend] Delegate to vLLM Omni When --omni Passed (#40744)

2026-04-24 12:30:00 -04:00

mcp

[Refactor] [11/N] to simplify the mcp architecture (#32396)

2026-01-15 18:49:31 +08:00

openai

[Frontend] add support for thinking_token_budget in completions (#42116)

2026-05-13 16:01:52 -04:00

pooling

[Feature] Add instruction support for score/rerank chat templates (#42412)

2026-05-14 09:41:22 +08:00

sagemaker

[Frontend][last/5] Improve pooling entrypoints | clean up. (#39675)

2026-04-16 07:53:23 -07:00

serve

[Bugfix][Frontend] Default max_tokens server-side on /inference/v1/generate (#42329)

2026-05-13 11:16:46 +02:00

speech_to_text

[Frontend] Consolidate Speech to Text entrypoints. (#42370)

2026-05-12 07:06:57 +00:00

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

api_server.py

[Perf] Add skip_clone to SamplingParams for internal request handling (#31041)

2025-12-24 14:35:57 -08:00

chat_utils.py

feat: Enable prompt_embeds Content Part Support in vLLM Chat Completions API (#40720)

2026-05-01 10:05:55 +08:00

constants.py

[responsesAPI][6] Fix multi turn MCP tokenization (#30230)

2025-12-10 10:13:13 +08:00

grpc_server.py

[gRPC] Add standard gRPC health checking (grpc.health.v1) for Kubernetes native probes (#38016)

2026-04-22 21:31:00 +00:00

launcher.py

[Frontend][Core] Re-add shutdown timeout - allowing in-flight requests to finish (#36666)

2026-03-13 12:10:06 -07:00

llm.py

[Quantization] Rework quantization_config to use QuantKey and allow for activation override (#41566)

2026-05-13 16:58:32 -04:00

logger.py

[Doc] Improve UX of --enable-log-requests (#35723)

2026-03-02 08:24:09 -08:00

ssl.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

utils.py

[Bugfix] Account for truncate_prompt_tokens when computing max_tokens (#41800)

2026-05-06 16:10:17 +00:00