wang.yuqiandGitHub 3e90d015ba [Frontend] Overlap preprocessing and computation for pooling models offline inference (#47699) ...

Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>

2026-07-16 14:00:20 +00:00

..

anthropic

[EC Connector] Add EC Transfer Params (#42433)

2026-07-12 14:35:33 +03:00

cli

[Frontend] Limit SO_REUSEPORT to multi-worker serving (#47529)

2026-07-04 01:26:24 +00:00

generate

[Frontend] add per-request timing metrics field to response body of Chat/Completions APIs (#46768)

2026-07-06 17:48:29 -07:00

mcp

[Refactor] Deprecate ResponsesParser wrapper, inline parsing into ParsableContext (#45431)

2026-06-12 16:15:41 -04:00

openai

[Fix] Align OpenAI vllm_xargs value types across request schemas (#48252)

2026-07-15 17:48:24 +00:00

pooling

[Frontend] Overlap preprocessing and computation for pooling models offline inference (#47699)

2026-07-16 14:00:20 +00:00

scale_out

[EC Connector] Add EC Transfer Params (#42433)

2026-07-12 14:35:33 +03:00

serve

[Frontend] Add /abort_requests to the RLHF dev API router (#47173)

2026-07-12 14:21:02 +08:00

speech_to_text

[Fix] Align OpenAI vllm_xargs value types across request schemas (#48252)

2026-07-15 17:48:24 +00:00

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

chat_utils.py

fix(entrypoints): stop resolve_items leaking in-flight media fetch tasks on partial failure (#48333)

2026-07-11 15:42:08 +00:00

grpc_server.py

[Frontend] Consolidate online serving utils. (#44479)

2026-06-04 06:49:31 +00:00

launcher.py

[Logs Refactor] Optimize shutdown logs, easier to follow and consistent (#43707)

2026-06-04 14:36:32 -04:00

llm.py

[Frontend] Overlap preprocessing and computation for pooling models offline inference (#47699)

2026-07-16 14:00:20 +00:00

offline_utils.py

[Frontend] Split the offline inference APIs and utils. (#43553)

2026-05-26 05:20:24 +00:00