3 people 80b18230e0 [Frontend] Add multimodal support to /inference/v1/generate endpoint (#38405) ...

Signed-off-by: Nithin Chalapathi <nithin.ch10@gmail.com>
Signed-off-by: Nithin Chalapathi <nithinc@berkeley.edu>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

2026-04-17 20:31:56 -07:00

..

chart-helm

[Doc]: Make extraInit containers fully configurable in helm chart (#27497)

2025-11-06 20:27:16 +00:00

disaggregated_encoder

[EPD] update EPD script arguments (#36742)

2026-03-31 12:02:09 +00:00

disaggregated_serving

[Frontend] Add multimodal support to /inference/v1/generate endpoint (#38405)

2026-04-17 20:31:56 -07:00

disaggregated_serving_p2p_nccl_xpyd

[CI][BugFix] ShellCheck cleanup to remove baseline and preserve runtime behavior (#34514)

2026-02-17 12:22:56 +00:00

ec_both_encoder

[BugFix] Fix implicit and incorrect assumption on ECConnector is_producer (#34783)

2026-03-04 15:01:30 +01:00

elastic_ep

[WideEP] Remove pplx all2all backend (#33724)

2026-02-26 14:30:10 -08:00

structured_outputs

[Doc]: fixing typos in various files (#30540)

2025-12-14 02:14:37 -08:00

api_client.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

batched_chat_completions.py

Add /v1/chat/completions/batch endpoint for batched chat completions (#38011)

2026-03-26 12:13:33 +08:00

data_parallel_pause_resume.py

[Core] Move pause and resume functions into engine (#34125)

2026-02-13 00:15:10 -08:00

disaggregated_prefill.sh

[CI][BugFix] ShellCheck cleanup to remove baseline and preserve runtime behavior (#34514)

2026-02-17 12:22:56 +00:00

gradio_openai_chatbot_webserver.py

[Bugfix] Update Gradio OpenAI Chatbot Webserver example to new Gradio message history format (#29249)

2025-11-24 00:47:54 +00:00

gradio_webserver.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

kv_events_subscriber.py

[HMA] [KVEvent] Enable GPU-side KV events for HMA (#37688)

2026-04-12 10:01:02 +03:00

multi_instance_data_parallel.py

[Misc][DP] support customized aggregated logger for dp (#24354)

2025-10-13 17:45:59 -07:00

multi-node-serving.sh

[CI][BugFix] ShellCheck cleanup to remove baseline and preserve runtime behavior (#34514)

2026-02-17 12:22:56 +00:00

openai_chat_completion_client_for_multimodal.py

[Chore] Replace all base64 usages with faster pybase64 package (#37290)

2026-03-17 14:44:19 +00:00

openai_chat_completion_client_with_tools_required.py

[V0 Deprecation] Remove VLLM_USE_V1 from docs and scripts (#26336)

2025-10-07 16:46:44 +08:00

openai_chat_completion_client_with_tools_xlam_streaming.py

[Misc] Add SPDX-FileCopyrightText (#20428)

2025-07-04 07:40:42 +00:00

openai_chat_completion_client_with_tools_xlam.py

[Misc] Add SPDX-FileCopyrightText (#20428)

2025-07-04 07:40:42 +00:00

openai_chat_completion_client_with_tools.py

[Frontend] supports interleaved thinking (#28531)

2025-11-13 16:14:13 +08:00

openai_chat_completion_tool_calls_with_reasoning.py

reasoning_content -> reasoning (#27752)

2025-11-08 12:15:08 +00:00

openai_chat_completion_with_reasoning_streaming.py

reasoning_content -> reasoning (#27752)

2025-11-08 12:15:08 +00:00

openai_chat_completion_with_reasoning.py

reasoning_content -> reasoning (#27752)

2025-11-08 12:15:08 +00:00

openai_lid_client.py

[model] support FireRedLID (#39290)

2026-04-10 08:43:58 +00:00

openai_realtime_client.py

[Chore] Replace all base64 usages with faster pybase64 package (#37290)

2026-03-17 14:44:19 +00:00

openai_realtime_microphone_client.py

[Chore] Replace all base64 usages with faster pybase64 package (#37290)

2026-03-17 14:44:19 +00:00

openai_responses_client_with_mcp_tools.py

[Frontend] Add tool filtering support to ToolServer (#29224)

2025-12-01 08:03:57 +00:00

openai_responses_client_with_tools.py

[responsesAPI][5] ResponsesParser with tools for full MCP python loop (#29798)

2025-12-05 11:11:50 -05:00

openai_responses_client.py

[responsesAPI] parse reasoning item input (#28248)

2025-11-22 15:42:11 +08:00

openai_transcription_client.py

[model] support FunASR model (#33247)

2026-02-11 07:37:09 +00:00

openai_translation_client.py

[Doc] Remove hardcoded Whisper in example openai translation client (#32027)

2026-01-09 14:44:52 +00:00

prompt_embed_inference_with_openai_client.py

[Frontend] Use new Renderer for Completions and Tokenize API (#32863)

2026-01-31 04:51:15 -08:00

ray_serve_deepseek.py

[V0 Deprecation] Remove VLLM_USE_V1 from docs and scripts (#26336)

2025-10-07 16:46:44 +08:00

retrieval_augmented_generation_with_langchain.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

retrieval_augmented_generation_with_llamaindex.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

run_cluster.sh

[FIX]Patch run-cluster.sh (fix for #28328) (#30002)

2025-12-11 23:36:31 +00:00

sagemaker-entrypoint.sh

[Misc] Add In-Container restart capability through supervisord for sagemaker entrypoint (#28502)

2026-01-13 13:06:10 -08:00

streamlit_openai_chatbot_webserver.py

reasoning_content -> reasoning (#27752)

2025-11-08 12:15:08 +00:00

token_generation_client.py

Explicitly set return_dict for apply_chat_template (#33372)

2026-01-30 07:27:04 +00:00

utils.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00