5 people 89c6a41001 [Bench] Add BFCL dataset for vllm bench serve tool-calling workloads (#42457) ...

Signed-off-by: Li Zhang <lzhanga@amazon.com>
Co-authored-by: Li Zhang <lzhanga@amazon.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>

2026-06-09 23:59:18 -07:00

..

sweep

[Benchmark] Simplify SLA scan (#35306)

2026-02-25 22:35:41 -08:00

__init__.py

Add vllm bench [latency, throughput] CLI commands (#16508)

2025-04-14 23:10:35 -07:00

test_bench_startup.py

resolve pydantic error in startup benchmark (#31348)

2026-01-10 02:41:27 +00:00

test_bfcl_dataset.py

[Bench] Add BFCL dataset for vllm bench serve tool-calling workloads (#42457)

2026-06-09 23:59:18 -07:00

test_custom_dataset_chat_template_kwargs.py

[Benchmark] Enable reasoning-model (thinking) benchmarking via --chat-template-kwargs for client-rendered datasets (#44244)

2026-06-02 22:49:51 -07:00

test_custom_dataset_seed.py

[Bench] Forward --seed to CustomDataset and CustomMMDataset shuffle (#40788)

2026-05-04 00:39:10 +00:00

test_custom_image_dataset.py

[Misc] Support local image encoding in benchmarks (#43843)

2026-06-02 15:15:06 +00:00

test_latency_cli.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_plot_filters.py

Fix boolean nested params, add dict format support, and enhance plotting for vllm bench sweep (#29025)

2025-12-02 20:40:56 +00:00

test_random_dataset.py

Feature/video support in random mm dataset (#25963)

2025-10-29 18:24:52 +08:00

test_random_multimodal_dataset_video.py

[Chore] Replace all base64 usages with faster pybase64 package (#37290)

2026-03-17 14:44:19 +00:00

test_sampling_params.py

feat: add TxtSlicesDataset to allow sampling slices from txt file for benchmarking (#30156)

2026-04-14 09:20:03 +00:00

test_serve_cli.py

add --insecure arg to the vllm bench to skip TLS (#34026)

2026-02-10 22:23:52 +08:00

test_throughput_cli.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_txt_slices_dataset.py

feat: add TxtSlicesDataset to allow sampling slices from txt file for benchmarking (#30156)

2026-04-14 09:20:03 +00:00