vllm/benchmarks/cutlass_benchmarks at a3e8a05d4c1b79dd44eb92bb6f57eb40c3fbdb21 - vllm - Gitea: Git with a cup of macha paffe

Karylab-cklius/vllm

Files

T

History

Cody YuandGitHub e2b85cf86a Fix w8a8 benchmark and add Llama-3-8B (#5562 )

2024-06-17 06:48:06 +00:00

..

w8a8_benchmarks.py

Fix w8a8 benchmark and add Llama-3-8B (#5562 )

2024-06-17 06:48:06 +00:00

weight_shapes.py

Fix w8a8 benchmark and add Llama-3-8B (#5562 )

2024-06-17 06:48:06 +00:00