vllm/benchmarks/cutlass_benchmarks at torch_dynamo - vllm - Gitea: Git with a cup of macha paffe

karylab_agents/vllm

forked from Karylab-cklius/vllm

Files

T

History

Woosuk KwonandGitHub a9a2e74d21 [Misc] Use torch.Tensor for type annotation (#6505 )

2024-07-17 13:01:10 +00:00

..

w8a8_benchmarks.py

[Misc] Use torch.Tensor for type annotation (#6505 )

2024-07-17 13:01:10 +00:00

weight_shapes.py

Fix w8a8 benchmark and add Llama-3-8B (#5562 )

2024-06-17 06:48:06 +00:00