karylab_agents/vllm
1
0
Fork 0
forked from Karylab-cklius/vllm
Code Pull Requests 2 Actions 1 Packages Activity
2,381 Commits 354 Branches 175 Tags
0df7ec0b2d890799ca71e2f862fdff5fcc52cdc0
Commit Graph
6 Commits
Author SHA1 Message Date
Woosuk KwonandGitHub a08df8322e [TPU] Support multi-host inference (#7457) 2024-08-13 16:31:20 -07:00
Woosuk KwonandGitHub 90bab18f24 [TPU] Use mark_dynamic to reduce compilation time (#7340) 2024-08-10 18:12:22 -07:00
Woosuk KwonandGitHub fad5576c58 [TPU] Reduce compilation time & Upgrade PyTorch XLA version (#6856) 2024-07-27 10:28:33 -07:00
Woosuk KwonandGitHub c467dff24f [Hardware][TPU] Support MoE with Pallas GMM kernel (#6457) 2024-07-16 09:56:28 -07:00
Woosuk KwonandGitHub 8c00f9c15d [Docs][TPU] Add installation tip for TPU (#5761) 2024-06-21 23:09:40 -07:00
Woosuk KwonandGitHub 1a8bfd92d5 [Hardware] Initial TPU integration (#5292) 2024-06-12 11:53:03 -07:00