karylab_agents/vllm
1
0
Fork 0
forked from Karylab-cklius/vllm
Code Pull Requests 2 Actions 1 Packages Activity
2,437 Commits 354 Branches 175 Tags
fc5ebbd1d3453461ea6e00a78faf87c41d1aa625
Commit Graph
2 Commits
Author SHA1 Message Date
SangBin ChoandGitHub ff7ec82c4d [Core] Optimize SPMD architecture with delta + serialization optimization (#7109) 2024-08-18 17:57:20 -07:00
afeldman-nmGitHubAndrew FeldmanNick Hill
 		fd95e026e0 [Core] Subclass ModelRunner to support cross-attention & encoder sequences (towards eventual encoder/decoder model support) (#4942) 
Co-authored-by: Andrew Feldman <afeld2012@gmail.com>
Co-authored-by: Nick Hill <nickhill@us.ibm.com>
 2024-08-06 16:51:47 -04:00