Karylab-cklius/vllm
1
0
Fork 1
Code Issues Pull Requests 1 Actions Packages Projects Releases Wiki Activity
109 Commits 352 Branches 175 Tags
submission
Commit Graph
12 Commits
Author SHA1 Message Date
Woosuk KwonandGitHub ee88a7e5f3 Add an option to use dummy model weights (#33) 2023-04-08 23:36:12 -07:00
Woosuk KwonandGitHub 897cb2ae28 Optimize data movement (#20) 2023-04-02 00:30:17 -07:00
Zhuohan LiandGitHub 1f01a18d39 Merge QKV into one linear layer (#15) 2023-04-02 00:23:29 -07:00
Woosuk KwonandGitHub 88c0268a18 Implement custom kernel for LLaMA rotary embedding (#14) 2023-03-30 11:04:21 -07:00
Woosuk KwonGitHubZhuohan Li
 		80a2f812f1 Implement LLaMA (#9) 
Co-authored-by: Zhuohan Li <zhuohan123@gmail.com>
 2023-03-30 12:25:32 +08:00
Zhuohan LiandGitHub 2f49f15585 Support tensor parallel (#2) 2023-03-21 13:45:42 -07:00
Woosuk KwonandGitHub 1a7eb7da61 Support beam search & parallel generation (#7) 2023-03-10 09:58:21 -08:00
Woosuk KwonandGitHub cbf8779afa Fix a bug in tying OPT embeddings (#1) 2023-02-24 16:29:36 -08:00
Woosuk Kwon de0fabbc5c Fix sampler 2023-02-23 20:30:12 +00:00
Woosuk Kwon 86f9eb6d39 Fix typo 2023-02-23 20:19:24 +00:00
Woosuk Kwon d4bc1a4d24 Add unoptimized OPT Attention 2023-02-23 09:31:55 +00:00
Woosuk Kwon 709a69176e Move worker/models -> models 2023-02-22 18:03:48 +00:00