karylab_agents/vllm
1
0
Fork 0
forked from Karylab-cklius/vllm
Code Pull Requests 2 Actions 1 Packages Activity
2,381 Commits 354 Branches 175 Tags
0df7ec0b2d890799ca71e2f862fdff5fcc52cdc0
Commit Graph
2 Commits
Author SHA1 Message Date
shangmingcandGitHub b67ae00cdb [Misc] Add quantization config support for speculative model. (#7343) 2024-08-15 19:34:28 -07:00
Cody YuGitHubCade DanielCade Daniel
 		973617ae02 [Speculative decoding][Re-take] Enable TP>1 speculative decoding (#4840) 
Co-authored-by: Cade Daniel <edacih@gmail.com>
Co-authored-by: Cade Daniel <cade@anyscale.com>
 2024-05-16 00:53:51 -07:00