karylab_agents/vllm
1
0
Fork 0
forked from Karylab-cklius/vllm
Code Pull Requests 2 Actions 1 Packages Activity
1,627 Commits 354 Branches 175 Tags
a3e8a05d4c1b79dd44eb92bb6f57eb40c3fbdb21
Commit Graph
1 Commits
Author SHA1 Message Date
Cade DanielandGitHub 8437bae6ef [Speculative decoding 3/9] Worker which speculates, scores, and applies rejection sampling (#3103) 2024-03-08 23:32:46 -08:00