karylab_agents/vllm
1
0
Fork 0
forked from Karylab-cklius/vllm
Code Pull Requests 2 Actions 1 Packages Activity
1,442 Commits 354 Branches 175 Tags
e9d3aa04f6e55e2bb540f0810da97ddd0deebb13
Commit Graph
2 Commits
Author SHA1 Message Date
Lily LiuandGitHub d5a1697772 [Dynamic Spec Decoding] Minor fix for disabling speculative decoding (#5000) 2024-05-25 10:00:14 -07:00
Cody YuGitHubCade Daniel
 		f942efb5a3 [Dynamic Spec Decoding] Auto-disable by the running queue size (#4592) 
Co-authored-by: Cade Daniel <edacih@gmail.com>
 2024-05-08 21:44:00 +00:00