vllm/tests/worker/spec_decode at d3c04b6a39df016504c28ec3fc27ea58ca802a28 - vllm - Gitea: Git with a cup of macha paffe

karylab_agents/vllm

forked from Karylab-cklius/vllm

Files

T

History

22de45235c Push logprob generation to LLMEngine (#3065 )

Co-authored-by: Avnish Narayan <avnish@anyscale.com>

2024-03-04 19:54:06 +00:00

..

__init__.py

[Speculative decoding 2/9] Multi-step worker for draft model (#2424 )

2024-01-21 16:31:47 -08:00

test_multi_step_worker.py

[Speculative decoding 2/9] Multi-step worker for draft model (#2424 )

2024-01-21 16:31:47 -08:00

utils.py

Push logprob generation to LLMEngine (#3065 )

2024-03-04 19:54:06 +00:00