karylab_agents/vllm
1
0
Fork 0
forked from Karylab-cklius/vllm
Code Pull Requests 2 Actions 1 Packages Activity
1,863 Commits 354 Branches 175 Tags
fc17110bbef4e78703abffac51133a2fb71e9f79
Commit Graph
2 Commits
Author SHA1 Message Date
afeldman-nmGitHubWoosuk Kwon
 		543aa48573 [Kernel] Correctly invoke prefill & decode kernels for cross-attention (towards eventual encoder/decoder model support) (#4888) 
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
 2024-07-08 17:12:15 +00:00
afeldman-nmandGitHub f42a006b15 [Bugfix]: During testing, use pytest monkeypatch for safely overriding the env var that indicates the vLLM backend (#5210) 2024-06-03 20:32:57 -07:00