Karylab-cklius/vllm
1
0
Fork 1
Code Issues Pull Requests 1 Actions Packages Projects Releases Wiki Activity
2,214 Commits 352 Branches 175 Tags
a3bbbfa1d8c2f30581d37c6f30429d648bbbf87c
Commit Graph
3 Commits
Author SHA1 Message Date
Michael GoinandGitHub 460c1884e3 [Bugfix] Support cpu offloading with fp8 quantization (#6960) 2024-07-31 12:47:46 -07:00
Matt WongandGitHub 06d6c5fe9f [Bugfix][CI/Build][Hardware][AMD] Fix AMD tests, add HF cache, update CK FA, add partially supported model notes (#6543) 2024-07-20 09:39:07 -07:00
youkaichaoandGitHub f53b8f0d05 [ci][test] add correctness test for cpu offloading (#6549) 2024-07-18 23:41:06 +00:00