This website requires JavaScript.
Explore
Help
Sign In
karylab_agents
/
vllm
Watch
1
Star
0
Fork
0
forked from
Karylab-cklius/vllm
Code
Pull Requests
2
Actions
1
Packages
Activity
Files
d64bf1646c19123bf236d5ba1c02b75ee3d68306
vllm
/
csrc
/
attention
T
History
Dean Leitersdorf
and
GitHub
79af7e96a0
[OPTIMIZATION] Optimizes the single_query_cached_kv_attention kernel (
#420
)
2023-08-04 10:57:29 -07:00
..
attention_dtypes.h
Improve setup script & Add a guard for bfloat16 kernels (
#130
)
2023-05-27 00:59:32 -07:00
attention_generic.cuh
Change the name to vLLM (
#150
)
2023-06-17 03:07:40 -07:00
attention_kernels.cu
[OPTIMIZATION] Optimizes the single_query_cached_kv_attention kernel (
#420
)
2023-08-04 10:57:29 -07:00
attention_utils.cuh
Change the name to vLLM (
#150
)
2023-06-17 03:07:40 -07:00
dtype_bfloat16.cuh
Change the name to vLLM (
#150
)
2023-06-17 03:07:40 -07:00
dtype_float16.cuh
Change the name to vLLM (
#150
)
2023-06-17 03:07:40 -07:00
dtype_float32.cuh
Change the name to vLLM (
#150
)
2023-06-17 03:07:40 -07:00
