diff options
| author | katsu560 <118887472+katsu560@users.noreply.github.com> | 2023-07-25 21:13:41 +0900 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2023-07-25 15:13:41 +0300 |
| commit | be2301bcdaf6c9f0921141bd071de7788e2a351a (patch) | |
| tree | 2a9d74bc8a272029f917ce8ec8c0adfe3a42895e /models | |
| parent | 1aa18ef994a6a2b531434eb13251ef48e56d345b (diff) | |
k_quants : add AVX support to dot functions with QK_K as 64 (#2339)
* add AVX to ggml_vec_dot_q2_K_q8_K()
* add AVX to ggml_vec_dot_q3_K_q8_K()
* add AVX to ggml_vec_dot_q4_K_q8_K()
* add AVX to ggml_vec_dot_q5_K_q8_K()
* add AVX to ggml_vec_dot_q6_K_q8_K()
* refactor AVX code in ggml_vec_dot_q6_K_q8_K()
Diffstat (limited to 'models')
0 files changed, 0 insertions, 0 deletions