Age | Commit message (Collapse) | Author | |
---|---|---|---|
2023-04-21 | Improve cuBLAS performance by using a memory pool (#1094) | slaren | |
* Improve cuBLAS performance by using a memory pool * Move cuda specific definitions to ggml-cuda.h/cu * Add CXX flags to nvcc * Change memory pool synchronization mechanism to a spin lock General code cleanup | |||
2023-04-20 | Add Q4_3 support to cuBLAS (#1086) | slaren | |
2023-04-20 | Improve cuBLAS performance by dequantizing on the GPU (#1065) | slaren | |