diff options
| author | Johannes Gäßler <johannesg@5d6.de> | 2023-06-06 21:33:23 +0200 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2023-06-06 21:33:23 +0200 |
| commit | 17366df842e358768c0df7024484fffecfc7865b (patch) | |
| tree | f042c8142311d45f8712db10debf89111b2c7e57 /models | |
| parent | 44f906e8537fcec965e312d621c80556d6aa9bec (diff) | |
Multi GPU support, CUDA refactor, CUDA scratch buffer (#1703)
* CUDA multi GPU + scratch
ggml_cuda_compute_forward
Tensor parallelism
ggml_cuda_add
ggml_cuda_rms_norm
ggml_cuda_silu
CUDA scratch buffer
--main-gpu CLI option
Diffstat (limited to 'models')
0 files changed, 0 insertions, 0 deletions