diff options
| author | eiery <19350831+eiery@users.noreply.github.com> | 2023-04-22 04:27:05 -0400 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2023-04-22 11:27:05 +0300 |
| commit | 10f19c1121068ce3dab9bece03a8b9caaea2db36 (patch) | |
| tree | 669b6ce043021f01ef8ac91a2e81bfb3df1a9b6a /llama.cpp | |
| parent | 7e312f165c5047d6e16680d1eebc83055e95c313 (diff) | |
llama : have n_batch default to 512 (#1091)
* set default n_batch to 512 when using BLAS
* spacing
* alternate implementation of setting different n_batch for BLAS
* set n_batch to 512 for all cases
Diffstat (limited to 'llama.cpp')
0 files changed, 0 insertions, 0 deletions