diff options
| author | Kawrakow <48489457+ikawrakow@users.noreply.github.com> | 2023-07-25 18:35:53 +0300 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2023-07-25 18:35:53 +0300 |
| commit | eb542d39324574a6778fad9ba9e34ba7a14a82a3 (patch) | |
| tree | 3009fde3ceb24f19dfbb2da7c072942ba06eaa83 /llama.h | |
| parent | 07aaa0f63fccaeab099b3a732abda20b921bc5a5 (diff) | |
Add LLAMA_DEFAULT_RMS_EPS so we can change the default (#2384)
Co-authored-by: Iwan Kawrakow <iwan.kawrakow@gmail.com>
Diffstat (limited to 'llama.h')
| -rw-r--r-- | llama.h | 4 |
1 files changed, 4 insertions, 0 deletions
@@ -53,6 +53,10 @@ #define LLAMA_SUPPORTS_GPU_OFFLOAD #endif +#ifndef LLAMA_DEFAULT_RMS_EPS +#define LLAMA_DEFAULT_RMS_EPS 5e-6f +#endif + #ifdef __cplusplus extern "C" { #endif |