diff options
author | slaren <slarengh@gmail.com> | 2023-07-24 17:57:12 +0200 |
---|---|---|
committer | GitHub <noreply@github.com> | 2023-07-24 17:57:12 +0200 |
commit | 41c674161fb2459bdf7806d1eebead15bc5d046e (patch) | |
tree | 0a211224c924a579287762cc7492fe1c9fcf3509 /ggml-metal.m | |
parent | b3f138d05849ccbce67303ac17b50ebbc268128a (diff) |
make rms_norm_eps a parameter (#2374)
* make rms_norm_eps a parameter
* add rms_norm_eps to command line
* fix baby llama, test-grad0
* use scientific notation for eps param in the help
ggml-ci
Diffstat (limited to 'ggml-metal.m')
-rw-r--r-- | ggml-metal.m | 3 |
1 files changed, 2 insertions, 1 deletions
diff --git a/ggml-metal.m b/ggml-metal.m index 1fd6e85..c1db3d1 100644 --- a/ggml-metal.m +++ b/ggml-metal.m @@ -812,7 +812,8 @@ void ggml_metal_graph_compute( encoder = [command_buffer computeCommandEncoder]; } - const float eps = 1e-6f; + float eps; + memcpy(&eps, dst->op_params, sizeof(float)); const int nth = 512; |