diff options
| author | Clint Herron <hanclinto@gmail.com> | 2023-04-22 02:54:33 -0400 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2023-04-22 09:54:33 +0300 |
| commit | e9a9cb0c54461ffbda75b7b2f99f3ea5562291c2 (patch) | |
| tree | 8dab01decfe5a05d8aa94f5ca21063f0d3128c31 /examples/alpaca.sh | |
| parent | b6e7f9b09e9c340ec97a2fae61c1eb8db861f2f9 (diff) | |
examples : Improve Alpaca Default Repeat Penalty: Better Match Alpaca.cpp Experience (#1107)
* Moving parameters to separate lines for readability.
* Increasing repeate_penalty to 1.1 to make alpaca more usable by default.
* Adding trailing newline.
Diffstat (limited to 'examples/alpaca.sh')
| -rwxr-xr-x | examples/alpaca.sh | 11 |
1 files changed, 10 insertions, 1 deletions
diff --git a/examples/alpaca.sh b/examples/alpaca.sh index 8d62617..aef207f 100755 --- a/examples/alpaca.sh +++ b/examples/alpaca.sh @@ -7,4 +7,13 @@ cd `dirname $0` cd .. -./main -m ./models/ggml-alpaca-7b-q4.bin --color -f ./prompts/alpaca.txt --ctx_size 2048 -n -1 -ins -b 256 --top_k 10000 --temp 0.2 --repeat_penalty 1 -t 7 +./main -m ./models/ggml-alpaca-7b-q4.bin \ + --color \ + -f ./prompts/alpaca.txt \ + --ctx_size 2048 \ + -n -1 \ + -ins -b 256 \ + --top_k 10000 \ + --temp 0.2 \ + --repeat_penalty 1.1 \ + -t 7 |