diff options
| author | aditya <bluenerd@protonmail.com> | 2023-08-10 12:32:35 +0530 |
|---|---|---|
| committer | aditya <bluenerd@protonmail.com> | 2023-08-10 12:32:35 +0530 |
| commit | a9ff78b3f48dc9f81943c41531c4959ce7e2ae9d (patch) | |
| tree | 49ee8c3c9148038f04112802265d928ef1aba428 /examples/llama2-13b.sh | |
| parent | 2516af4cd61f509c995b4f78fdf123cba33f3509 (diff) | |
| parent | 916a9acdd0a411426690400ebe2bb7ce840a6bba (diff) | |
resolve merge conflict
Diffstat (limited to 'examples/llama2-13b.sh')
| -rwxr-xr-x | examples/llama2-13b.sh | 18 |
1 files changed, 18 insertions, 0 deletions
diff --git a/examples/llama2-13b.sh b/examples/llama2-13b.sh new file mode 100755 index 0000000..92b3f6d --- /dev/null +++ b/examples/llama2-13b.sh @@ -0,0 +1,18 @@ +#!/bin/bash + +# +# Temporary script - will be removed in the future +# + +cd `dirname $0` +cd .. + +./main -m models/available/Llama2/13B/llama-2-13b.ggmlv3.q4_0.bin \ + --color \ + --ctx_size 2048 \ + -n -1 \ + -ins -b 256 \ + --top_k 10000 \ + --temp 0.2 \ + --repeat_penalty 1.1 \ + -t 8 |