diff options
| author | Jose Maldonado <63384398+yukiteruamano@users.noreply.github.com> | 2023-07-21 06:53:27 -0400 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2023-07-21 13:53:27 +0300 |
| commit | 73643f5fb1136dc2b65ae910bdc5a431520d70a2 (patch) | |
| tree | 6ce452a7b36dbff208231c9671e13df6769be60d /examples | |
| parent | a814d04f81121e0429b39a61fe4afd946cd42046 (diff) | |
gitignore : changes for Poetry users + chat examples (#2284)
A fix in Makefile for FreeBSD users. In the platfrom x86_64 is amd64. This fix resolve compilation using CFLAGS and CXXFLAGS with -march=native and -mtune=native
Add two examples for interactive mode using Llama2 models (thx TheBloke for models)
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
Diffstat (limited to 'examples')
| -rwxr-xr-x | examples/llama2-13b.sh | 18 | ||||
| -rwxr-xr-x | examples/llama2.sh | 18 |
2 files changed, 36 insertions, 0 deletions
diff --git a/examples/llama2-13b.sh b/examples/llama2-13b.sh new file mode 100755 index 0000000..92b3f6d --- /dev/null +++ b/examples/llama2-13b.sh @@ -0,0 +1,18 @@ +#!/bin/bash + +# +# Temporary script - will be removed in the future +# + +cd `dirname $0` +cd .. + +./main -m models/available/Llama2/13B/llama-2-13b.ggmlv3.q4_0.bin \ + --color \ + --ctx_size 2048 \ + -n -1 \ + -ins -b 256 \ + --top_k 10000 \ + --temp 0.2 \ + --repeat_penalty 1.1 \ + -t 8 diff --git a/examples/llama2.sh b/examples/llama2.sh new file mode 100755 index 0000000..221b375 --- /dev/null +++ b/examples/llama2.sh @@ -0,0 +1,18 @@ +#!/bin/bash + +# +# Temporary script - will be removed in the future +# + +cd `dirname $0` +cd .. + +./main -m models/available/Llama2/7B/llama-2-7b.ggmlv3.q4_0.bin \ + --color \ + --ctx_size 2048 \ + -n -1 \ + -ins -b 256 \ + --top_k 10000 \ + --temp 0.2 \ + --repeat_penalty 1.1 \ + -t 8 |