diff options
| -rw-r--r-- | README.md | 7 | ||||
| -rwxr-xr-x | examples/alpaca.sh (renamed from alpaca.sh) | 4 | ||||
| -rwxr-xr-x | examples/chat-13B.sh (renamed from examples/chatLLaMa) | 0 | ||||
| -rwxr-xr-x | examples/chat.sh (renamed from chat.sh) | 4 |
4 files changed, 13 insertions, 2 deletions
@@ -179,7 +179,10 @@ Here is an example few-shot interaction, invoked with the command ```bash # default arguments using 7B model -./chat.sh +./examples/chat.sh + +# advanced chat with 13B model +./examples/chat-13B.sh # custom arguments using 13B model ./main -m ./models/13B/ggml-model-q4_0.bin -n 256 --repeat_penalty 1.0 --color -i -r "User:" -f prompts/chat-with-bob.txt @@ -195,7 +198,7 @@ Note the use of `--color` to distinguish between user input and generated text. 2. Run the `main` tool like this: ``` -./main -m ./models/ggml-alpaca-7b-q4.bin --color -f ./prompts/alpaca.txt -ins +./examples/alpaca.sh ``` Sample run: diff --git a/alpaca.sh b/examples/alpaca.sh index d8a9f45..4c9aa50 100755 --- a/alpaca.sh +++ b/examples/alpaca.sh @@ -1,6 +1,10 @@ #!/bin/bash + # # Temporary script - will be removed in the future # +cd `dirname $0` +cd .. + ./main -m ./models/ggml-alpaca-7b-q4.bin --color -f ./prompts/alpaca.txt -ins -b 256 --top_k 10000 --temp 0.2 --repeat_penalty 1 -t 7 diff --git a/examples/chatLLaMa b/examples/chat-13B.sh index 4265d7b..4265d7b 100755 --- a/examples/chatLLaMa +++ b/examples/chat-13B.sh diff --git a/chat.sh b/examples/chat.sh index 5531315..2b6a63e 100755 --- a/chat.sh +++ b/examples/chat.sh @@ -1,6 +1,10 @@ #!/bin/bash + # # Temporary script - will be removed in the future # +cd `dirname $0` +cd .. + ./main -m ./models/7B/ggml-model-q4_0.bin -b 128 -n 256 --repeat_penalty 1.0 --color -i -r "User:" -f prompts/chat-with-bob.txt |