diff options
author | Georgi Gerganov <ggerganov@gmail.com> | 2023-03-21 18:09:37 +0200 |
---|---|---|
committer | Georgi Gerganov <ggerganov@gmail.com> | 2023-03-21 18:09:46 +0200 |
commit | dc6a845b8573cd7d06c6b295241d26f311602a1f (patch) | |
tree | f70c2cf591864b9b73d1736ed0087a628921c6ee | |
parent | 6a612959e1b6c37b68b6b141329751a2902b1030 (diff) |
Add chat.sh script
-rw-r--r-- | README.md | 5 | ||||
-rwxr-xr-x | chat.sh | 6 |
2 files changed, 10 insertions, 1 deletions
@@ -179,8 +179,11 @@ In this mode, you can always interrupt generation by pressing Ctrl+C and enter o Here is an example few-shot interaction, invoked with the command ``` -./main -m ./models/13B/ggml-model-q4_0.bin -n 256 --repeat_penalty 1.0 --color -i -r "User:" -f prompts/chat-with-bob.txt +# default arguments using 7B model +./chat.sh +# custom arguments using 13B model +./main -m ./models/13B/ggml-model-q4_0.bin -n 256 --repeat_penalty 1.0 --color -i -r "User:" -f prompts/chat-with-bob.txt ``` Note the use of `--color` to distinguish between user input and generated text. @@ -0,0 +1,6 @@ +#!/bin/bash +# +# Temporary script - will be removed in the future +# + +./main -m ./models/7B/ggml-model-q4_0.bin -n 256 --repeat_penalty 1.0 --color -i -r "User:" -f prompts/chat-with-bob.txt |