aboutsummaryrefslogtreecommitdiff
diff options
context:
space:
mode:
authorGeorgi Gerganov <ggerganov@gmail.com>2023-03-21 18:09:37 +0200
committerGeorgi Gerganov <ggerganov@gmail.com>2023-03-21 18:09:46 +0200
commitdc6a845b8573cd7d06c6b295241d26f311602a1f (patch)
treef70c2cf591864b9b73d1736ed0087a628921c6ee
parent6a612959e1b6c37b68b6b141329751a2902b1030 (diff)
Add chat.sh script
-rw-r--r--README.md5
-rwxr-xr-xchat.sh6
2 files changed, 10 insertions, 1 deletions
diff --git a/README.md b/README.md
index f0b0c2a..62cf82d 100644
--- a/README.md
+++ b/README.md
@@ -179,8 +179,11 @@ In this mode, you can always interrupt generation by pressing Ctrl+C and enter o
Here is an example few-shot interaction, invoked with the command
```
-./main -m ./models/13B/ggml-model-q4_0.bin -n 256 --repeat_penalty 1.0 --color -i -r "User:" -f prompts/chat-with-bob.txt
+# default arguments using 7B model
+./chat.sh
+# custom arguments using 13B model
+./main -m ./models/13B/ggml-model-q4_0.bin -n 256 --repeat_penalty 1.0 --color -i -r "User:" -f prompts/chat-with-bob.txt
```
Note the use of `--color` to distinguish between user input and generated text.
diff --git a/chat.sh b/chat.sh
new file mode 100755
index 0000000..24a0f10
--- /dev/null
+++ b/chat.sh
@@ -0,0 +1,6 @@
+#!/bin/bash
+#
+# Temporary script - will be removed in the future
+#
+
+./main -m ./models/7B/ggml-model-q4_0.bin -n 256 --repeat_penalty 1.0 --color -i -r "User:" -f prompts/chat-with-bob.txt