diff options
| author | Georgi Gerganov <ggerganov@gmail.com> | 2023-03-24 23:17:58 +0200 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2023-03-24 23:17:58 +0200 |
| commit | 04c6f5ed6fafd63601fa06757877ed5ccf9d5991 (patch) | |
| tree | 1a730c214eae193ef234a4dd59cc543174f5bf2b /alpaca.sh | |
| parent | 7a9b6c3a8bdc1cb75fefc826dfaa7331eb63695d (diff) | |
Immediately start processing the prompt before user input has been provided (#476)
Diffstat (limited to 'alpaca.sh')
| -rwxr-xr-x | alpaca.sh | 2 |
1 files changed, 1 insertions, 1 deletions
@@ -3,4 +3,4 @@ # Temporary script - will be removed in the future # -./main -m ./models/ggml-alpaca-7b-q4.bin --color -f ./prompts/alpaca.txt -ins --top_k 10000 --temp 0.2 --repeat_penalty 1 -t 7 +./main -m ./models/ggml-alpaca-7b-q4.bin --color -f ./prompts/alpaca.txt -ins -b 256 --top_k 10000 --temp 0.2 --repeat_penalty 1 -t 7 |