diff options
| author | Stephan Walter <stephan@walter.name> | 2023-03-17 17:47:35 +0000 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2023-03-17 19:47:35 +0200 |
| commit | 367946c668757532deed929e1d78673c6ac6bcb8 (patch) | |
| tree | 55245c6c86103db1777b3dcd0831dbd72184a3c2 /.devops | |
| parent | 6b0df5ccf360fe5c015f6607f0375bfc6849005e (diff) | |
Don't tell users to use a bad number of threads (#243)
The readme tells people to use the command line option "-t 8", causing 8
threads to be started. On systems with fewer than 8 cores, this causes a
significant slowdown. Remove the option from the example command lines
and use /proc/cpuinfo on Linux to determine a sensible default.
Diffstat (limited to '.devops')
| -rwxr-xr-x | .devops/tools.sh | 2 |
1 files changed, 1 insertions, 1 deletions
diff --git a/.devops/tools.sh b/.devops/tools.sh index b5711c9..352e049 100755 --- a/.devops/tools.sh +++ b/.devops/tools.sh @@ -34,7 +34,7 @@ else echo "Unknown command: $arg1" echo "Available commands: " echo " --run (-r): Run a model previously converted into ggml" - echo " ex: -m /models/7B/ggml-model-q4_0.bin -p \"Building a website can be done in 10 simple steps:\" -t 8 -n 512" + echo " ex: -m /models/7B/ggml-model-q4_0.bin -p \"Building a website can be done in 10 simple steps:\" -n 512" echo " --convert (-c): Convert a llama model into ggml" echo " ex: \"/models/7B/\" 1" echo " --quantize (-q): Optimize with quantization process ggml" |