aboutsummaryrefslogtreecommitdiff
path: root/examples/gpt4all.sh
diff options
context:
space:
mode:
authorKerfuffle <44031344+KerfuffleV2@users.noreply.github.com>2023-05-28 11:48:57 -0600
committerGitHub <noreply@github.com>2023-05-28 11:48:57 -0600
commit1b78ed20818b72306edc7208b9bfb69a1a0d3297 (patch)
tree8c72e202378906da0cf7559755356e16f22d27c0 /examples/gpt4all.sh
parent337aea11390221bc925e4acb1f603f1649af2735 (diff)
Only show -ngl option when relevant + other doc/arg handling updates (#1625)
1. Add a `LLAMA_SUPPORTS_GPU_OFFLOAD` define to `llama.h` (defined when compiled with CLBlast or cuBLAS) 2. Update the argument handling in the common example code to only show the `-ngl`, `--n-gpu-layers` option when GPU offload is possible. 3. Add an entry for the `-ngl`, `--n-gpu-layers` option to the `main` and `server` examples documentation 4. Update `main` and `server` examples documentation to use the new style dash separator argument format 5. Update the `server` example to use dash separators for its arguments and adds `-ngl` to `--help` (only shown when compiled with appropriate support). It will still support `--memory_f32` and `--ctx_size` for compatibility. 6. Add a warning discouraging use of `--memory-f32` for the `main` and `server` examples `--help` text as well as documentation. Rationale: https://github.com/ggerganov/llama.cpp/discussions/1593#discussioncomment-6004356
Diffstat (limited to 'examples/gpt4all.sh')
0 files changed, 0 insertions, 0 deletions