diff options
author | Pavol Rusnak <pavol@rusnak.io> | 2023-04-06 08:56:58 +0200 |
---|---|---|
committer | GitHub <noreply@github.com> | 2023-04-06 08:56:58 +0200 |
commit | d2beca95dcfcd6f1145886e914b879ffc3604b7a (patch) | |
tree | 70ecd17c1ab4cd003c01127c6293de8a8256b318 | |
parent | eeaa7b0492fc79baab8bb1fe195d6c87159f2bd3 (diff) |
Make docker instructions more explicit (#785)
-rw-r--r-- | README.md | 8 |
1 files changed, 5 insertions, 3 deletions
@@ -350,20 +350,22 @@ We have two Docker images available for this project: The easiest way to download the models, convert them to ggml and optimize them is with the --all-in-one command which includes the full docker image. +Replace `/path/to/models` below with the actual path where you downloaded the models. + ```bash -docker run -v /llama/models:/models ghcr.io/ggerganov/llama.cpp:full --all-in-one "/models/" 7B +docker run -v /path/to/models:/models ghcr.io/ggerganov/llama.cpp:full --all-in-one "/models/" 7B ``` On complete, you are ready to play! ```bash -docker run -v /llama/models:/models ghcr.io/ggerganov/llama.cpp:full --run -m /models/7B/ggml-model-q4_0.bin -p "Building a website can be done in 10 simple steps:" -n 512 +docker run -v /path/to/models:/models ghcr.io/ggerganov/llama.cpp:full --run -m /models/7B/ggml-model-q4_0.bin -p "Building a website can be done in 10 simple steps:" -n 512 ``` or with light image: ```bash -docker run -v /llama/models:/models ghcr.io/ggerganov/llama.cpp:light -m /models/7B/ggml-model-q4_0.bin -p "Building a website can be done in 10 simple steps:" -n 512 +docker run -v /path/to/models:/models ghcr.io/ggerganov/llama.cpp:light -m /models/7B/ggml-model-q4_0.bin -p "Building a website can be done in 10 simple steps:" -n 512 ``` ### Contributing |