diff options
| author | SIGSEGV <21287366+akr2002@users.noreply.github.com> | 2023-07-11 21:39:48 +0530 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2023-07-11 21:39:48 +0530 |
| commit | 7f75f68795e0a84c06cc790c17e8e471ca6f00f9 (patch) | |
| tree | 392dab7137dc44f612b3f0c17b2329cf4c829bbe /examples/server/README.md | |
| parent | c1f29d1bb1d9f3084c9dc177fe9bf9269b9e35af (diff) | |
| parent | 917831c63a4138814d23da1917bf2b5d5b9faa6c (diff) | |
Merge branch 'ggerganov:master' into master
Diffstat (limited to 'examples/server/README.md')
| -rw-r--r-- | examples/server/README.md | 2 |
1 files changed, 1 insertions, 1 deletions
diff --git a/examples/server/README.md b/examples/server/README.md index ad9b6bb..3691abd 100644 --- a/examples/server/README.md +++ b/examples/server/README.md @@ -16,7 +16,7 @@ Command line options: - `--memory-f32`: Use 32-bit floats instead of 16-bit floats for memory key+value. Not recommended. - `--mlock`: Lock the model in memory, preventing it from being swapped out when memory-mapped. - `--no-mmap`: Do not memory-map the model. By default, models are mapped into memory, which allows the system to load only the necessary parts of the model as needed. -- `--lora FNAME`: Apply a LoRA (Low-Rank Adaptation) adapter to the model (implies --no-mmap). This allows you to adapt the pretrained model to specific tasks or domains. +- `--lora FNAME`: Apply a LoRA (Low-Rank Adaptation) adapter to the model. This allows you to adapt the pretrained model to specific tasks or domains. - `--lora-base FNAME`: Optional model to use as a base for the layers modified by the LoRA adapter. This flag is used in conjunction with the `--lora` flag, and specifies the base model for the adaptation. - `-to N`, `--timeout N`: Server read/write timeout in seconds. Default `600`. - `--host`: Set the hostname or ip address to listen. Default `127.0.0.1`. |