diff options
| author | Georgi Gerganov <ggerganov@gmail.com> | 2023-03-11 01:18:10 +0200 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2023-03-11 01:18:10 +0200 |
| commit | 6da2df34ee40301d9ecb126968ec4c0c6195f26d (patch) | |
| tree | ec901157e33fe408fc4f2e7b8f97aad33093dfb2 | |
| parent | 9dcf4dba459ba6482a7a5aced22645a387ec6991 (diff) | |
Update README.md
| -rw-r--r-- | README.md | 2 |
1 files changed, 1 insertions, 1 deletions
@@ -139,5 +139,5 @@ python3 convert-pth-to-ggml.py models/7B/ 1 In general, it seems to work, but I think it fails for unicode character support. Hopefully, someone can help with that - I don't know yet how much the quantization affects the quality of the generated text - Probably the token sampling can be improved -- x86 quantization support [not yet ready](https://github.com/ggerganov/ggml/pull/27). Basically, you want to run this on Apple Silicon +- x86 quantization support [not yet ready](https://github.com/ggerganov/ggml/pull/27). Basically, you want to run this on Apple Silicon. For now, on Linux and Windows you can use the F16 `ggml-model-f16.bin` model, but it will be much slower. |