diff options
| author | Georgi Gerganov <ggerganov@gmail.com> | 2023-03-11 18:10:18 +0200 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2023-03-11 18:10:18 +0200 |
| commit | 4235e3d5b3f4a0e6844f6291322ebb42181345c9 (patch) | |
| tree | d8c707b21c485d75c3f7c3e54c3e20988c0fdcb1 | |
| parent | f1eaff4721153a5a5094fd1bd8cbdae7a3c079cc (diff) | |
Update README.md
| -rw-r--r-- | README.md | 5 |
1 files changed, 0 insertions, 5 deletions
@@ -6,11 +6,6 @@ Inference of [Facebook's LLaMA](https://github.com/facebookresearch/llama) model Commit [007a8f6f459c6eb56678fdee4c09219ddb85b640](https://github.com/ggerganov/llama.cpp/commit/007a8f6f459c6eb56678fdee4c09219ddb85b640) added support for all LLaMA models, but introduced breaking changes. If you generated any models before that commit, you must regenerate them after updating to latest master. - -**TEMPORARY NOTICE:** -Currently the quantized models run **only** on Apple Silicon. On other architectures, you can [use the F16 models](https://github.com/ggerganov/llama.cpp/issues/2#issuecomment-1464615286), but they will be much slower. Support will be [added later](https://github.com/ggerganov/ggml/pull/27) - - ## Description The main goal is to run the model using 4-bit quantization on a MacBook. |