aboutsummaryrefslogtreecommitdiff
diff options
context:
space:
mode:
authorPavol Rusnak <pavol@rusnak.io>2023-03-18 21:58:46 +0100
committerPavol Rusnak <pavol@rusnak.io>2023-03-18 22:25:35 +0100
commit554b54152145c30618bac171efb712cf4a7d1e96 (patch)
tree43ff0b690449a3275ad99c9475de715918d94ad0
parentd3f202d57b694376cef6f381a6b6901825c3f6d9 (diff)
Add memory/disk requirements to readme
-rw-r--r--README.md12
1 files changed, 11 insertions, 1 deletions
diff --git a/README.md b/README.md
index 808d54e..fc8b2fd 100644
--- a/README.md
+++ b/README.md
@@ -155,7 +155,17 @@ python3 convert-pth-to-ggml.py models/7B/ 1
When running the larger models, make sure you have enough disk space to store all the intermediate files.
-TODO: add model disk/mem requirements
+### Memory/Disk Requirements
+
+As the models are currently fully loaded into memory, you will need adequate disk space to save them
+and sufficient RAM to load them. At the moment, memory and disk requirements are the same.
+
+| model | original size | quantized size (4-bit) |
+|-------|---------------|------------------------|
+| 7B | 13 GB | 3.9 GB |
+| 15B | 24 GB | 7.8 GB |
+| 30B | 60 GB | 19.5 GB |
+| 65B | 120 GB | 38.5 GB |
### Interactive mode