diff options
| author | Mack Straight <eiz@users.noreply.github.com> | 2023-03-20 03:17:23 -0700 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2023-03-20 03:17:23 -0700 |
| commit | 074bea2eb1f1349a0118239c4152914aecaa1be4 (patch) | |
| tree | 41ce911ac28d858cabfeff650b10521b30838656 /Makefile | |
| parent | 5cb63e2493c49bc2c3b9b355696e8dc26cdd0380 (diff) | |
sentencepiece bpe compatible tokenizer (#252)
* potential out of bounds read
* fix quantize
* style
* Update convert-pth-to-ggml.py
* mild cleanup
* don't need the space-prefixing here rn since main.cpp already does it
* new file magic + version header field
* readme notice
* missing newlines
Co-authored-by: slaren <2141330+slaren@users.noreply.github.com>
Diffstat (limited to 'Makefile')
| -rw-r--r-- | Makefile | 2 |
1 files changed, 1 insertions, 1 deletions
@@ -31,7 +31,7 @@ endif # CFLAGS = -I. -O3 -DNDEBUG -std=c11 -fPIC -CXXFLAGS = -I. -I./examples -O3 -DNDEBUG -std=c++11 -fPIC +CXXFLAGS = -I. -I./examples -O3 -DNDEBUG -std=c++17 -fPIC LDFLAGS = # OS specific |