diff options
| author | Georgi Gerganov <ggerganov@gmail.com> | 2023-04-15 17:53:22 +0300 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2023-04-15 17:53:22 +0300 |
| commit | e95b6554b493e71a0275764342e09bd5784a7026 (patch) | |
| tree | 6b9d3e9d4eb23b64ae76f0108b409aa5825cd1b8 /examples/Miku.sh | |
| parent | aa485cee334e84437e21681c14b6f80b65876d8b (diff) | |
ggml : add Q8_0 quantization for intermediate results (#951)
* ggml : add Q8_0 quantization for intermediate results
* quantize-stats : fix test + add it to Makefile default
* Q8: use int8_t, AVX/AVX2 optimizations
* ggml : fix quantize_row_q8_0() ARM_NEON rounding
* minor : updates after rebase to latest master
* quantize-stats : delete obsolete strings
* ggml : fix q4_1 dot func
---------
Co-authored-by: Stephan Walter <stephan@walter.name>
Diffstat (limited to 'examples/Miku.sh')
0 files changed, 0 insertions, 0 deletions