diff options
| author | unbounded <haakon@likedan.net> | 2023-04-22 11:10:39 +0200 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2023-04-22 12:10:39 +0300 |
| commit | 5f939498d517b4dddbe904f202e895a3ecfb9dc4 (patch) | |
| tree | 010b9312921f4234bda24d3ff10aba86e1d3b6ac /tests/test-tokenizer-0.cpp | |
| parent | 36b4f7e06406eed8a605cc9f2921d9244ef6a8e5 (diff) | |
ggml : unit test for quantization functions (#953)
* Unit test for quantization functions
Use the ggml_internal_get_quantize_fn function to loop through all
quantization formats and run a sanity check on the result.
Also add a microbenchmark that times these functions directly without
running the rest of the GGML graph.
* test-quantize-fns: CI fixes
Fix issues uncovered in CI
- need to use sizes divisible by 32*8 for loop unrolling
- use intrinsic header that should work on Mac
* test-quantize: remove
Per PR comment, subsumed by test-quantize-fns
* test-quantize: fix for q8_0 intermediates
Diffstat (limited to 'tests/test-tokenizer-0.cpp')
0 files changed, 0 insertions, 0 deletions