Introduce C-style API (#370)

* Major refactoring - introduce C-style API

* Clean up

* Add <cassert>

* Add <iterator>

* Add <algorithm> ....

* Fix timing reporting and accumulation

* Measure eval time only for single-token calls

* Change llama_tokenize return meaning

1 files changed, 7 insertions, 0 deletions

diff --git a/ggml.h b/ggml.h
index bac4fe6..48b6cc0 100644
--- a/ggml.h
+++ b/ggml.h
@@ -742,6 +742,13 @@ enum ggml_opt_result ggml_opt(
         struct ggml_tensor * f);
 
 //
+// quantization
+//
+
+size_t ggml_quantize_q4_0(float * src, void * dst, int n, int k, int qk, int64_t * hist);
+size_t ggml_quantize_q4_1(float * src, void * dst, int n, int k, int qk, int64_t * hist);
+
+//
 // system info
 //