diff options
| author | Georgi Gerganov <ggerganov@gmail.com> | 2023-06-15 20:29:48 +0300 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2023-06-15 20:29:48 +0300 |
| commit | 4bfcc855abdb2c9fcc3c5a84747974521909fa41 (patch) | |
| tree | bac5ee7eed2be4fabbfda2fb7bdd7d1e0917b10f /ggml-metal.h | |
| parent | 6b8312e7979b852f6b6ac9d29cd51fda16c17948 (diff) | |
metal : parallel command buffer encoding (#1860)
* metal : parallel command buffer encoding
* metal : determine number of command buffers based on gf->n_threads
Diffstat (limited to 'ggml-metal.h')
| -rw-r--r-- | ggml-metal.h | 1 |
1 files changed, 1 insertions, 0 deletions
diff --git a/ggml-metal.h b/ggml-metal.h index a9441a9..033c4d8 100644 --- a/ggml-metal.h +++ b/ggml-metal.h @@ -55,6 +55,7 @@ void ggml_metal_set_tensor(struct ggml_metal_context * ctx, struct ggml_tensor * void ggml_metal_get_tensor(struct ggml_metal_context * ctx, struct ggml_tensor * t); // same as ggml_graph_compute but uses Metal +// creates gf->n_threads command buffers in parallel void ggml_metal_graph_compute(struct ggml_metal_context * ctx, struct ggml_cgraph * gf); #ifdef __cplusplus |