aboutsummaryrefslogtreecommitdiff
path: root/examples/train-text-from-scratch
diff options
context:
space:
mode:
authorzrm <trustiosity.zrm@gmail.com>2023-06-26 13:57:59 -0400
committerGitHub <noreply@github.com>2023-06-26 20:57:59 +0300
commitb853d456018b10820686362af41b2f2f75f1eec6 (patch)
tree264e68c8555d8509a5ac27f01eed5e6c69940174 /examples/train-text-from-scratch
parent9225baef71407d799a6f7f563b77fd7f82791416 (diff)
ggml : add NUMA support (#1556)
* detect NUMA systems and pin work threads to nodes (linux) * disable mmap prefetch/readahead for NUMA systems * avoid sending finalize op to thread pool if it does nothing * silence robot * fix args * make --numa a param * recommendation that n_nodes evenly divide n_threads did not warrant such aggressive enforcement * lower synchronization overhead * statically allocate * move numa state to g_state * add description for --numa * ggml : minor style changes * ggml : minor style + try fix sanitizer build * llama : allow to initialize backend with NUMA support * llama : avoid ggml include in llama-util.h * ggml : style / formatting * ggml : fix handling of ops with n_threads > n_tasks > 1 * server : utilize numa parameter --------- Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
Diffstat (limited to 'examples/train-text-from-scratch')
0 files changed, 0 insertions, 0 deletions