aboutsummaryrefslogtreecommitdiff
path: root/models
diff options
context:
space:
mode:
authorEvan Jones <evan.q.jones@gmail.com>2023-05-02 22:26:13 -0400
committerGitHub <noreply@github.com>2023-05-02 22:26:13 -0400
commite216aa04633892b972d013719e38b59fd4917341 (patch)
tree53ffbc32f976fb799dd679204fa7e15f887f9e6b /models
parent2485d7a4d39406cd0f468e35551b472cceb5bd61 (diff)
llama : only copy used KV cache in get / set state (#1272)
* llama : only copy used KV cache in get / set state * switch to ggml for copying k, v * avoid designated initializers
Diffstat (limited to 'models')
0 files changed, 0 insertions, 0 deletions