diff options
| author | Evan Jones <evan.q.jones@gmail.com> | 2023-05-02 22:26:13 -0400 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2023-05-02 22:26:13 -0400 |
| commit | e216aa04633892b972d013719e38b59fd4917341 (patch) | |
| tree | 53ffbc32f976fb799dd679204fa7e15f887f9e6b /models | |
| parent | 2485d7a4d39406cd0f468e35551b472cceb5bd61 (diff) | |
llama : only copy used KV cache in get / set state (#1272)
* llama : only copy used KV cache in get / set state
* switch to ggml for copying k, v
* avoid designated initializers
Diffstat (limited to 'models')
0 files changed, 0 insertions, 0 deletions