diff options
| author | Bach Le <bach@bullno1.com> | 2023-07-12 00:18:43 +0800 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2023-07-11 19:18:43 +0300 |
| commit | c9c74b4e3f9dcfab8b0032749ff8a579ab4e4d8d (patch) | |
| tree | 651d6915218efa83cad8745310f7d1114ca21e2a /tests/test-quantize-perf.cpp | |
| parent | 3ec7e596b2ba3f43c22f441254ca2bcfa91102ba (diff) | |
llama : add classifier-free guidance (#2135)
* Initial implementation
* Remove debug print
* Restore signature of llama_init_from_gpt_params
* Free guidance context
* Make freeing of guidance_ctx conditional
* Make Classifier-Free Guidance a sampling function
* Correct typo. CFG already means context-free grammar.
* Record sampling time in llama_sample_classifier_free_guidance
* Shift all values by the max value before applying logsoftmax
* Fix styling based on review
Diffstat (limited to 'tests/test-quantize-perf.cpp')
0 files changed, 0 insertions, 0 deletions