diff options
| author | Ivan Stepanov <ivanstepanovftw@gmail.com> | 2023-04-29 08:34:41 +0300 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2023-04-29 08:34:41 +0300 |
| commit | dd7eff57d8491792010b1002b8de6a4b54912e5c (patch) | |
| tree | ed7f7c85ef220cafca40976b52bfeac948b3c673 /examples/reason-act.sh | |
| parent | 7fc50c051ae8a78e9643fdf172d12e20f2dd9b6c (diff) | |
llama : new sampling algorithms (#1126)
* Sample interface, new samplers.
New samplers:
- locally typical sampling
- tail free sampling
- frequency and presence penalty
- mirostat
Ignore EOS fix: -inf should be used.
* mirostat
* Added --logit-bias and --no-penalize-nl, removed std::span
* Use C++11, clarify llama API documentation, rename Mirostat parameters to --mirostat_lr and --mirostat_ent, add temperature sampling for Mirostat, simplify Mirostat sampling API parameters (removed N and *k)
Use C++11, clarify llama API documentation, rename Mirostat parameters to --mirostat_lr and --mirostat_ent, add temperature sampling for Mirostat, simplify Mirostat sampling API parameters (removed N and *k)
* Save and load example adjust
* Tests
* Windows build fix
* Windows test fix
Diffstat (limited to 'examples/reason-act.sh')
0 files changed, 0 insertions, 0 deletions