diff options
| author | Martin Krasser <krasserm@googlemail.com> | 2023-08-08 15:29:19 +0200 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2023-08-08 16:29:19 +0300 |
| commit | f5bfea0580e417f99850d5456ca541d871a3e48c (patch) | |
| tree | 16a12f6014ce32f7597807997dd527d0679df3db /examples/server/README.md | |
| parent | acfc5478ff3446ca3b54553967a3dea09b7c771a (diff) | |
Allow passing grammar to completion endpoint (#2532)
* Allow passing grammar to completion endpoint
Diffstat (limited to 'examples/server/README.md')
| -rw-r--r-- | examples/server/README.md | 2 |
1 files changed, 2 insertions, 0 deletions
diff --git a/examples/server/README.md b/examples/server/README.md index aee31ae..e56ca06 100644 --- a/examples/server/README.md +++ b/examples/server/README.md @@ -151,6 +151,8 @@ node . `mirostat_eta`: Set the Mirostat learning rate, parameter eta (default: 0.1). + `grammar`: Set grammar for grammar-based sampling (default: no grammar) + `seed`: Set the random number generator (RNG) seed (default: -1, -1 = random seed). `ignore_eos`: Ignore end of stream token and continue generating (default: false). |