From f5bfea0580e417f99850d5456ca541d871a3e48c Mon Sep 17 00:00:00 2001 From: Martin Krasser Date: Tue, 8 Aug 2023 15:29:19 +0200 Subject: Allow passing grammar to completion endpoint (#2532) * Allow passing grammar to completion endpoint --- examples/server/README.md | 2 ++ 1 file changed, 2 insertions(+) (limited to 'examples/server/README.md') diff --git a/examples/server/README.md b/examples/server/README.md index aee31ae..e56ca06 100644 --- a/examples/server/README.md +++ b/examples/server/README.md @@ -151,6 +151,8 @@ node . `mirostat_eta`: Set the Mirostat learning rate, parameter eta (default: 0.1). + `grammar`: Set grammar for grammar-based sampling (default: no grammar) + `seed`: Set the random number generator (RNG) seed (default: -1, -1 = random seed). `ignore_eos`: Ignore end of stream token and continue generating (default: false). -- cgit v1.2.3