diff options
author | tjohnman <tjohnman@users.noreply.github.com> | 2023-03-22 18:16:35 +0100 |
---|---|---|
committer | GitHub <noreply@github.com> | 2023-03-22 19:16:35 +0200 |
commit | 305ba6f0e6daa3796aad9dd18053a1945dd4cc58 (patch) | |
tree | de8daef4c068615aacbad4ffff1c2350a81deac9 /utils.h | |
parent | 4122dffff958cd137175b58f1f27c0913528d7ba (diff) |
Don't force immediate interactive without `-i` (#354)
* Don't force immediate interactive without -i
Sometimes we might want to use a reverse prompt but we want to let the
model generate tokens right after the initial prompt. So we don't force
user input mode if the -i flag wasn't specified and instead let it run
until we encounter the reverse prompt.
This gives use some more flexibility, since it doesn't force the user to
enter a newline if they want to let the model generate text right after
the initial prompt and only be asked for input if the reverse prompt is
encountered.
The `--interactive-first` flag is reintroduced to force the old
behavior. `-r` behaves like `-i` plus introduces a reverse prompt (it
can be specified more than once).
* Update help output.
---------
Co-authored-by: Johnman <tjohnman@github>
Diffstat (limited to 'utils.h')
-rw-r--r-- | utils.h | 2 |
1 files changed, 1 insertions, 1 deletions
@@ -38,7 +38,7 @@ struct gpt_params { bool random_prompt = false; // do not randomize prompt if none provided bool use_color = false; // use color to distinguish generations and inputs bool interactive = false; // interactive mode - bool interactive_start = false; // reverse prompt immediately + bool interactive_start = false; // wait for user input immediately bool instruct = false; // instruction mode (used for Alpaca models) bool ignore_eos = false; // do not stop generating after eos bool perplexity = false; // compute perplexity over the prompt |