diff options
| author | Xiao-Yong Jin <jinxiaoyong@gmail.com> | 2023-07-25 07:19:11 -0500 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2023-07-25 15:19:11 +0300 |
| commit | 0c06204fb39aa5560e883e0ae74be9518c57d88e (patch) | |
| tree | b2b218adf5dfe353d744d8b46d9f20f7c40d66a6 /examples/embd-input/embd_input.py | |
| parent | 1fed755b1fb9babb6dbc1b4023e492950cd5a5be (diff) | |
main : add `--in-prefix-bos` to prefix BOS to user inputs; keep EOS (#2304)
* add `--in-prefix-bos` to prefix BOS to user inputs; keep EOS
The BOS precedes the string specified by `--in-prefix`.
Model generated EOS is now kept in the context.
It provides a way to strictly following the prompt format used in
Llama-2-chat.
The EOS handling also benefits some existing finetunes that uses
EOS to mark the end of turn.
* examples/common: move input_prefix_bos to other bools
Diffstat (limited to 'examples/embd-input/embd_input.py')
0 files changed, 0 insertions, 0 deletions