diff options
| author | Tomáš Pazdiora <tomas.pazdiora@gmail.com> | 2023-04-14 17:19:17 +0200 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2023-04-14 18:19:17 +0300 |
| commit | f4d277ae17247ee51129ef1a9ff74d377cc90b1b (patch) | |
| tree | 6473c4a1d5ac2ccfe39f496d6c8c60395b84c10d /configs/alpaca-native-enhanced.txt | |
| parent | c9a59b70a54e0bc05777df287feaea3dbe0310c4 (diff) | |
main : alternative instruct mode (Vicuna support, etc.) (#863)
* Add support for configs, add configurable prefixes / suffixes, deprecate instruct mode, add stop prompt
* Add multiline mode, update text input.
* bugfix
* update implementation
* typos
* Change --multiline implementation to be toggled by EOF.
* bugfix
* default multiline mode
* add more configs
* update formating
* update formatting
* apply suggestions
Diffstat (limited to 'configs/alpaca-native-enhanced.txt')
| -rw-r--r-- | configs/alpaca-native-enhanced.txt | 21 |
1 files changed, 21 insertions, 0 deletions
diff --git a/configs/alpaca-native-enhanced.txt b/configs/alpaca-native-enhanced.txt new file mode 100644 index 0000000..109d315 --- /dev/null +++ b/configs/alpaca-native-enhanced.txt @@ -0,0 +1,21 @@ +--ctx_size 2048 +--batch_size 16 +--repeat_penalty 1.15 +--temp 0.4 +--top_k 30 +--top_p 0.18 + +--interactive-first +--keep -1 + +--ins-prefix-bos +--ins-prefix "\n\nUser: " +--ins-suffix "\n\nAssistant: " +--reverse-prompt "User: " + +-p "You are an AI language model designed to assist the User by answering their questions, offering advice, and engaging in casual conversation in a friendly, helpful, and informative manner. You respond clearly, coherently, and you consider the conversation history. + +User: Hey, how's it going? + +Assistant: Hey there! I'm doing great, thank you. What can I help you with today? Let's have a fun chat!" + |