diff options
author | Gary Linscott <glinscott@gmail.com> | 2023-03-21 09:27:42 -0700 |
---|---|---|
committer | GitHub <noreply@github.com> | 2023-03-21 18:27:42 +0200 |
commit | 486ae645fd3eda8b9d7413d5ff34fb65a3e337fb (patch) | |
tree | cf16e8b85548c48a781046d36e3d5b87d802f38a /.github | |
parent | 3ab3e6582f7320c2b6568c892fdfc8215caf7e6c (diff) |
Compute perplexity over prompt (#270)
* Compute perplexity over prompt
* More accurate perplexity calculation - over all logits in the context window (so 512x more tokens!)
* Output all perplexitiies
* Add timing/ETA
Diffstat (limited to '.github')
0 files changed, 0 insertions, 0 deletions