diff options
| author | Tobias Lütke <tobi@shopify.com> | 2023-07-05 16:51:13 -0400 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2023-07-05 16:51:13 -0400 |
| commit | 31cfbb1013a482e89c72146e2063ac4362becae7 (patch) | |
| tree | b6479860979f90d185a132efe883ae7fb62b07f5 /pocs/vdot/q8dot.cpp | |
| parent | 983b555e9ddb36703cee4d22642afe958de093b7 (diff) | |
Expose generation timings from server & update completions.js (#2116)
* use javascript generators as much cleaner API
Also add ways to access completion as promise and EventSource
* export llama_timings as struct and expose them in server
* update readme, update baked includes
* llama : uniform variable names + struct init
---------
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
Diffstat (limited to 'pocs/vdot/q8dot.cpp')
0 files changed, 0 insertions, 0 deletions