aboutsummaryrefslogtreecommitdiff
path: root/examples/server
AgeCommit message (Expand)Author
2023-07-04Add an API example using server.cpp similar to OAI. (#2009)jwj7140
2023-07-04Simple webchat for server (#1998)Tobias Lütke
2023-07-04fix server crashes (#2076)Henri Vasserman
2023-07-03server: add option to output probabilities for completion (#1962)WangHaoranRobin
2023-06-29Use unsigned for random seed (#2006)Howard Su
2023-06-26ggml : add NUMA support (#1556)zrm
2023-06-25fix server sampling: top k sampler first (#1977)anon998
2023-06-24llama : make model stateless and context stateful (llama_state) (#1797)Didzis Gosko
2023-06-20[Fix] Reenable server embedding endpoint (#1937)Henri Vasserman
2023-06-17Server Example Refactor and Improvements (#1570)Randall Fitzgerald
2023-06-15readme : server compile flag (#1874)Srinivas Billa
2023-06-14CUDA full GPU acceleration, KV cache in VRAM (#1827)Johannes Gäßler
2023-06-06Multi GPU support, CUDA refactor, CUDA scratch buffer (#1703)Johannes Gäßler
2023-05-28Only show -ngl option when relevant + other doc/arg handling updates (#1625)Kerfuffle
2023-05-28examples : add --alias option to gpt_params to set use friendly model name (#...Vladimir Zorin
2023-05-27Include server in releases + other build system cleanups (#1610)Kerfuffle
2023-05-21examples : add server example with REST API (#1443)Steward Garcia