llama.cpp.git - llama.cpp

Age	Commit message (Collapse)	Author
2023-03-21	Change default repeat_penalty to 1.0	Georgi Gerganov
	I feel this penalty is not really helping. Especially for the example from the README it makes results pretty bad
2023-03-21	Add tokenizer test + revert to C++11 (#355)	Georgi Gerganov
	* Add test-tokenizer-0 to do a few tokenizations - feel free to expand * Added option to convert-pth-to-ggml.py script to dump just the vocabulary * Added ./models/ggml-vocab.bin containing just LLaMA vocab data (used for tests) * Added utility to load vocabulary file from previous point (temporary implementation) * Avoid using std::string_view and drop back to C++11 (hope I didn't break something) * Rename gpt_vocab -> llama_vocab * All CMake binaries go into ./bin/ now
2023-03-20	move file magic/version to header, print expected version (#319)	Mack Straight

2023-03-20	sentencepiece bpe compatible tokenizer (#252)	Mack Straight
	* potential out of bounds read * fix quantize * style * Update convert-pth-to-ggml.py * mild cleanup * don't need the space-prefixing here rn since main.cpp already does it * new file magic + version header field * readme notice * missing newlines Co-authored-by: slaren <2141330+slaren@users.noreply.github.com>
2023-03-19	Support for multiple reverse prompts. (#299)	tjohnman
	Co-authored-by: Johnman <> Co-authored-by: Johnman <tjohnman@github>
2023-03-19	Make prompt randomization optional. (#300)	tjohnman
	Co-authored-by: Johnman <>
2023-03-19	Add --ignore-eos parameter (#181)	slaren
	Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
2023-03-19	Command line switch to use F16 for memory_k and memory_v (refactor of #154) ↵	Erik Scholz
	(#294) * Use F16 for memory_k and memory_v * add command line switch to use f16 instead of f32 for memory k+v --------- Co-authored-by: Ty Everett <ty@tyweb.us>
2023-03-19	Add "--instruct" argument for usage with Alpaca (#240)	Georgi Gerganov
	Also start adding prompts in "./prompts"
2023-03-17	Default to 4 threads (#243)	Georgi Gerganov

2023-03-17	Don't tell users to use a bad number of threads (#243)	Stephan Walter
	The readme tells people to use the command line option "-t 8", causing 8 threads to be started. On systems with fewer than 8 cores, this causes a significant slowdown. Remove the option from the example command lines and use /proc/cpuinfo on Linux to determine a sensible default.
2023-03-15	added ctx_size parameter (#148)	Justin Suess
	* added ctx_size parameter * added it in more places * Apply suggestions from code review --------- Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
2023-03-12	Add interactive mode (#61)	Matvey Soloviev
	* Initial work on interactive mode. * Improve interactive mode. Make rev. prompt optional. * Update README to explain interactive mode. * Fix OS X build
2023-03-12	Add back top_k (#56)	beiller
	* Add back top_k * Update utils.cpp * Update utils.h --------- Co-authored-by: Bill Hamilton <bill.hamilton@shopify.com> Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
2023-03-12	Add repetition penalty (#20)	beiller
	* Adding repeat penalization * Update utils.h * Update utils.cpp * Numeric fix Should probably still scale by temp even if penalized * Update comments, more proper application I see that numbers can go negative so a fix from a referenced commit * Minor formatting --------- Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
2023-03-10	Fix a bug in the rope calculation	Georgi Gerganov

2023-03-10	Final touches	Georgi Gerganov

2023-03-10	Initial release	Georgi Gerganov