llama.cpp.git - llama.cpp

Age	Commit message (Expand)	Author
2023-07-31	CUDA: mmq CLI option, fixed mmq build issues (#2453)	Johannes Gäßler
2023-07-31	Fix Metal backend broken from the allocator changes (#2455)	slaren
2023-07-30	ggml : add graph tensor allocator (#2411)	slaren
2023-07-28	llama : support more diverse tokenizers? (#2420)	eric8607242
2023-07-28	llama : use n_embd_gqa instead of n_embd to handle llama-2 70B (#2433)	Rand Xie
2023-07-27	metal : disable graph concurrency optimization due to bug (#2413)	Georgi Gerganov
2023-07-26	ggml : allocate graphs in a context (#2392)	slaren
2023-07-25	Add LLAMA_DEFAULT_RMS_EPS so we can change the default (#2384)	Kawrakow
2023-07-25	ggml : improve graph build time via hash table lookup (#2329)	slaren
2023-07-25	metal : concurrently dispatch commands (#2358)	Shouzheng Liu
2023-07-24	make rms_norm_eps a parameter (#2374)	slaren
2023-07-23	llama : add grammar-based sampling (#1773)	Evan Jones
2023-07-23	llama : grouped-query attention + LLaMAv2 70B support (#2276)	Georgi Gerganov
2023-07-23	llama : print max tensor size to stderr (#2336)	Christian Demsar
2023-07-22	llama : optimize memory buffers (#2325)	Georgi Gerganov
2023-07-21	ggml : fix rope args order + assert (#2054)	Georgi Gerganov
2023-07-21	llama : remove cfg smooth factor as it is only a reparameterization of the gu...	Guillaume "Vermeille" Sanchez
2023-07-21	llama : make tensor_split ptr instead of array (#2272)	Georgi Gerganov
2023-07-20	llama : fix regression from #2000 - could not load no-mmap models	Georgi Gerganov
2023-07-19	llama : extend API to get max devices at runtime (#2253)	Rinne
2023-07-18	ci : integrate with ggml-org/ci (#2250)	Georgi Gerganov
2023-07-17	llama : fix t_start_sample_us initialization warning (#2238)	Alex Klinkhamer
2023-07-15	llama : add custom RoPE (#2054)	Xiao-Yong Jin
2023-07-14	llama : add functions that work directly on model (#2197)	Bach Le
2023-07-11	llama : add classifier-free guidance (#2135)	Bach Le
2023-07-11	Possible solution to allow K-quants on models with n_vocab!=32000 (#2148)	LostRuins
2023-07-10	mpi : add support for distributed inference via MPI (#2099)	Evan Miller
2023-07-09	llama : remove "first token must be BOS" restriction (#2153)	oobabooga
2023-07-07	ggml : change ggml_graph_compute() API to not require context (#1999)	Qingyou Meng
2023-07-05	Expose generation timings from server & update completions.js (#2116)	Tobias Lütke
2023-07-05	ggml : generalize `quantize_fns` for simpler FP16 handling (#1237)	Stephan Walter
2023-07-05	llama: Don't double count the sampling time (#2107)	Howard Su
2023-07-05	Fixed OpenCL offloading prints (#2082)	Johannes Gäßler
2023-07-03	Fix crash of test-tokenizer-0 under Debug build (#2064)	Howard Su
2023-07-03	[llama] No need to check file version when loading vocab score (#2079)	Howard Su
2023-07-01	Test-based VRAM scratch size + context adjustment (#2056)	Johannes Gäßler
2023-07-01	metal : release buffers when freeing metal context (#2062)	Aaron Miller
2023-07-01	llama : fix return value of llama_load_session_file_internal (#2022)	Georgi Gerganov
2023-07-01	llama : catch llama_load_session_file_internal exceptions (#2022)	Rand Xie
2023-06-29	Use unsigned for random seed (#2006)	Howard Su
2023-06-28	llama : replacing auto &kv with const auto &kv (#2041)	m3ndax
2023-06-28	llama : remove shards weight file support (#2000)	Howard Su
2023-06-28	CUDA GPU acceleration for LoRAs + f16 models (#1970)	Johannes Gäßler
2023-06-28	llama : support input embeddings directly (#1910)	ningshanwutuobang
2023-06-27	llama : fix rope usage after ChatGLM change	Georgi Gerganov
2023-06-26	ggml : add NUMA support (#1556)	zrm
2023-06-26	k-quants : support for super-block size of 64 (#2001)	Kawrakow
2023-06-24	llama : fix top-p sampling to match the canonical definition (#1953)	Alex Renda
2023-06-24	llama : make model stateless and context stateful (llama_state) (#1797)	Didzis Gosko
2023-06-20	llama : fix params struct slignment (#1936)	Ettore Di Giacinto