aboutsummaryrefslogtreecommitdiff
path: root/llama.cpp
AgeCommit message (Expand)Author
2023-08-08CUDA: tighter VRAM scratch size for 65b/70b (#2551)Johannes Gäßler
2023-08-07Fixed mmap prefetch for GPU offloading (#2529)Johannes Gäßler
2023-08-04Stream save llama context data to file instead of allocating entire buffer up...l3utterfly
2023-07-31CUDA: mmq CLI option, fixed mmq build issues (#2453)Johannes Gäßler
2023-07-31Fix Metal backend broken from the allocator changes (#2455)slaren
2023-07-30ggml : add graph tensor allocator (#2411)slaren
2023-07-28llama : support more diverse tokenizers? (#2420)eric8607242
2023-07-28llama : use n_embd_gqa instead of n_embd to handle llama-2 70B (#2433)Rand Xie
2023-07-27metal : disable graph concurrency optimization due to bug (#2413)Georgi Gerganov
2023-07-26ggml : allocate graphs in a context (#2392)slaren
2023-07-25Add LLAMA_DEFAULT_RMS_EPS so we can change the default (#2384)Kawrakow
2023-07-25ggml : improve graph build time via hash table lookup (#2329)slaren
2023-07-25metal : concurrently dispatch commands (#2358)Shouzheng Liu
2023-07-24make rms_norm_eps a parameter (#2374)slaren
2023-07-23llama : add grammar-based sampling (#1773)Evan Jones
2023-07-23llama : grouped-query attention + LLaMAv2 70B support (#2276)Georgi Gerganov
2023-07-23llama : print max tensor size to stderr (#2336)Christian Demsar
2023-07-22llama : optimize memory buffers (#2325)Georgi Gerganov
2023-07-21ggml : fix rope args order + assert (#2054)Georgi Gerganov
2023-07-21llama : remove cfg smooth factor as it is only a reparameterization of the gu...Guillaume "Vermeille" Sanchez
2023-07-21llama : make tensor_split ptr instead of array (#2272)Georgi Gerganov
2023-07-20llama : fix regression from #2000 - could not load no-mmap modelsGeorgi Gerganov
2023-07-19llama : extend API to get max devices at runtime (#2253)Rinne
2023-07-18ci : integrate with ggml-org/ci (#2250)Georgi Gerganov
2023-07-17llama : fix t_start_sample_us initialization warning (#2238)Alex Klinkhamer
2023-07-15llama : add custom RoPE (#2054)Xiao-Yong Jin
2023-07-14llama : add functions that work directly on model (#2197)Bach Le
2023-07-11llama : add classifier-free guidance (#2135)Bach Le
2023-07-11Possible solution to allow K-quants on models with n_vocab!=32000 (#2148)LostRuins
2023-07-10mpi : add support for distributed inference via MPI (#2099)Evan Miller
2023-07-09llama : remove "first token must be BOS" restriction (#2153)oobabooga
2023-07-07ggml : change ggml_graph_compute() API to not require context (#1999)Qingyou Meng
2023-07-05Expose generation timings from server & update completions.js (#2116)Tobias Lütke
2023-07-05ggml : generalize `quantize_fns` for simpler FP16 handling (#1237)Stephan Walter
2023-07-05llama: Don't double count the sampling time (#2107)Howard Su
2023-07-05Fixed OpenCL offloading prints (#2082)Johannes Gäßler
2023-07-03Fix crash of test-tokenizer-0 under Debug build (#2064)Howard Su
2023-07-03[llama] No need to check file version when loading vocab score (#2079)Howard Su
2023-07-01Test-based VRAM scratch size + context adjustment (#2056)Johannes Gäßler
2023-07-01metal : release buffers when freeing metal context (#2062)Aaron Miller
2023-07-01llama : fix return value of llama_load_session_file_internal (#2022)Georgi Gerganov
2023-07-01llama : catch llama_load_session_file_internal exceptions (#2022)Rand Xie
2023-06-29Use unsigned for random seed (#2006)Howard Su
2023-06-28llama : replacing auto &kv with const auto &kv (#2041)m3ndax
2023-06-28llama : remove shards weight file support (#2000)Howard Su
2023-06-28CUDA GPU acceleration for LoRAs + f16 models (#1970)Johannes Gäßler
2023-06-28llama : support input embeddings directly (#1910)ningshanwutuobang
2023-06-27llama : fix rope usage after ChatGLM changeGeorgi Gerganov
2023-06-26ggml : add NUMA support (#1556)zrm
2023-06-26k-quants : support for super-block size of 64 (#2001)Kawrakow
generated by cgit v1.2.3 (git 2.25.1) at 2024-10-18 11:29:38 +0000