aboutsummaryrefslogtreecommitdiff
AgeCommit message (Expand)Author
2023-08-10resolve merge conflictaditya
2023-08-09ggml-alloc: Don't try to re-use buffers of external tensors (#2562)Sam Spilsbury
2023-08-09add log_callback to llama_context_params for custom logging. (#2234)grahameth
2023-08-09CUDA: tuned mul_mat_q kernels (#2546)Johannes Gäßler
2023-08-08Allow passing grammar to completion endpoint (#2532)Martin Krasser
2023-08-08CUDA: tighter VRAM scratch size for 65b/70b (#2551)Johannes Gäßler
2023-08-08llm.vim : multiline autocompletion, get rid of "^@" (#2543)chaihahaha
2023-08-08vim : bring back simple llm.vim exampleGeorgi Gerganov
2023-08-08vim : streaming and more (#2495)AustinMroz
2023-08-07Add --rope-scale parameter (#2544)klosax
2023-08-07ggml : mul mat tweaks (#2372)Georgi Gerganov
2023-08-07ggml : pad result of ggml_nbytes()Georgi Gerganov
2023-08-07ggml : change params pointer (style change) (#2539)Georgi Gerganov
2023-08-07ggml : sync (custom ops) (#2537)Georgi Gerganov
2023-08-07Fixed mmap prefetch for GPU offloading (#2529)Johannes Gäßler
2023-08-07metal : fix out-of-bounds access + inc concurrency nodes (#2416)Georgi Gerganov
2023-08-07[Makefile] Move ARM CFLAGS before compilation (#2536)GiviMAD
2023-08-07[Zig] Rewrite build for Zig 0.11 (#2514)Henri Vasserman
2023-08-06console : fix issue related to Windows 11 PowerShell console mode persistence...DannyDaemonic
2023-08-06convert.py : add missing abstract methods for quantized data (#2491)Keiichi Tabata
2023-08-05CUDA: faster k-quant mul_mat_q kernels (#2525)Johannes Gäßler
2023-08-04fix firefox autoscroll (#2519)Jonas Wunderlich
2023-08-04server: regenerate completion.js.hpp (#2515)Cebtenzzre
2023-08-04CUDA: use min compute capability of GPUs actually used (#2506)Cebtenzzre
2023-08-04CUDA: check if event is NULL before cudaStreamWaitEvent (#2505)Cebtenzzre
2023-08-04Add --simple-io option for subprocesses and break out console.h and cpp (#1558)DannyDaemonic
2023-08-04Fixing race condition in server and partial stream handling in frontend. (#2391)Stephen Nichols
2023-08-04Stream save llama context data to file instead of allocating entire buffer up...l3utterfly
2023-08-04build : fix several cast and printf warnings (#2499)Borislav Stanimirov
2023-08-02examples : generate JSON according to schema (#1887)Evan Jones
2023-08-02CUDA: faster non k-quant mul_mat_q kernels (#2483)Johannes Gäßler
2023-08-02CUDA: Fix models with output size != 32000 (#2480)Johannes Gäßler
2023-08-02readme : add Aquila-7B model series to supported models (#2487)ldwang
2023-08-02tests : Fix compilation warnings (Linux/GCC) (#2451)Eve
2023-08-02readme : Add Chinese LLaMA-2 / Alpaca-2 to supported models (#2475)Yiming Cui
2023-08-01fix a typo in examples/server/README.md (#2478)Bono Lv
2023-08-01server : Support dark mode (#2414)ebraminio
2023-08-01metal : add gqa8 kernel to allow llama-2-70B on metal (#2459)Matteo Boschini
2023-07-31CUDA: fixed LLAMA_FAST compilation option (#2473)Johannes Gäßler
2023-07-31CUDA: fixed cmake F16 option (#2471)Johannes Gäßler
2023-07-31CUDA: mmq CLI option, fixed mmq build issues (#2453)Johannes Gäßler
2023-07-31CUDA: Implemented row flattening for non-glm RoPE (#2468)Johannes Gäßler
2023-07-31CUDA: fewer memory bank conflicts for mul_mat_q (#2458)Johannes Gäßler
2023-07-31Fix Metal backend broken from the allocator changes (#2455)slaren
2023-07-30ggml : add graph tensor allocator (#2411)slaren
2023-07-29CUDA: Quantized matrix matrix multiplication (#2160)Johannes Gäßler
2023-07-29CUDA: faster multi GPU synchronization (#2448)Johannes Gäßler
2023-07-28perplexity : add Hellaswag calculation (#2389)klosax
2023-07-28ggml : workaround for missing _mm256_setr_m128i in GCC < 8 in k_quants.c (#2405)Lee
2023-07-28llama : support more diverse tokenizers? (#2420)eric8607242