llama.cpp.git - llama.cpp

Age	Commit message (Collapse)	Author
2023-05-12	ggml : remove bit shuffling (#1405)	Georgi Gerganov
	* ggml : remove Q4_0 bit shufling (ARM NEON) * ggml : remove Q4_1 bit shuffling (ARM NEON + reference) * ggml : nibbles_from_floats() + bytes_from_nibbles() (ARM NEON) * ggml : remove Q4_2 bit shuffling (WIP, BROKEN) * ggml : remove Q5_0 bit shuffling (ARM NEON) * ggml : 2x faster scalar implementations * ggml : remove Q5_1 bit shuffling (ARM NEON + scalar) * ggml : simplify scalar dot * ggml : remove WASM SIMD bit shuffling + remove vzip for ARM 32-bit * ggml : fix Q4_1 quantization * ggml : update cuBLAS + normalize variable names * ggml : remove Q4_2 mode * ggml : minor formatting * ggml : fix Q5_0 quantization * scripts : add script for measuring the time per token * AVX implementations (#1370) * ggml : uniform 5th bit extraction * llama : produce error upon loading old model files * llama : fix model magic/version write * ggml : speed-up Q5_0 + Q5_1 at 4 threads * ggml : preserve old Q4 and Q5 formats * ggml : simplify Q8_1 - no need for low / high sums anymore * ggml : fix Q8_0 and Q8_1 rounding * Revert "AVX implementations (#1370)" This reverts commit 948d124837f9d287d8490f41338e0e4cceb0814f. * ggml : fix AVX2 implementation * sha : update hashes for 7B and 13B * readme : update timings + remove warning banner * llama : update v2 PR number to 1405 * ggml : fix WASM comments * ggml : back to original bit order * readme : add note that Q4 and Q5 have been changed * llama : fix return for unknown version --------- Co-authored-by: Stephan Walter <stephan@walter.name>
2023-04-28	Remove Q4_3 which is no better than Q5 (#1218)	Stephan Walter

2023-04-25	Update SHA256SUMS after quantization change (#1181)	Stephan Walter
	Co-authored-by: Pavol Rusnak <pavol@rusnak.io>
2023-04-20	Add ggml-model-*.bin checksums for 7B, 13B, 30B, 65B (#1088)	Stephan Walter
	* Add ggml-model-.bin checksums for 7B, 13B, 30B Add ggml-model-*.bin checksums for 65B --------- Co-authored-by: Pavol Rusnak <pavol@rusnak.io>
2023-03-23	Revert "Delete SHA256SUMS for now" (#429)	Stephan Walter
	* Revert "Delete SHA256SUMS for now (#416)" This reverts commit 8eea5ae0e5f31238a97c79ea9103c27647380e37. * Remove ggml files until they can be verified * Remove alpaca json * Add also model/tokenizer.model to SHA256SUMS + update README --------- Co-authored-by: Pavol Rusnak <pavol@rusnak.io>
2023-03-23	Delete SHA256SUMS for now (#416)	anzz1
	Delete this for now to avoid confusion since it contains some wrong checksums from the old tokenizer format Re-add after #374 is resolved
2023-03-21	Add SHA256SUMS file and instructions to README how to obtain and verify the ↵	Gary Mulder
	downloads Hashes created using: sha256sum models/B/.pth models/[7136]B/ggml-model-f16.bin models/[7136]B/ggml-model-q4_0.bin > SHA256SUMS