14 Commits (721311070e31464ac12bef9a4444093eb3eaebf7)

Author	SHA1	Message	Date
Nebula	9b4a15b17d	Fix RMS norm in GGML (#191)	3 years ago
hoangmit	6eac39ba95	Add RMS norm and use it (#187) ... * add ggml_rms_norm * update op num	3 years ago
hoangmit	113e685d18	inline -> static inline for "bytesFromNibbles" (#161) ... Without "static" prefix, it fails to compile in clang	3 years ago
Ronsor	47857e564c	Don't use vdotq_s32 if it's not available (#139) ... * Don't use vdotq_s32 if it's not available `dotprod` extensions aren't available on some ARM CPUs (e.g. Raspberry Pi 4), so check for them and only use them if they're available. Reintroduces the code removed in 84d9015 if `__ARM_FEATURE_DOTPROD` isn't defined. * Update ggml.c --------- Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>	3 years ago
Thomas Klausner	41be0a3b3d	Add NetBSD support. (#90)	3 years ago
Georgi Gerganov	84d9015c4a	Use vdotq_s32 to improve performance (#67) ... * 10% performance boost on ARM * Back to original change	3 years ago
Georgi Gerganov	c80e2a8f2a	Revert "10% performance boost on ARM" ... This reverts commit 113a9e83eb. There are some reports for illegal instruction. Moved this stuff to vdotq_s32 branch until resolve	3 years ago
Georgi Gerganov	54a0e66ea0	Check for vdotq_s32 availability	3 years ago
Georgi Gerganov	543c57e991	Ammend to previous commit - forgot to update non-QRDMX branch	3 years ago
Georgi Gerganov	113a9e83eb	10% performance boost on ARM	3 years ago
Sebastián A	eb062bb012	Windows fixes (#31) ... * Apply fixes suggested to build on windows Issue: https://github.com/ggerganov/llama.cpp/issues/22 * Remove unsupported VLAs * MSVC: Remove features that are only available on MSVC C++20. * Fix zero initialization of the other fields. * Change the use of vector for stack allocations.	3 years ago
Georgi Gerganov	f1eaff4721	Add AVX2 support for x86 architectures thanks to @Const-me !	3 years ago
Georgi Gerganov	007a8f6f45	Support all LLaMA models + change Q4_0 quantization storage	3 years ago
Georgi Gerganov	26c0846629	Initial release	3 years ago