104 Commits

Author	SHA1	Message	Date
Stephan Walter	69c92298a9	Deduplicate q4 quantization functions (#383) ... * Deduplicate q4 quantization functions * Use const; add basic test * Re-enable quantization test * Disable AVX2 flags in CI --------- Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>	2023-03-22 19:29:06 +02:00
Georgi Gerganov	f5a77a629b	Introduce C-style API (#370) ... * Major refactoring - introduce C-style API * Clean up * Add <cassert> * Add <iterator> * Add <algorithm> .... * Fix timing reporting and accumulation * Measure eval time only for single-token calls * Change llama_tokenize return meaning	2023-03-22 07:32:36 +02:00
hoangmit	6eac39ba95	Add RMS norm and use it (#187) ... * add ggml_rms_norm * update op num	2023-03-16 00:41:38 +02:00
Georgi Gerganov	26c0846629	Initial release	2023-03-10 20:56:40 +02:00