Eve 5c3d0f1824

ggml : IQ4_NL sgemm + Q4_0 AVX optimization (#9422) ...

* squashed

readd my iq4_nl sgemm PR https://github.com/ggerganov/llama.cpp/pull/8049

have ggml_vec_dot_q4_0 do two blocks per loop for avx

try out f16c ggml_vec_dot_iq4_nl, but it's not really faster. as per https://github.com/ggerganov/llama.cpp/pull/8549 we can calculate several blocks at a time with no issue

* shuffle

* remove f16c iq4_nl as i cant make it faster than before

2024-09-16 09:48:24 +03:00

..

cmake

llama : reorganize source code + improve CMake (#8006)

2024-06-26 18:33:02 +03:00

include

common : reimplement logging (#9418)

2024-09-15 20:46:12 +03:00

src

ggml : IQ4_NL sgemm + Q4_0 AVX optimization (#9422)

2024-09-16 09:48:24 +03:00

.gitignore

vulkan : cmake integration (#8119)

2024-07-13 18:12:39 +02:00

CMakeLists.txt

Improve Vulkan shader build system (#9239)

2024-09-06 08:56:17 +02:00