llama.cpp/ggml
Georgi Gerganov 06658ad7c3
metal : separate scale and mask from QKT in FA kernel (#9189)
* metal : separate scale and mask from QKT in FA kernel

* metal : ne01 check no longer necessary

* metal : keep data in local memory
2024-08-26 18:31:02 +03:00
..
cmake llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
include CPU/CUDA: Gemma 2 FlashAttention support (#8542) 2024-08-24 21:34:59 +02:00
src metal : separate scale and mask from QKT in FA kernel (#9189) 2024-08-26 18:31:02 +03:00
.gitignore vulkan : cmake integration (#8119) 2024-07-13 18:12:39 +02:00
CMakeLists.txt Vulkan Optimizations and Fixes (#8959) 2024-08-14 18:32:53 +02:00