llama.cpp/ggml-vulkan-shaders.hpp at df68d4fa5dc929217d3e64d673e099d7a417b206 - llama.cpp - Gitea: Git with a cup of tea

Mirrors/llama.cpp

mirror of https://github.com/ggerganov/llama.cpp.git synced 2024-12-25 05:48:47 +01:00

0cc4m 7c7836d9d4

Vulkan Shader Refactor, Memory Debugging Option (#7947 )

* Refactor shaders, extract GLSL code from ggml_vk_generate_shaders.py into vulkan-shaders directory

* Improve debug log code

* Add memory debug output option

* Fix flake8

* Fix unnecessary high llama-3 VRAM use

2024-06-16 07:17:31 +02:00

8.4 MiB

Raw Blame History

The file is too large to be shown. View Raw