llama.cpp/ggml-vulkan-shaders.hpp at 98f948b9d072e293faceb795b69ce3e5805ecf65 - llama.cpp - Gitea: Git with a cup of tea

Mirrors/llama.cpp

mirror of https://github.com/ggerganov/llama.cpp.git synced 2024-12-27 22:59:24 +01:00

0cc4m 7c7836d9d4

Vulkan Shader Refactor, Memory Debugging Option (#7947 )

* Refactor shaders, extract GLSL code from ggml_vk_generate_shaders.py into vulkan-shaders directory

* Improve debug log code

* Add memory debug output option

* Fix flake8

* Fix unnecessary high llama-3 VRAM use

2024-06-16 07:17:31 +02:00

8.4 MiB

Raw Blame History

The file is too large to be shown. View Raw