Mirrors/llama.cpp
1
0
Fork 0
mirror of https://github.com/ggerganov/llama.cpp.git synced 2024-12-26 14:20:31 +01:00
Code Issues Packages Projects Releases Wiki Activity
3,236 Commits 359 Branches 2,868 Tags 343 MiB
sl/zero-max-size
Commit Graph

2 Commits

Author SHA1 Message Date
0cc4m
45c0e2e4c1
Refactor Vulkan backend to allow multiple contexts (#7961) 
* Refactor Vulkan backend to allow multiple contexts

* Fix too many shader groups called validation error in llama3 on AMD and Intel GPUs

* Fix Vulkan debug build error
 2024-06-23 10:21:25 +02:00
0cc4m
7c7836d9d4
Vulkan Shader Refactor, Memory Debugging Option (#7947) 
* Refactor shaders, extract GLSL code from ggml_vk_generate_shaders.py into vulkan-shaders directory

* Improve debug log code

* Add memory debug output option

* Fix flake8

* Fix unnecessary high llama-3 VRAM use
 2024-06-16 07:17:31 +02:00