llama.cpp/.github
Masaya, Kato a5735e4426
ggml : use OpenMP as a thread pool (#7606)
* ggml: Added OpenMP for multi-threads processing

* ggml : Limit the number of threads used to avoid deadlock

* update shared state n_threads in parallel region

* clear numa affinity for main thread even with openmp

* enable openmp by default

* fix msvc build

* disable openmp on macos

* ci : disable openmp with thread sanitizer

* Update ggml.c

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>

---------

Co-authored-by: slaren <slarengh@gmail.com>
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
2024-06-03 17:14:15 +02:00
..
ISSUE_TEMPLATE github: add contact links to issues and convert question into research [no ci] (#7612) 2024-05-30 21:55:36 +10:00
workflows ggml : use OpenMP as a thread pool (#7606) 2024-06-03 17:14:15 +02:00
labeler.yml labeler: added Apple Metal detector (+Kompute) (#7529) 2024-05-25 19:30:42 +10:00