3 Commits

Author	SHA1	Message	Date
slaren	0d56246f4b	ggml : group all experts in a single ggml_mul_mat_id (#6505) ... * ggml : group all experts in a single ggml_mul_mat_id cuda : improve mmid row copy * cuda : fix bin bcast with non-cont src0 * test-backend-ops : only run all mul mat tests for base types * llama : disable moe offloading with SYCL --------- Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>	2024-04-18 15:18:48 +02:00
slaren	280345968d	cuda : rename build flag to LLAMA_CUDA (#6299)	2024-03-26 01:16:01 +01:00
Georgi Gerganov	d2819d5577	scripts : add helpers script for bench comparing commits (#5521) ... * scripts : add helpers script for bench comparing commits * scripts : detect CUDA * set flags after checking the command line * fix make flags --------- Co-authored-by: slaren <slarengh@gmail.com>	2024-02-16 15:14:40 +02:00