Radoslav Gerganov
|
6da5bec81c
|
rpc : better caching of the base buffer pointer (#11331)
There is no need to use map, just store the base pointer in the buffer
context.
|
2025-01-21 15:06:41 +02:00 |
|
Radoslav Gerganov
|
a4dd490069
|
rpc : code cleanup (#11107)
Remove duplicated macros, use GGML_LOG_ERROR for errors
|
2025-01-07 08:37:02 +02:00 |
|
matt23654
|
f922a9c542
|
[GGML][RPC] Support for models with non-512-aligned tensors over RPC. (#11047)
* Added init tensor calling code
* Added get_alloc_size forwarding
* Cleaned up and improved type/error handling.
* fix: remove trailing whitespaces.
* Cleanup and use GGML error logging functions.
* Handle potentially dangerous edge cases.
* Apply suggestions from code review
Co-authored-by: Diego Devesa <slarengh@gmail.com>
---------
Co-authored-by: Diego Devesa <slarengh@gmail.com>
|
2025-01-04 17:10:30 +01:00 |
|
Diego Devesa
|
5931c1f233
|
ggml : add support for dynamic loading of backends (#10469)
* ggml : add support for dynamic loading of backends
---------
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
|
2024-11-25 15:13:39 +01:00 |
|
Diego Devesa
|
ae8de6d50a
|
ggml : build backends as libraries (#10256)
* ggml : build backends as libraries
---------
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
Co-authored-by: R0CKSTAR <xiaodong.ye@mthreads.com>
|
2024-11-14 18:04:35 +01:00 |
|