mirror of
https://github.com/ggerganov/llama.cpp.git
synced 2024-11-25 17:39:23 +01:00
dev-notes.md: gguf read/write example note
parent
333b2970fa
commit
212923661c
@ -1,4 +1,4 @@
|
||||
# Dev Note
|
||||
# Dev Notes
|
||||
|
||||
These are general free form note with pointers to good jumping to point to under
|
||||
stand the llama.cpp codebase.
|
||||
@ -53,3 +53,10 @@ Aka it's for the writing/reading api.
|
||||
| GGUF Context | Size Of 'Data' In Bytes | size | `size_t` | gguf.c:`@gguf_context` |
|
||||
| Tensor Info Entry | Tensor memory mapped pointer location in computer | data | `void *` | gguf.c:`@gguf_tensor_info` |
|
||||
| Tensor Info Entry | Tensor memory mapped size of layer data in computer | size | `size_t` | gguf.c:`@gguf_tensor_info` |
|
||||
|
||||
|
||||
### Is there a simple example of gguf being used?
|
||||
|
||||
There is this cpp example program that will write a test gguf write/read
|
||||
|
||||
- [./example/gguf.cpp](https://github.com/ggerganov/llama.cpp/blob/master/examples/gguf/gguf.cpp)
|
Loading…
Reference in New Issue
Block a user