dev-notes.md: gguf read/write example note

brian khuu 2024-06-12 13:54:09 +10:00
parent 333b2970fa
commit 212923661c

@ -1,4 +1,4 @@
# Dev Note
# Dev Notes
These are general free form note with pointers to good jumping to point to under
stand the llama.cpp codebase.
@ -53,3 +53,10 @@ Aka it's for the writing/reading api.
| GGUF Context | Size Of 'Data' In Bytes | size | `size_t` | gguf.c:`@gguf_context` |
| Tensor Info Entry | Tensor memory mapped pointer location in computer | data | `void *` | gguf.c:`@gguf_tensor_info` |
| Tensor Info Entry | Tensor memory mapped size of layer data in computer | size | `size_t` | gguf.c:`@gguf_tensor_info` |
### Is there a simple example of gguf being used?
There is this cpp example program that will write a test gguf write/read
- [./example/gguf.cpp](https://github.com/ggerganov/llama.cpp/blob/master/examples/gguf/gguf.cpp)