Mirrors/llama.cpp
1
0
Fork 0
mirror of https://github.com/ggerganov/llama.cpp.git synced 2024-11-23 00:28:22 +01:00
Code Issues Packages Projects Releases Wiki Activity

dev-notes.md: gguf read/write example note

brian khuu 2024-06-12 13:54:09 +10:00
parent 333b2970fa
commit 212923661c
1 changed files with 8 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

9
dev-notes.md

@ -1,4 +1,4 @@
# Dev Note # Dev Notes
These are general free form note with pointers to good jumping to point to under These are general free form note with pointers to good jumping to point to under
stand the llama.cpp codebase. stand the llama.cpp codebase.
@ -53,3 +53,10 @@ Aka it's for the writing/reading api.
| GGUF Context | Size Of 'Data' In Bytes | size | `size_t` | gguf.c:`@gguf_context` | | GGUF Context | Size Of 'Data' In Bytes | size | `size_t` | gguf.c:`@gguf_context` |
| Tensor Info Entry | Tensor memory mapped pointer location in computer | data | `void *` | gguf.c:`@gguf_tensor_info` | | Tensor Info Entry | Tensor memory mapped pointer location in computer | data | `void *` | gguf.c:`@gguf_tensor_info` |
| Tensor Info Entry | Tensor memory mapped size of layer data in computer | size | `size_t` | gguf.c:`@gguf_tensor_info` | | Tensor Info Entry | Tensor memory mapped size of layer data in computer | size | `size_t` | gguf.c:`@gguf_tensor_info` |
### Is there a simple example of gguf being used?
There is this cpp example program that will write a test gguf write/read
- [./example/gguf.cpp](https://github.com/ggerganov/llama.cpp/blob/master/examples/gguf/gguf.cpp)