mirror of
https://github.com/ggerganov/llama.cpp.git
synced 2024-11-01 07:30:17 +01:00
d0d5de42e5
* gguf-split: split and merge gguf files per tensor * gguf-split: build with make toolchain * gguf-split: rename `--split-tensors-size` to `--split-max-tensors`. Set general.split_count KV to all split * split : minor style + fix compile warnings * gguf-split: remove --upload not implemented --------- Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
10 lines
265 B
Markdown
10 lines
265 B
Markdown
## GGUF split Example
|
|
|
|
CLI to split / merge GGUF files.
|
|
|
|
**Command line options:**
|
|
|
|
- `--split`: split GGUF to multiple GGUF, default operation.
|
|
- `--split-max-tensors`: maximum tensors in each split: default(128)
|
|
- `--merge`: merge multiple GGUF to a single GGUF.
|