Mirrors/llama.cpp
1
0
Fork 0
mirror of https://github.com/ggerganov/llama.cpp.git synced 2024-11-22 08:17:58 +01:00
Code Issues Packages Projects Releases Wiki Activity

Updated GGML Tips & Tricks (markdown)

Georgi Gerganov 2023-09-06 10:52:11 +03:00
parent 0181dbe6e1
commit b3d1c333a8
1 changed files with 4 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

4
GGML-Tips-&-Tricks.md

@ -108,3 +108,7 @@ index 3413288..7578bfa 100644
- LLaMAv2 7B, `n_past == 0`, `n_batch == 7`
![image](https://github.com/ggerganov/llama.cpp/assets/1991296/bfa28ae2-aeb0-40a6-8228-374cb0011c5d)
- LLaMAv2 7B, `n_past == 4`, `n_batch == 3`
![image](https://github.com/ggerganov/llama.cpp/assets/1991296/a0ba30a9-7a5d-4f94-b07f-8d3753f786f0)