Mirrors/llama.cpp
1
0
Fork 0
mirror of https://github.com/ggerganov/llama.cpp.git synced 2024-11-25 17:39:23 +01:00
Code Issues Packages Projects Releases Wiki Activity

Updated GGML Tips & Tricks (markdown)

Georgi Gerganov 2023-09-06 10:49:00 +03:00
parent 93da44c7bd
commit 0181dbe6e1
1 changed files with 2 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

4
GGML-Tips-&-Tricks.md

@ -101,10 +101,10 @@ index 3413288..7578bfa 100644
{
```
- `n_past == 45`, `n_batch == 1`
- LLaMAv2 7B, `n_past == 45`, `n_batch == 1`
![image](https://github.com/ggerganov/llama.cpp/assets/1991296/93ac4a44-e7e6-4a9e-a332-b38c642847cc)
- `n_past == 0`, `n_batch == 7`
- LLaMAv2 7B, `n_past == 0`, `n_batch == 7`
![image](https://github.com/ggerganov/llama.cpp/assets/1991296/bfa28ae2-aeb0-40a6-8228-374cb0011c5d)