mirror of
https://github.com/ggerganov/llama.cpp.git
synced 2024-11-01 07:30:17 +01:00
b0034d93ce
* examples : add passkey test * passkey : better prints * passkey : select pass key pos from CLI * passkey : simplify n_past logic * make : add passkey target * passkey : add "self-extend"-like context extension (#4810) * llama : "self-extend"-like context extension * passkey : add comment * passkey : add readme
13 lines
259 B
Markdown
13 lines
259 B
Markdown
# llama.cpp/example/passkey
|
|
|
|
See the following PRs for more info:
|
|
|
|
- https://github.com/ggerganov/llama.cpp/pull/3856
|
|
- https://github.com/ggerganov/llama.cpp/pull/4810
|
|
|
|
### Usage
|
|
|
|
```bash
|
|
make -j && ./passkey ./models/llama-7b-v2/ggml-model-f16.gguf 250
|
|
```
|