1
0
mirror of https://github.com/ggerganov/llama.cpp.git synced 2025-01-20 00:31:15 +01:00
llama.cpp/examples/passkey
Diego Devesa 7cc2d2c889
ggml : move AMX to the CPU backend ()
* ggml : move AMX to the CPU backend

---------

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
2024-11-29 21:54:58 +01:00
..
CMakeLists.txt ggml : move AMX to the CPU backend () 2024-11-29 21:54:58 +01:00
passkey.cpp common : use common_ prefix for common library functions () 2024-10-10 22:57:42 +02:00
README.md passkey : add short intro to README.md [no-ci] () 2024-07-05 09:14:24 +03:00

llama.cpp/example/passkey

A passkey retrieval task is an evaluation method used to measure a language models ability to recall information from long contexts.

See the following PRs for more info:

Usage

make -j && ./llama-passkey -m ./models/llama-7b-v2/ggml-model-f16.gguf --junk 250