Mirrors/llama.cpp
1
0
Fork 0
mirror of https://github.com/ggerganov/llama.cpp.git synced 2024-12-25 13:58:46 +01:00
Code Issues Packages Projects Releases Wiki Activity
gg/metal-mul-mv-new
llama.cpp/examples/run
History
Eric Curtin 0cc63754b8
Introduce llama-run (#10291) 
It's like simple-chat but it uses smart pointers to avoid manual
memory cleanups. Less memory leaks in the code now. Avoid printing
multiple dots. Split code into smaller functions. Uses no exception
handling.

Signed-off-by: Eric Curtin <ecurtin@redhat.com>
2024-11-25 22:56:24 +01:00
..
CMakeLists.txt Introduce llama-run (#10291) 2024-11-25 22:56:24 +01:00
README.md Introduce llama-run (#10291) 2024-11-25 22:56:24 +01:00
run.cpp Introduce llama-run (#10291) 2024-11-25 22:56:24 +01:00

README.md

llama.cpp/example/run

The purpose of this example is to demonstrate a minimal usage of llama.cpp for running models.

./llama-run Meta-Llama-3.1-8B-Instruct.gguf
...