1
0
mirror of https://github.com/ggerganov/llama.cpp.git synced 2025-01-14 22:38:58 +01:00
llama.cpp/examples/lookahead
2023-12-12 11:53:36 +02:00
..
CMakeLists.txt lookahead : add example for lookahead decoding () 2023-11-26 20:33:07 +02:00
lookahead.cpp lookahead : support -n -1 infinite generation 2023-11-26 21:52:23 +02:00
README.md english : use typos to fix comments and logs () 2023-12-12 11:53:36 +02:00

llama.cpp/examples/lookahead

Demonstration of lookahead decoding technique:

https://lmsys.org/blog/2023-11-21-lookahead-decoding/

More info: https://github.com/ggerganov/llama.cpp/pull/4207