Mirrors/llama.cpp
1
0
Fork 0
mirror of https://github.com/ggerganov/llama.cpp.git synced 2024-11-25 17:39:23 +01:00
Code Issues Packages Projects Releases Wiki Activity

Updated Templates supported by llama_chat_apply_template (markdown)

Xuan Son Nguyen 2024-03-04 12:23:08 +01:00
parent 5dee763ef3
commit 86f794b1f9
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
Templates-supported-by-llama_chat_apply_template.md

@ -133,7 +133,7 @@ response<|endoftext|>
## Custom chat templates
Currently, it's not possible to use your own chat template with `/chat/completions`
Currently, it's not possible to use your own chat template with llama.cpp server's `/chat/completions`
One of the possible solutions is use `/completions` endpoint instead, and write your own code (for example, using python) to apply a template before passing the final prompt to `/completions`