Mirrors/llama.cpp
1
0
Fork 0
mirror of https://github.com/ggerganov/llama.cpp.git synced 2024-11-22 08:17:58 +01:00
Code Issues Packages Projects Releases Wiki Activity

Updated Templates supported by llama_chat_apply_template (markdown)

Xuan Son Nguyen 2024-03-04 12:21:00 +01:00
parent 91878db2eb
commit 5dee763ef3
1 changed files with 10 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

10
Templates-supported-by-llama_chat_apply_template.md

@ -4,6 +4,8 @@ Please not that, we do **not** include a jinja parser in llama.cpp due to its co
This is the list of templates currently supported by `llama_apply_chat_template`. If you found another template on huggingface that's not yet supported by llama.cpp, please feel free to open an issue:
## Supported templates
<details>
<summary>Python code</summary>
@ -128,3 +130,11 @@ again<|endoftext|>
<|assistant|>
response<|endoftext|>
```
## Custom chat templates
Currently, it's not possible to use your own chat template with `/chat/completions`
One of the possible solutions is use `/completions` endpoint instead, and write your own code (for example, using python) to apply a template before passing the final prompt to `/completions`
TODO: write demo python code