From 643ffe9cbba95e04a943fa7762578720a29f2306 Mon Sep 17 00:00:00 2001 From: Xuan Son Nguyen Date: Sun, 14 Apr 2024 18:16:05 +0200 Subject: [PATCH] Updated Templates supported by llama_chat_apply_template (markdown) --- Templates-supported-by-llama_chat_apply_template.md | 8 +++++++- 1 file changed, 7 insertions(+), 1 deletion(-) diff --git a/Templates-supported-by-llama_chat_apply_template.md b/Templates-supported-by-llama_chat_apply_template.md index b2dec16..c87d48b 100644 --- a/Templates-supported-by-llama_chat_apply_template.md +++ b/Templates-supported-by-llama_chat_apply_template.md @@ -116,7 +116,7 @@ ASSISTANT: ``` Usage: ./server -m ... --chat-template deepseek deepseek-ai/deepseek-coder-33b-instruct -<｜begin▁of▁sentence｜>You are a helpful assistant### Instruction: +You are a helpful assistant### Instruction: Hello ### Response: Hi there @@ -132,6 +132,12 @@ Another question ``` +``` +Usage: ./server -m ... --chat-template command-r +CohereForAI/c4ai-command-r-plus +<|START_OF_TURN_TOKEN|><|SYSTEM_TOKEN|>You are a helpful assistant<|END_OF_TURN_TOKEN|><|START_OF_TURN_TOKEN|><|USER_TOKEN|>Hello<|END_OF_TURN_TOKEN|><|START_OF_TURN_TOKEN|><|CHATBOT_TOKEN|>Hi there<|END_OF_TURN_TOKEN|><|START_OF_TURN_TOKEN|><|USER_TOKEN|>Who are you<|END_OF_TURN_TOKEN|><|START_OF_TURN_TOKEN|><|CHATBOT_TOKEN|>I am an assistant<|END_OF_TURN_TOKEN|><|START_OF_TURN_TOKEN|><|USER_TOKEN|>Another question<|END_OF_TURN_TOKEN|><|START_OF_TURN_TOKEN|><|CHATBOT_TOKEN|> +``` + Additionally, we also support zephyr template (I cannot find it on huggingface, but have seen in [this list](https://github.com/ggerganov/llama.cpp/blob/c8d847d57efdc0f9bbbf881d48c645e151b36fd8/examples/server/public/promptFormats.js) ) ```