Commit Graph

24 Commits

Author SHA1 Message Date
pandora
b98635d823
Fixing Mistral Templates
Hi there, fixing the templates as close as possible to the ground truth, you ca find more information regarding the templates in here: https://github.com/mistralai/cookbook/blob/main/concept-deep-dive/tokenization/chat_templates.md

Still needs to be verified, so please dont merge yet!
2024-09-21 18:48:28 +02:00
Guanghua Lu
d7bd3da35e
Add Llama 3 instruction template (#5891) 2024-05-19 20:17:26 -03:00
oobabooga
cb31998605 Add a template for NVIDIA ChatQA models 2024-05-03 08:19:04 -07:00
oobabooga
4e739dc211 Add an instruction template for Command R 2024-04-05 18:22:25 -07:00
fschuh
fa1019e8fe
Removed extra spaces from Mistral instruction template that were causing Mistral to misbehave (#5517) 2024-02-16 21:40:51 -03:00
Badis Ghoubali
9fdee65cf5
Improve ChatML template (#5411) 2024-02-04 23:39:15 -03:00
Badis Ghoubali
c44836c4d7
Fix spaces in Mistral/Mixtral instruct prompt (#5214) 2024-01-09 21:12:54 -03:00
Stefan Daniel Schwarz
8956f3ebe2
Synthia instruction templates (#5041) 2023-12-22 22:19:43 -03:00
oobabooga
3d10c574e7 Fix custom system messages in instruction templates 2023-12-18 17:45:06 -08:00
oobabooga
64a57d9dc2 Remove duplicate instruction templates 2023-12-17 21:39:47 -08:00
oobabooga
306c479d3a Minor fix to Vigogne-Chat template 2023-12-17 19:15:54 -08:00
Eve
7c6f39382b
Add Orca-Vicuna instruction template (#4971) 2023-12-17 23:55:23 -03:00
oobabooga
a060908d6c Mixtral Instruct: detect prompt format for llama.cpp loader
Workaround until the tokenizer.chat_template kv field gets implemented
2023-12-15 06:59:15 -08:00
Ixion
3f3960dbfb
Fixed invalid Jinja2 syntax in instruction templates (#4911) 2023-12-13 15:46:23 -03:00
oobabooga
39d2fe1ed9
Jinja templates for Instruct and Chat (#4874) 2023-12-12 17:23:14 -03:00
oobabooga
b81d6ad8a4
Detect Orca 2 template (#4697) 2023-11-21 15:26:42 -03:00
oobabooga
6e2e0317af
Separate context and system message in instruction formats (#4499) 2023-11-07 20:02:58 -03:00
Haotian Liu
32984ea2f0
Support LLaVA v1.5 (#4305) 2023-10-20 02:28:14 -03:00
Eve
6e2dec82f1
add chatml support + mistral-openorca (#4275) 2023-10-13 11:49:17 -03:00
oobabooga
9ccaf5eebb I forgot to add the file 2023-09-28 18:25:58 -07:00
oobabooga
3e7c624f8e Add a template for OpenOrca-Platypus2 2023-08-17 15:03:08 -07:00
oobabooga
a3295dd666 Detect n_gqa and prompt template for wizardlm-70b 2023-08-09 10:51:16 -07:00
oobabooga
4ba30f6765 Add OpenChat template 2023-08-08 14:10:04 -07:00
oobabooga
c237ce607e Move characters/instruction-following to instruction-templates 2023-08-06 17:50:32 -07:00