Mirrors/llama.cpp
1
0
Fork 0
mirror of https://github.com/ggerganov/llama.cpp.git synced 2025-01-30 22:03:03 +01:00
Code Issues Packages Projects Releases Wiki Activity
ff4cb6ef4c
llama.cpp/src
History
Olivier Chafik 6171c9d258
Add Jinja template support (#11016) 
* Copy minja from 58f0ca6dd7

* Add --jinja and --chat-template-file flags

* Add missing <optional> include

* Avoid print in get_hf_chat_template.py

* No designated initializers yet

* Try and work around msvc++ non-macro max resolution quirk

* Update test_chat_completion.py

* Wire LLM_KV_TOKENIZER_CHAT_TEMPLATE_N in llama_model_chat_template

* Refactor test-chat-template

* Test templates w/ minja

* Fix deprecation

* Add --jinja to llama-run

* Update common_chat_format_example to use minja template wrapper

* Test chat_template in e2e test

* Update utils.py

* Update test_chat_completion.py

* Update run.cpp

* Update arg.cpp

* Refactor common_chat_* functions to accept minja template + use_jinja option

* Attempt to fix linkage of LLAMA_CHATML_TEMPLATE

* Revert LLAMA_CHATML_TEMPLATE refactor

* Normalize newlines in test-chat-templates for windows tests

* Forward decl minja::chat_template to avoid eager json dep

* Flush stdout in chat template before potential crash

* Fix copy elision warning

* Rm unused optional include

* Add missing optional include to server.cpp

* Disable jinja test that has a cryptic windows failure

* minja: fix vigogne (https://github.com/google/minja/pull/22)

* Apply suggestions from code review

Co-authored-by: Xuan Son Nguyen <thichthat@gmail.com>
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>

* Finish suggested renamings

* Move chat_templates inside server_context + remove mutex

* Update --chat-template-file w/ recent change to --chat-template

* Refactor chat template validation

* Guard against missing eos/bos tokens (null token otherwise throws in llama_vocab::impl::token_get_attr)

* Warn against missing eos / bos tokens when jinja template references them

* rename: common_chat_template[s]

* reinstate assert on chat_templates.template_default

* Update minja to b8437df626

* Update minja to https://github.com/google/minja/pull/25

* Update minja from https://github.com/google/minja/pull/27

* rm unused optional header

---------

Co-authored-by: Xuan Son Nguyen <thichthat@gmail.com>
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
2025-01-21 13:18:51 +00:00
..
CMakeLists.txt Add Jinja template support (#11016) 2025-01-21 13:18:51 +00:00
llama-adapter.cpp llama : add llama_vocab, functions -> methods, naming (#11110) 2025-01-12 11:32:42 +02:00
llama-adapter.h llama : add llama_vocab, functions -> methods, naming (#11110) 2025-01-12 11:32:42 +02:00
llama-arch.cpp Add Jinja template support (#11016) 2025-01-21 13:18:51 +00:00
llama-arch.h Add Jinja template support (#11016) 2025-01-21 13:18:51 +00:00
llama-batch.cpp llama : refactor src/llama.cpp (#10902) 2025-01-03 10:18:53 +02:00
llama-batch.h llama : refactor src/llama.cpp (#10902) 2025-01-03 10:18:53 +02:00
llama-chat.cpp llama : add support for Deepseek-R1-Qwen distill model (#11310) 2025-01-20 14:35:07 +01:00
llama-chat.h llama-chat : add phi 4 template (#11148) 2025-01-09 10:07:33 +01:00
llama-context.cpp llama : add llama_vocab, functions -> methods, naming (#11110) 2025-01-12 11:32:42 +02:00
llama-context.h llama : add llama_vocab, functions -> methods, naming (#11110) 2025-01-12 11:32:42 +02:00
llama-cparams.cpp llama : refactor src/llama.cpp (#10902) 2025-01-03 10:18:53 +02:00
llama-cparams.h llama : refactor src/llama.cpp (#10902) 2025-01-03 10:18:53 +02:00
llama-grammar.cpp llama : add llama_vocab, functions -> methods, naming (#11110) 2025-01-12 11:32:42 +02:00
llama-grammar.h llama : refactor src/llama.cpp (#10902) 2025-01-03 10:18:53 +02:00
llama-hparams.cpp llama: add support for QRWKV6 model architecture (#11001) 2025-01-10 09:58:08 +08:00
llama-hparams.h llama : add llama_vocab, functions -> methods, naming (#11110) 2025-01-12 11:32:42 +02:00
llama-impl.cpp GGUF: C++ refactor, backend support, misc fixes (#11030) 2025-01-07 18:01:58 +01:00
llama-impl.h llama : refactor src/llama.cpp (#10902) 2025-01-03 10:18:53 +02:00
llama-kv-cache.cpp llama : add llama_vocab, functions -> methods, naming (#11110) 2025-01-12 11:32:42 +02:00
llama-kv-cache.h llama : refactor src/llama.cpp (#10902) 2025-01-03 10:18:53 +02:00
llama-mmap.cpp mmap: add include for cerrno (#11296) 2025-01-20 16:02:43 +02:00
llama-mmap.h mmap : fix fileno macro clash (#11076) 2025-01-06 10:52:38 +02:00
llama-model-loader.cpp llama : add llama_model_load_from_splits (#11255) 2025-01-16 13:54:08 +01:00
llama-model-loader.h llama : add llama_model_load_from_splits (#11255) 2025-01-16 13:54:08 +01:00
llama-model.cpp Add Jinja template support (#11016) 2025-01-21 13:18:51 +00:00
llama-model.h rpc : early register backend devices (#11262) 2025-01-17 10:57:09 +02:00
llama-quant.cpp llama : add llama_model_load_from_splits (#11255) 2025-01-16 13:54:08 +01:00
llama-quant.h llama : refactor src/llama.cpp (#10902) 2025-01-03 10:18:53 +02:00
llama-sampling.cpp llama : add llama_vocab, functions -> methods, naming (#11110) 2025-01-12 11:32:42 +02:00
llama-sampling.h llama : add llama_vocab, functions -> methods, naming (#11110) 2025-01-12 11:32:42 +02:00
llama-vocab.cpp llama : add support for Deepseek-R1-Qwen distill model (#11310) 2025-01-20 14:35:07 +01:00
llama-vocab.h llama : remove notion of CLS token (#11064) 2025-01-12 12:15:53 +02:00
llama.cpp rpc : early register backend devices (#11262) 2025-01-17 10:57:09 +02:00
unicode-data.cpp server : better security control for public deployments (#9776) 2024-10-08 13:27:04 +02:00
unicode-data.h llama : reduce compile time and binary size (#9712) 2024-10-02 15:49:55 +02:00
unicode.cpp cmake : add sanitizer flags for llama.cpp (#11279) 2025-01-18 16:18:15 +02:00
unicode.h unicode : improve naming style (#10838) 2024-12-16 12:31:45 +02:00