Michał Moskal ff227703d6 sampling : support for llguidance grammars (#10224) ... * initial porting of previous LLG patch * update for new APIs * build: integrate llguidance as an external project * use '%llguidance' as marker to enable llg lark syntax * add some docs * clarify docs * code style fixes * remove llguidance.h from .gitignore * fix tests when llg is enabled * pass vocab not model to llama_sampler_init_llg() * copy test-grammar-integration.cpp to test-llguidance.cpp * clang fmt * fix ref-count bug * build and run test * gbnf -> lark syntax * conditionally include llguidance test based on LLAMA_LLGUIDANCE flag * rename llguidance test file to test-grammar-llguidance.cpp * add gh action for llg test * align tests with LLG grammar syntax and JSON Schema spec * llama_tokenizer() in fact requires valid utf8 * update llg * format file * add $LLGUIDANCE_LOG_LEVEL support * fix whitespace * fix warning * include <cmath> for INFINITY * add final newline * fail llama_sampler_init_llg() at runtime * Link gbnf_to_lark.py script; fix links; refer to llg docs for lexemes * simplify #includes * improve doc string for LLAMA_LLGUIDANCE * typo in merge * bump llguidance to 0.6.12		2025-02-02 09:55:32 +02:00
..
ISSUE_TEMPLATE	github : add cmd line field to bug report (#11090)	2025-01-06 16:34:49 +01:00
workflows	sampling : support for llguidance grammars (#10224)	2025-02-02 09:55:32 +02:00
labeler.yml	ci : add ubuntu cuda build, build with one arch on windows (#10456)	2024-11-26 13:05:07 +01:00
pull_request_template.md	github : minify link [no ci] (revert)	2024-12-03 11:21:43 +02:00