Michael Podvitskiy 69ff61397d llama : support models without vocabulary (#5798) ... * additional methods to read model and ctx parameters * vocab size as a part of a model metadata * models without vocabulary, convert.py part * models without vocabulary, llama.cpp part * PR clean up * converter scrypt fixes * llama_vocab_type update (renamed the new key) * pr review fixes * revert function renaming * one more NoVocab assert		2024-03-14 18:21:56 +02:00
..
__init__.py	gguf-py: Refactor and allow reading/modifying existing GGUF files (#3981)	2023-11-11 08:04:50 +03:00
constants.py	llama : support models without vocabulary (#5798)	2024-03-14 18:21:56 +02:00
gguf_reader.py	gguf-py : add support for I8, I16 and I32 (#6045)	2024-03-14 12:40:14 +02:00
gguf_writer.py	llama : support models without vocabulary (#5798)	2024-03-14 18:21:56 +02:00
gguf.py	gguf-py: Refactor and allow reading/modifying existing GGUF files (#3981)	2023-11-11 08:04:50 +03:00
py.typed	convert : various script cleanups/fixes + merges and special token handling (#2842)	2023-08-30 11:25:50 +03:00
tensor_mapping.py	llama : support Mamba Selective State Space Models (#5328)	2024-03-08 17:31:00 -05:00
vocab.py	fix(gguf-py): special tokens are no longer skipped when add_<token>_token is set to false (#5487)	2024-02-15 14:14:37 +01:00