fairydreaming fbca2f27fc Add support for ArcticForCausalLM (#7020) ... * common : increase max number of experts to 128 * common : add tensor LLM_TENSOR_FFN_NORM_EXPS for normalization before MoE that runs in parallel to attention + ffn * gguf-py : add architecture-specific block mappings that override selected general block mappings * convert-hf : add model conversion support for ArcticForCausalLM * convert-hf : use added_tokens_decoder from tokenizer_config.json to redefine tokens from SentencePiece model (only for ArcticForCausalLM) * llama : add inference support for LLM_ARCH_ARCTIC --------- Co-authored-by: Stanisław Szymczyk <sszymczy@gmail.com>		2024-05-24 14:31:13 +02:00
..
__init__.py	convert-hf : support direct Q8_0 conversion (#7234)	2024-05-13 14:10:51 -04:00
constants.py	Add support for ArcticForCausalLM (#7020)	2024-05-24 14:31:13 +02:00
gguf_reader.py	convert-hf : save memory with lazy evaluation (#7075)	2024-05-08 18:16:38 -04:00
gguf_writer.py	llama : add phi3 128K model support (#7225)	2024-05-21 23:28:32 +03:00
gguf.py	gguf-py: Refactor and allow reading/modifying existing GGUF files (#3981)	2023-11-11 08:04:50 +03:00
lazy.py	convert-hf : support direct Q8_0 conversion (#7234)	2024-05-13 14:10:51 -04:00
py.typed	convert : various script cleanups/fixes + merges and special token handling (#2842)	2023-08-30 11:25:50 +03:00
quants.py	convert-hf : support direct Q8_0 conversion (#7234)	2024-05-13 14:10:51 -04:00
tensor_mapping.py	Add support for ArcticForCausalLM (#7020)	2024-05-24 14:31:13 +02:00
vocab.py	convert-hf : save memory with lazy evaluation (#7075)	2024-05-08 18:16:38 -04:00