70 Commits

Author	SHA1	Message	Date
oobabooga	0af10ab49b	Add Classifier Free Guidance (CFG) for Transformers/ExLlama (#3325)	2023-08-06 17:22:48 -03:00
oobabooga	87dab03dc0	Add the --cpu option for llama.cpp to prevent CUDA from being used (#3432)	2023-08-03 11:00:36 -03:00
oobabooga	32a2bbee4a	Implement auto_max_new_tokens for ExLlama	2023-08-02 11:03:56 -07:00
oobabooga	e931844fe2	Add auto_max_new_tokens parameter (#3419)	2023-08-02 14:52:20 -03:00
oobabooga	84297d05c4	Add a "Filter by loader" menu to the Parameters tab	2023-07-31 19:09:02 -07:00
oobabooga	b17893a58f	Revert "Add tensor split support for llama.cpp (#3171)" ... This reverts commit 031fe7225e.	2023-07-26 07:06:01 -07:00
Shouyi	031fe7225e	Add tensor split support for llama.cpp (#3171)	2023-07-25 18:59:26 -03:00
oobabooga	a07d070b6c	Add llama-2-70b GGML support (#3285)	2023-07-24 16:37:03 -03:00
randoentity	a69955377a	[GGML] Support for customizable RoPE (#3083) ... --------- Co-authored-by: oobabooga <112222186+oobabooga@users.noreply.github.com>	2023-07-17 22:32:37 -03:00
oobabooga	5e3f7e00a9	Create llamacpp_HF loader (#3062)	2023-07-16 02:21:13 -03:00
oobabooga	e202190c4f	lint	2023-07-12 11:33:25 -07:00
Gabriel Pena	eedb3bf023	Add low vram mode on llama cpp (#3076)	2023-07-12 11:05:13 -03:00
Panchovix	10c8c197bf	Add Support for Static NTK RoPE scaling for exllama/exllama_hf (#2955)	2023-07-04 01:13:16 -03:00
oobabooga	c52290de50	ExLlama with long context (#2875)	2023-06-25 22:49:26 -03:00
oobabooga	3ae9af01aa	Add --no_use_cuda_fp16 param for AutoGPTQ	2023-06-23 12:22:56 -03:00
LarryVRH	580c1ee748	Implement a demo HF wrapper for exllama to utilize existing HF transformers decoding. (#2777)	2023-06-21 15:31:42 -03:00
oobabooga	5f392122fd	Add gpu_split param to ExLlama ... Adapted from code created by Ph0rk0z. Thank you Ph0rk0z.	2023-06-16 20:49:36 -03:00
oobabooga	9f40032d32	Add ExLlama support (#2444)	2023-06-16 20:35:38 -03:00
oobabooga	dea43685b0	Add some clarifications	2023-06-16 19:10:53 -03:00
oobabooga	7ef6a50e84	Reorganize model loading UI completely (#2720)	2023-06-16 19:00:37 -03:00