5 Commits

Author	SHA1	Message	Date
oobabooga	c52290de50	ExLlama with long context (#2875)	2023-06-25 22:49:26 -03:00
jllllll	bef67af23c	Use pre-compiled python module for ExLlama (#2770)	2023-06-24 20:24:17 -03:00
oobabooga	cec5fb0ef6	Failed attempt at evaluating exllama_hf perplexity	2023-06-24 12:02:25 -03:00
Panchovix	b4a38c24b7	Fix Multi-GPU not working on exllama_hf (#2803)	2023-06-22 16:05:25 -03:00
LarryVRH	580c1ee748	Implement a demo HF wrapper for exllama to utilize existing HF transformers decoding. (#2777)	2023-06-21 15:31:42 -03:00