604 Commits

Author	SHA1	Message	Date
oobabooga	c0fd7f3257	Add mirostat parameters for llama.cpp (#2287)	2023-05-22 19:37:24 -03:00
oobabooga	d63ef59a0f	Apply LLaMA-Precise preset to Vicuna by default	2023-05-21 23:00:42 -03:00
oobabooga	dcc3e54005	Various "impersonate" fixes	2023-05-21 22:54:28 -03:00
oobabooga	e116d31180	Prevent unwanted log messages from modules	2023-05-21 22:42:34 -03:00
oobabooga	fb91406e93	Fix generation_attempts continuing after an empty reply	2023-05-21 22:14:50 -03:00
oobabooga	e18534fe12	Fix "continue" in chat-instruct mode	2023-05-21 22:05:59 -03:00
oobabooga	8ac3636966	Add epsilon_cutoff/eta_cutoff parameters (#2258)	2023-05-21 15:11:57 -03:00
oobabooga	1e5821bd9e	Fix silero tts autoplay (attempt #2)	2023-05-21 13:25:11 -03:00
oobabooga	a5d5bb9390	Fix silero tts autoplay	2023-05-21 12:11:59 -03:00
oobabooga	05593a7834	Minor bug fix	2023-05-20 23:22:36 -03:00
Matthew McAllister	ab6acddcc5	Add Save/Delete character buttons (#1870) ... --------- Co-authored-by: oobabooga <112222186+oobabooga@users.noreply.github.com>	2023-05-20 21:48:45 -03:00
oobabooga	c5af549d4b	Add chat API (#2233)	2023-05-20 18:42:17 -03:00
Konstantin Gukov	1b52bddfcc	Mitigate UnboundLocalError (#2136)	2023-05-19 14:46:18 -03:00
Alex "mcmonkey" Goodwin	50c70e28f0	Lora Trainer improvements, part 6 - slightly better raw text inputs (#2108)	2023-05-19 12:58:54 -03:00
oobabooga	9d5025f531	Improve error handling while loading GPTQ models	2023-05-19 11:20:08 -03:00
oobabooga	b667ffa51d	Simplify GPTQ_loader.py	2023-05-17 16:22:56 -03:00
oobabooga	ef10ffc6b4	Add various checks to model loading functions	2023-05-17 16:14:54 -03:00
oobabooga	abd361b3a0	Minor change	2023-05-17 11:33:43 -03:00
oobabooga	21ecc3701e	Avoid a name conflict	2023-05-17 11:23:13 -03:00
oobabooga	fb91c07191	Minor bug fix	2023-05-17 11:16:37 -03:00
oobabooga	1a8151a2b6	Add AutoGPTQ support (basic) (#2132)	2023-05-17 11:12:12 -03:00
Alex "mcmonkey" Goodwin	1f50dbe352	Experimental jank multiGPU inference that's 2x faster than native somehow (#2100)	2023-05-17 10:41:09 -03:00
oobabooga	ce21804ec7	Allow extensions to define a new tab	2023-05-17 01:31:56 -03:00
oobabooga	a84f499718	Allow extensions to define custom CSS and JS	2023-05-17 00:30:54 -03:00
oobabooga	7584d46c29	Refactor models.py (#2113)	2023-05-16 19:52:22 -03:00
oobabooga	5cd6dd4287	Fix no-mmap bug	2023-05-16 17:35:49 -03:00
Forkoz	d205ec9706	Fix Training fails when evaluation dataset is selected (#2099) ... Fixes https://github.com/oobabooga/text-generation-webui/issues/2078 from Googulator	2023-05-16 13:40:19 -03:00
atriantafy	26cf8c2545	add api port options (#1990)	2023-05-15 20:44:16 -03:00
Andrei	e657dd342d	Add in-memory cache support for llama.cpp (#1936)	2023-05-15 20:19:55 -03:00
Jakub Strnad	0227e738ed	Add settings UI for llama.cpp and fixed reloading of llama.cpp models (#2087)	2023-05-15 19:51:23 -03:00
oobabooga	c07215cc08	Improve the default Assistant character	2023-05-15 19:39:08 -03:00
oobabooga	4e66f68115	Create get_max_memory_dict() function	2023-05-15 19:38:27 -03:00
AlphaAtlas	071f0776ad	Add llama.cpp GPU offload option (#2060)	2023-05-14 22:58:11 -03:00
oobabooga	3b886f9c9f	Add chat-instruct mode (#2049)	2023-05-14 10:43:55 -03:00
oobabooga	df37ba5256	Update impersonate_wrapper	2023-05-12 12:59:48 -03:00
oobabooga	e283ddc559	Change how spaces are handled in continue/generation attempts	2023-05-12 12:50:29 -03:00
oobabooga	2eeb27659d	Fix bug in --cpu-memory	2023-05-12 06:17:07 -03:00
oobabooga	5eaa914e1b	Fix settings.json being ignored because of config.yaml	2023-05-12 06:09:45 -03:00
oobabooga	71693161eb	Better handle spaces in LlamaTokenizer	2023-05-11 17:55:50 -03:00
oobabooga	7221d1389a	Fix a bug	2023-05-11 17:11:10 -03:00
oobabooga	0d36c18f5d	Always return only the new tokens in generation functions	2023-05-11 17:07:20 -03:00
oobabooga	394bb253db	Syntax improvement	2023-05-11 16:27:50 -03:00
oobabooga	f7dbddfff5	Add a variable for tts extensions to use	2023-05-11 16:12:46 -03:00
oobabooga	638c6a65a2	Refactor chat functions (#2003)	2023-05-11 15:37:04 -03:00
oobabooga	b7a589afc8	Improve the Metharme prompt	2023-05-10 16:09:32 -03:00
oobabooga	b01c4884cb	Better stopping strings for instruct mode	2023-05-10 14:22:38 -03:00
oobabooga	6a4783afc7	Add markdown table rendering	2023-05-10 13:41:23 -03:00
oobabooga	3316e33d14	Remove unused code	2023-05-10 11:59:59 -03:00
Alexander Dibrov	ec14d9b725	Fix custom_generate_chat_prompt (#1965)	2023-05-10 11:29:59 -03:00
oobabooga	32481ec4d6	Fix prompt order in the dropdown	2023-05-10 02:24:09 -03:00