2040 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
oobabooga	2583bc5840	Simplify deepspeed implementation (#40)	2023-02-02 12:15:44 -03:00
oobabooga	7f4315b120	Mention 8bit fix for Windows users ... Closes #44, #20	2023-02-02 11:00:57 -03:00
oobabooga	d6b2d68527	Remove redundant requirements	2023-02-02 10:40:09 -03:00
oobabooga	f38c9bf428	Fix deepspeed (oops)	2023-02-02 10:39:37 -03:00
oobabooga	90f1067598	Move deepspeed parameters to another file	2023-02-02 10:25:09 -03:00
oobabooga	1a658b41aa	Merge pull request #43 from 81300/ds ... Add DeepSpeed ZeRO-3 integration	2023-02-02 10:03:19 -03:00
oobabooga	39461bd796	Delete .gitignore	2023-02-02 10:01:56 -03:00
81300	248ec4fa21	Merge branch 'oobabooga:main' into ds	2023-02-01 20:50:51 +02:00
81300	a6f4760772	Add arg for bfloat16	2023-02-01 20:22:07 +02:00
81300	c515282f5c	no_split_module_classes not needed	2023-02-01 19:47:26 +02:00
81300	0a0d289537	Fix issue with generating on multiple GPUs	2023-02-01 19:02:07 +02:00
81300	a97afa6965	Add DeepSpeed ZeRO-3 integration	2023-02-01 18:48:13 +02:00
oobabooga	6b13816c47	Change default --disk behavior	2023-02-01 10:43:28 -03:00
oobabooga	119be56390	Add back low_cpu_mem_usage=True ... Removing it didn't help with anything, so I am adding it bad on a purely superstiticious basis.	2023-02-01 10:01:44 -03:00
oobabooga	d4a0b377ab	Allow standalone --cpu-memory ... I think that what I am doing probably makes sense, but I could be wrong.	2023-01-31 21:23:16 -03:00
oobabooga	efb0ab502e	New preset	2023-01-31 21:03:25 -03:00
oobabooga	8ef89df746	Try to leave at least 1GiB free to prevent oom errors	2023-01-31 20:47:05 -03:00
oobabooga	bb77f20a6c	Don't use low_cpu_mem_usage and device_map together	2023-01-31 13:24:05 -03:00
oobabooga	824329749d	Merge pull request #38 from Silver267/patch-2 ... Fix an error	2023-01-31 08:14:50 -03:00
oobabooga	001ecf95b2	Update server.py	2023-01-31 08:14:16 -03:00
Silver267	a85bb5e9a2	Fix an error ... Fixes "UnboundLocalError: local variable 'substring_found' referenced before assignment" when loading non-pygmalion models in cai chat mode.	2023-01-31 01:34:10 -05:00
oobabooga	5b0bbfa6e8	Clean up	2023-01-30 14:17:12 -03:00
oobabooga	7aa3d6583e	Update README.md	2023-01-30 09:45:31 -03:00
oobabooga	239f96a9c5	Add extensions guide	2023-01-30 09:44:57 -03:00
oobabooga	dfbca86533	Add **bold** support in chat mode	2023-01-30 08:36:58 -03:00
oobabooga	2dadf42cb5	Print the tokenized example dialogue in a prettier way	2023-01-30 08:29:49 -03:00
oobabooga	161cae001b	I needed this	2023-01-29 23:20:22 -03:00
oobabooga	3ebca480f6	Minor fix	2023-01-29 23:05:17 -03:00
oobabooga	00707a0b3b	Add "Impersonate" button	2023-01-29 22:56:23 -03:00
oobabooga	ad148571f4	Add fixed Google Translation extension	2023-01-29 14:55:24 -03:00
oobabooga	b19415849c	Merge branch 'main' of github.com:oobabooga/text-generation-webui	2023-01-29 14:41:41 -03:00
oobabooga	584a7dd50d	Remove defective extension	2023-01-29 14:40:14 -03:00
oobabooga	f92996b3c8	Update README.md	2023-01-29 14:37:05 -03:00
oobabooga	de72e83508	Reorganize things	2023-01-29 14:27:22 -03:00
oobabooga	6fbfee9e6d	Remove some bloat	2023-01-29 12:05:18 -03:00
oobabooga	9c9bd1074f	Add option to replace the bot's last reply	2023-01-29 12:02:44 -03:00
oobabooga	e5ff4ddfc8	Add bot prefix modifier option in extensions	2023-01-29 10:11:59 -03:00
oobabooga	c1c129196e	Merge branch 'main' of github.com:oobabooga/text-generation-webui	2023-01-29 09:48:44 -03:00
oobabooga	b6d01bb704	Enable extensions in all modes, not just chat	2023-01-29 09:48:18 -03:00
oobabooga	ba33e6f1d3	Delete .github/ISSUE_TEMPLATE directory	2023-01-29 09:37:05 -03:00
oobabooga	af09b0ed9a	Update issue templates	2023-01-29 09:36:11 -03:00
oobabooga	9e4db10cd0	Update README.md	2023-01-29 03:13:22 -03:00
oobabooga	1a139664f5	Grammar	2023-01-29 02:54:36 -03:00
oobabooga	2d134031ca	Apply extensions to character greeting	2023-01-29 00:04:11 -03:00
oobabooga	c9447da898	Rename extension	2023-01-28 23:47:15 -03:00
oobabooga	1a8d815de4	Make src and dst languages explicit	2023-01-28 23:29:17 -03:00
oobabooga	7ff68ef252	Add Google Translate extension	2023-01-28 23:26:07 -03:00
oobabooga	e349b52256	Read extensions parameters from settings file	2023-01-28 23:21:40 -03:00
oobabooga	2239be2351	Support for number/bool extension parameters	2023-01-28 23:08:28 -03:00
oobabooga	6da94e358c	Add support for extensions parameters ... Still experimental	2023-01-28 23:00:51 -03:00