352 Commits

Author	SHA1	Message	Date
draff	e6c631aea4	Replace --load-in-4bit with --llama-bits ... Replaces --load-in-4bit with a more flexible --llama-bits arg to allow for 2 and 3 bit models as well. This commit also fixes a loading issue with .pt files which are not in the root of the models folder	2023-03-10 21:36:45 +00:00
oobabooga	7c3d1b43c1	Merge pull request #204 from MichealC0/patch-1 ... Update README.md	2023-03-09 23:04:09 -03:00
oobabooga	1a3d25f75d	Merge pull request #206 from oobabooga/llama-4bit ... Add LLaMA 4-bit support	2023-03-09 21:07:32 -03:00
oobabooga	eb0cb9b6df	Update README	2023-03-09 20:53:52 -03:00
oobabooga	d41e3c233b	Update README.md	2023-03-09 18:02:44 -03:00
oobabooga	33414478bf	Update README	2023-03-09 11:13:03 -03:00
oobabooga	e7adf5fe4e	Add Contrastive Search preset #197	2023-03-09 10:27:11 -03:00
Chimdumebi Nebolisa	4dd14dcab4	Update README.md	2023-03-09 10:22:09 +01:00
oobabooga	b4bfd87319	Update README.md	2023-03-06 20:55:01 -03:00
oobabooga	d0e8780555	Update README.md	2023-03-06 20:17:59 -03:00
oobabooga	18ccfcd7fe	Update README.md	2023-03-06 20:15:55 -03:00
oobabooga	91823e1ed1	Update README.md	2023-03-06 16:48:31 -03:00
oobabooga	aa7ce0665e	Merge branch 'main' of github.com:oobabooga/text-generation-webui	2023-03-06 10:58:41 -03:00
oobabooga	bf56b6c1fb	Load settings.json without the need for --settings settings.json ... This is for setting UI defaults	2023-03-06 10:57:45 -03:00
oobabooga	2de9f122cd	Update README.md	2023-03-06 09:34:49 -03:00
oobabooga	736f61610b	Update README	2023-03-04 01:33:52 -03:00
oobabooga	76378c6cc2	Update README	2023-03-02 11:27:15 -03:00
oobabooga	f4b130e2bd	Update README.md	2023-02-27 15:15:45 -03:00
oobabooga	c183d2917c	Update README.md	2023-02-26 00:59:07 -03:00
oobabooga	cfe010b244	Update README.md	2023-02-26 00:54:37 -03:00
oobabooga	87d9f3e329	Update README.md	2023-02-26 00:54:19 -03:00
oobabooga	955997a90b	Update README.md	2023-02-26 00:54:07 -03:00
oobabooga	c593dfa827	Update README.md	2023-02-25 18:57:34 -03:00
oobabooga	7872a64f78	Update README.md	2023-02-25 18:56:43 -03:00
oobabooga	88cfc84ddb	Update README	2023-02-25 01:33:26 -03:00
oobabooga	0b90e0b3b6	Update README.md	2023-02-24 12:01:07 -03:00
oobabooga	1a23e6d185	Add Pythia to README	2023-02-24 11:38:01 -03:00
oobabooga	f4f508c8e2	Update README.md	2023-02-24 09:03:09 -03:00
oobabooga	ced5d9ab04	Update README.md	2023-02-23 10:04:07 -03:00
oobabooga	b18071330f	Update README.md	2023-02-23 01:32:05 -03:00
oobabooga	b4a7f5fa70	Update README.md	2023-02-22 01:54:12 -03:00
oobabooga	e195377050	Deprecate torch dumps, move to safetensors (they load even faster)	2023-02-20 15:03:19 -03:00
oobabooga	58520a1f75	Update README.md	2023-02-20 12:44:31 -03:00
oobabooga	05e9da0c12	Update README.md	2023-02-18 22:34:51 -03:00
oobabooga	b1add0e586	Update README.md	2023-02-18 22:32:16 -03:00
oobabooga	348acdf626	Mention deepspeed in the README	2023-02-16 17:29:48 -03:00
oobabooga	05b53e4626	Update README	2023-02-15 14:43:34 -03:00
oobabooga	ed73d00bd5	Update README	2023-02-15 14:43:13 -03:00
oobabooga	30fcb26737	Update README	2023-02-15 14:42:41 -03:00
oobabooga	5ee9283cae	Mention BLIP	2023-02-15 13:53:38 -03:00
oobabooga	8d3b3959e7	Document --picture option	2023-02-15 13:50:18 -03:00
oobabooga	01e5772302	Update README.md	2023-02-14 13:06:26 -03:00
oobabooga	210c918199	Update README.md	2023-02-13 21:49:19 -03:00
oobabooga	b7ddcab53a	Update README.md	2023-02-13 15:52:49 -03:00
oobabooga	939e9d00a2	Update README.md	2023-02-12 00:47:03 -03:00
oobabooga	bf9dd8f8ee	Add --text-only option to the download script	2023-02-12 00:42:56 -03:00
oobabooga	42cc307409	Update README.md	2023-02-12 00:34:55 -03:00
oobabooga	144857acfe	Update README	2023-02-11 14:49:11 -03:00
oobabooga	0dd1409f24	Add penalty_alpha parameter (contrastive search)	2023-02-11 14:48:12 -03:00
oobabooga	8aafb55693	1-click installer now also works for AMD GPUs ... (I think)	2023-02-11 14:24:47 -03:00
oobabooga	1176d64b13	Update README.md	2023-02-11 07:56:12 -03:00
Spencer-Dawson	c5324d653b	re-added missed README changes	2023-02-11 00:13:06 -07:00
oobabooga	cf89ef1c74	Update README.md	2023-02-10 21:46:29 -03:00
oobabooga	8782ac1911	Update README.md	2023-02-10 17:10:27 -03:00
oobabooga	7d7cc37560	Add Linux 1-click installer	2023-02-10 17:09:53 -03:00
oobabooga	991de5ed40	Update README.md	2023-02-09 14:36:47 -03:00
oobabooga	04d3d0aee6	Add 1-click windows installer (for #45)	2023-02-09 13:27:30 -03:00
oobabooga	a21620fc59	Update README	2023-02-08 01:17:50 -03:00
oobabooga	fc0493d885	Add credits	2023-02-08 00:09:41 -03:00
oobabooga	53af062fa5	Update README.md	2023-02-05 23:14:25 -03:00
oobabooga	90bb2caffd	Update README.md	2023-02-03 19:45:11 -03:00
oobabooga	93b0d1b1b8	Update README.md	2023-02-03 10:14:52 -03:00
oobabooga	6212b41930	Update README	2023-02-03 09:13:14 -03:00
oobabooga	7f4315b120	Mention 8bit fix for Windows users ... Closes #44, #20	2023-02-02 11:00:57 -03:00
oobabooga	7aa3d6583e	Update README.md	2023-01-30 09:45:31 -03:00
oobabooga	239f96a9c5	Add extensions guide	2023-01-30 09:44:57 -03:00
oobabooga	f92996b3c8	Update README.md	2023-01-29 14:37:05 -03:00
oobabooga	9e4db10cd0	Update README.md	2023-01-29 03:13:22 -03:00
oobabooga	1a139664f5	Grammar	2023-01-29 02:54:36 -03:00
oobabooga	89c862b179	Update README	2023-01-28 20:37:43 -03:00
oobabooga	6b5dcd46c5	Add support for extensions ... This is experimental.	2023-01-27 00:40:39 -03:00
oobabooga	d49710878e	Update README.md	2023-01-26 16:17:15 -03:00
oobabooga	ff180f3e60	Update installation instructions (for #15)	2023-01-26 12:32:21 -03:00
oobabooga	61611197e0	Add --verbose option (oops)	2023-01-26 02:18:06 -03:00
oobabooga	64f278d248	Update README	2023-01-25 19:43:30 -03:00
oobabooga	b77933d327	File names must be img_me.jpg and img_bot.jpg	2023-01-25 19:40:30 -03:00
oobabooga	fc73188ec7	Allow specifying your own profile picture in chat mode	2023-01-25 19:37:44 -03:00
oobabooga	651eb50dd1	Merge branch 'main' of github.com:oobabooga/text-generation-webui	2023-01-25 10:20:03 -03:00
oobabooga	3b8f0021cc	Stop generating at \nYou: in chat mode	2023-01-25 10:17:55 -03:00
oobabooga	befabbb862	Update README.md	2023-01-24 23:01:43 -03:00
oobabooga	7b98971df1	Update README.md	2023-01-24 18:39:29 -03:00
oobabooga	86b237eb0b	Update README.md	2023-01-24 09:29:34 -03:00
oobabooga	c2d1f04305	Update README.md	2023-01-23 23:34:20 -03:00
oobabooga	6c40f7eeb4	New NovelAI/KoboldAI preset selection	2023-01-23 20:44:27 -03:00
oobabooga	22845ba445	Update README	2023-01-23 13:41:50 -03:00
oobabooga	5b60691367	Update README	2023-01-23 10:05:25 -03:00
oobabooga	085d5cbcb9	Update README	2023-01-23 10:03:19 -03:00
oobabooga	8a68930220	Update README	2023-01-23 10:02:35 -03:00
oobabooga	3c5454c6f8	Update README	2023-01-22 19:38:07 -03:00
oobabooga	8f37383dc6	Update README	2023-01-22 19:29:24 -03:00
oobabooga	9592e7e618	Update README	2023-01-22 19:28:03 -03:00
oobabooga	c410fe5ab8	Add simplified colab notebook	2023-01-22 19:27:30 -03:00
oobabooga	41806fe40d	Update chat screenshot	2023-01-22 17:28:51 -03:00
oobabooga	00f3b0996b	Warn the user that chat mode becomes a lot slower with text streaming	2023-01-22 16:19:11 -03:00
oobabooga	5b50db9dee	Mention pygmalion support	2023-01-22 01:30:55 -03:00
oobabooga	6b06fca2f1	Mention pygmalion support	2023-01-22 01:28:52 -03:00
oobabooga	434d4b128c	Add refresh buttons for the model/preset/character menus	2023-01-22 00:02:46 -03:00
oobabooga	bc664ecf3b	Update the installation instructions for low attention span people	2023-01-21 22:54:35 -03:00
oobabooga	f9dbe7e08e	Update README	2023-01-21 03:05:55 -03:00
oobabooga	990ee54ddd	Move the example dialogue to the chat history, and keep it hidden. ... This greatly improves the performance of text generation, as histories can be quite long. It also makes more sense to implement it this way.	2023-01-21 02:48:06 -03:00
oobabooga	d7299df01f	Rename parameters	2023-01-21 00:33:41 -03:00
oobabooga	5df03bf0fd	Merge branch 'main' into main	2023-01-21 00:25:34 -03:00
oobabooga	faaafe7c0e	Better parameter naming	2023-01-20 23:45:16 -03:00
Silver267	f4634e4c32	Update.	2023-01-20 17:05:43 -05:00
oobabooga	83584ae2d7	Clearer installation instructions	2023-01-20 00:20:35 -03:00
oobabooga	8d4170826f	Update README	2023-01-19 21:08:26 -03:00
oobabooga	cd7b07239f	Add Colab guide	2023-01-19 17:58:04 -03:00
oobabooga	83808171d3	Add --share option for Colab	2023-01-19 17:31:29 -03:00
oobabooga	b054367be2	Update README	2023-01-19 16:54:58 -03:00
oobabooga	f9faad4cfa	Add low VRAM guide	2023-01-19 11:25:17 -03:00
oobabooga	7ace04864a	Implement sending layers to disk with --disk (#10)	2023-01-19 11:09:24 -03:00
oobabooga	1ce95ee817	Mention text streaming	2023-01-19 10:46:41 -03:00
oobabooga	93fa9bbe01	Clean up the streaming implementation	2023-01-19 10:43:05 -03:00
oobabooga	6456777b09	Clean things up	2023-01-16 16:35:45 -03:00
oobabooga	99d24bdbfe	Update README.md	2023-01-16 11:23:45 -03:00
oobabooga	ed1d2c0d38	Update README.md	2023-01-16 11:19:23 -03:00
oobabooga	82c50a09b2	Update README.md	2023-01-16 10:31:13 -03:00
oobabooga	3a28865eb2	Update README.md	2023-01-16 10:07:00 -03:00
oobabooga	18626c4788	Update README.md	2023-01-16 01:51:59 -03:00
oobabooga	a3bb18002a	Update README	2023-01-15 22:34:56 -03:00
oobabooga	ebf4d5f506	Add --max-gpu-memory parameter for #7	2023-01-15 22:33:35 -03:00
oobabooga	e6691bd920	Make chat mode more like cai	2023-01-15 18:16:46 -03:00
oobabooga	9f1b6e0398	Update README	2023-01-15 16:50:58 -03:00
oobabooga	99b35dd48d	Update README	2023-01-15 15:46:09 -03:00
oobabooga	027c3dd27d	Allow jpg profile images	2023-01-15 15:45:25 -03:00
oobabooga	ada2e556d0	Update README	2023-01-15 15:41:36 -03:00
oobabooga	26d8ec3188	Update README	2023-01-15 15:40:03 -03:00
oobabooga	afe9f77f96	Reorder parameters	2023-01-15 15:30:39 -03:00
oobabooga	88d67427e1	Implement default settings customization using a json file	2023-01-15 15:23:41 -03:00
oobabooga	56be7149aa	Update README	2023-01-15 12:39:31 -03:00
oobabooga	6136da419c	Add --cai-chat option that mimics Character.AI's interface	2023-01-15 12:20:04 -03:00
oobabooga	d0af274185	Update README	2023-01-15 04:29:19 -03:00
oobabooga	5bbba25528	Move screenshots somewhere else	2023-01-15 04:27:22 -03:00
oobabooga	0aefcded63	Update README	2023-01-15 04:12:04 -03:00
oobabooga	9a261d82e9	Update README	2023-01-15 03:35:57 -03:00
oobabooga	b73decda6f	Update README	2023-01-15 03:34:34 -03:00
oobabooga	525834ea34	Update README	2023-01-15 03:33:32 -03:00
oobabooga	34021131ff	Credit the presets	2023-01-15 03:00:59 -03:00
oobabooga	fa29cd8698	Update README.md	2023-01-15 02:51:52 -03:00
oobabooga	194e2f8439	Update README.md	2023-01-15 02:50:10 -03:00
oobabooga	830ec7123a	Add more screenshots	2023-01-14 23:25:05 -03:00
oobabooga	3750e301a1	Update README	2023-01-13 11:33:38 -03:00
oobabooga	7299159360	Mention pygmalion	2023-01-13 09:33:38 -03:00
oobabooga	acf3d6d27e	I have tested the CPU conda requirements and this works	2023-01-13 09:19:39 -03:00
oobabooga	d3bd6a3093	Installation instructions	2023-01-13 01:39:09 -03:00
oobabooga	44b4274ec2	Installation instructions	2023-01-13 01:37:12 -03:00
oobabooga	323aaa074f	Installation instructions	2023-01-13 01:29:36 -03:00
oobabooga	886c12dd77	Add more detailed installation instructions	2023-01-13 01:27:29 -03:00
oobabooga	aeff0d4cc1	Update README	2023-01-11 23:04:06 -03:00
oobabooga	e0ec20c1b7	Update readme	2023-01-11 23:01:50 -03:00
oobabooga	5ba60f83a4	Add detailed gpt4chan installation instructions	2023-01-11 23:00:31 -03:00
oobabooga	21415f6988	Mention API	2023-01-11 16:51:32 -03:00
oobabooga	d5e01c80e3	Add nice HTML output for all models	2023-01-11 01:10:11 -03:00
oobabooga	89fd0180b7	Better description of features	2023-01-10 23:30:41 -03:00
oobabooga	a236b24d24	Add --auto-devices and --load-in-8bit options for #4	2023-01-10 23:16:33 -03:00
oobabooga	3aefcfd963	Grammar	2023-01-09 19:07:47 -03:00
oobabooga	7028116bf2	Fix	2023-01-09 19:07:10 -03:00
oobabooga	222ae23fe0	Fix	2023-01-09 19:06:29 -03:00
oobabooga	6c178b1c91	Add --listen parameter	2023-01-09 19:05:36 -03:00
oobabooga	86092d1879	Update README	2023-01-09 18:58:24 -03:00
oobabooga	9aa51ca227	Update README	2023-01-09 18:18:35 -03:00
oobabooga	fbbad7cf8a	Mention units	2023-01-09 18:14:09 -03:00
oobabooga	306be22b8e	Add system requirements	2023-01-09 18:12:41 -03:00
oobabooga	96a75b616b	Update README	2023-01-09 16:19:57 -03:00
oobabooga	f737029ee5	Update README	2023-01-09 16:15:54 -03:00
oobabooga	9704cfaa45	Update README	2023-01-09 16:09:27 -03:00
oobabooga	e2a917b3bf	Update README	2023-01-09 11:11:05 -03:00
oobabooga	0e67ccf607	Implement CPU mode	2023-01-09 10:58:46 -03:00
oobabooga	b801e0d50d	Minor changes	2023-01-08 14:37:43 -03:00
oobabooga	a0b1b1beb2	Mention gpt4chan's config.json	2023-01-07 23:13:43 -03:00
oobabooga	f76bdadbed	Add chat mode	2023-01-07 22:52:46 -03:00
oobabooga	c82ccbb24d	Update README	2023-01-07 19:23:59 -03:00
oobabooga	596b40f982	Update readme	2023-01-07 19:22:43 -03:00
oobabooga	0a967bf86d	Link galactica	2023-01-07 19:19:55 -03:00
oobabooga	971fb8e011	Mention the features	2023-01-07 18:40:51 -03:00
oobabooga	b53b658320	Update the README	2023-01-06 20:29:00 -03:00
oobabooga	e5f547fc87	Implement notebook mode	2023-01-06 20:22:26 -03:00
oobabooga	6c02fe7a94	Update the README	2023-01-06 20:09:06 -03:00
oobabooga	eb3aa6b3d7	Update the README	2023-01-06 20:08:43 -03:00
oobabooga	6f2b804de2	Update the README	2023-01-06 20:07:58 -03:00
oobabooga	f3f802454c	Update the README	2023-01-06 20:07:11 -03:00
oobabooga	8f789ed999	Update README	2023-01-06 20:06:24 -03:00
oobabooga	8c3746b629	Add updates to README	2023-01-06 20:00:58 -03:00
oobabooga	ee88d02292	Small fix	2023-01-06 02:13:48 -03:00
oobabooga	d47e518a02	Improve instructions	2023-01-06 02:12:38 -03:00
oobabooga	4142760d56	Better wording	2023-01-06 01:44:40 -03:00
oobabooga	285032da36	Make model loading more transparent	2023-01-06 01:41:52 -03:00
oobabooga	c65bad40dc	Add support for presets	2023-01-06 01:33:21 -03:00
oobabooga	77214d155c	Update	2023-01-06 00:18:34 -03:00
oobabooga	e76727267d	Update	2023-01-06 00:14:33 -03:00
oobabooga	276ef0032d	Mention more models	2023-01-06 00:13:26 -03:00
oobabooga	7daebf91bb	Update	2023-01-06 00:07:51 -03:00
oobabooga	960d881148	Merge branch 'main' of github.com:oobabooga/text-generation-webui	2023-01-06 00:06:48 -03:00
oobabooga	39d47bb8a9	Update the installation instructions (fixes #1)	2023-01-06 00:05:11 -03:00
oobabooga	a90097e0b8	Update README.md	2022-12-21 21:49:03 -03:00
oobabooga	e0583f0ec2	Update README.md	2022-12-21 16:52:23 -03:00
oobabooga	261684f92e	Update README.md	2022-12-21 16:49:30 -03:00
oobabooga	65352bc189	Update README.md	2022-12-21 15:00:16 -03:00
oobabooga	e3d7c99987	Update README.md	2022-12-21 14:37:50 -03:00
oobabooga	5018b0fb65	Update README.md	2022-12-21 14:04:51 -03:00