529 Commits

Author	SHA1	Message	Date
oobabooga	b6ff138084	Add --checkpoint argument for GPTQ	2023-05-04 15:17:20 -03:00
Ahmed Said	fbcd32988e	added no_mmap & mlock parameters to llama.cpp and removed llamacpp_model_alternative (#1649) ... --------- Co-authored-by: oobabooga <112222186+oobabooga@users.noreply.github.com>	2023-05-02 18:25:28 -03:00
oobabooga	f39c99fa14	Load more than one LoRA with --lora, fix a bug	2023-04-25 22:58:48 -03:00
oobabooga	b6af2e56a2	Add --character flag, add character to settings.json	2023-04-24 13:19:42 -03:00
eiery	78d1977ebf	add n_batch support for llama.cpp (#1115)	2023-04-24 03:46:18 -03:00
Andy Salerno	654933c634	New universal API with streaming/blocking endpoints (#990) ... Previous title: Add api_streaming extension and update api-example-stream to use it * Merge with latest main * Add parameter capturing encoder_repetition_penalty * Change some defaults, minor fixes * Add --api, --public-api flags * remove unneeded/broken comment from blocking API startup. The comment is already correctly emitted in try_start_cloudflared by calling the lambda we pass in. * Update on_start message for blocking_api, it should say 'non-streaming' and not 'streaming' * Update the API examples * Change a comment * Update README * Remove the gradio API * Remove unused import * Minor change * Remove unused import --------- Co-authored-by: oobabooga <112222186+oobabooga@users.noreply.github.com>	2023-04-23 15:52:43 -03:00
oobabooga	7438f4f6ba	Change GPTQ triton default settings	2023-04-22 12:27:30 -03:00
oobabooga	fe02281477	Update README.md	2023-04-22 03:05:00 -03:00
oobabooga	038fa3eb39	Update README.md	2023-04-22 02:46:07 -03:00
oobabooga	505c2c73e8	Update README.md	2023-04-22 00:11:27 -03:00
oobabooga	f8da9a0424	Update README.md	2023-04-18 20:25:08 -03:00
oobabooga	c3f6e65554	Update README.md	2023-04-18 20:23:31 -03:00
oobabooga	eb15193327	Update README.md	2023-04-18 13:07:08 -03:00
oobabooga	7fbfc489e2	Update README.md	2023-04-18 12:56:37 -03:00
oobabooga	f559f9595b	Update README.md	2023-04-18 12:54:09 -03:00
loeken	89e22d4d6a	added windows/docker docs (#1027)	2023-04-18 12:47:43 -03:00
oobabooga	8275989f03	Add new 1-click installers for Linux and MacOS	2023-04-18 02:40:36 -03:00
oobabooga	301c687c64	Update README.md	2023-04-17 11:25:26 -03:00
oobabooga	89bc540557	Update README	2023-04-17 10:55:35 -03:00
practicaldreamer	3961f49524	Add note about --no-fused_mlp ignoring --gpu-memory (#1301)	2023-04-17 10:46:37 -03:00
sgsdxzy	b57ffc2ec9	Update to support GPTQ triton commit c90adef (#1229)	2023-04-17 01:11:18 -03:00
oobabooga	3e5cdd005f	Update README.md	2023-04-16 23:28:59 -03:00
oobabooga	39099663a0	Add 4-bit LoRA support (#1200)	2023-04-16 23:26:52 -03:00
oobabooga	705121161b	Update README.md	2023-04-16 20:03:03 -03:00
oobabooga	50c55a51fc	Update README.md	2023-04-16 19:22:31 -03:00
Forkoz	c6fe1ced01	Add ChatGLM support (#1256) ... --------- Co-authored-by: oobabooga <112222186+oobabooga@users.noreply.github.com>	2023-04-16 19:15:03 -03:00
oobabooga	c96529a1b3	Update README.md	2023-04-16 17:00:03 -03:00
oobabooga	004f275efe	Update README.md	2023-04-14 23:36:56 -03:00
oobabooga	83964ed354	Update README.md	2023-04-14 23:33:54 -03:00
oobabooga	c41037db68	Update README.md	2023-04-14 23:32:39 -03:00
v0xie	9d66957207	Add --listen-host launch option (#1122)	2023-04-13 21:35:08 -03:00
oobabooga	403be8a27f	Update README.md	2023-04-13 21:23:35 -03:00
Light	97e67d136b	Update README.md	2023-04-13 21:00:58 +08:00
Light	15d5a043f2	Merge remote-tracking branch 'origin/main' into triton	2023-04-13 19:38:51 +08:00
oobabooga	7dfbe54f42	Add --model-menu option	2023-04-12 21:24:26 -03:00
MarlinMr	47daf891fe	Link to developer.nvidia.com (#1104)	2023-04-12 15:56:42 -03:00
Light	f3591ccfa1	Keep minimal change.	2023-04-12 23:26:06 +08:00
oobabooga	461ca7faf5	Mention that pull request reviews are welcome	2023-04-11 23:12:48 -03:00
oobabooga	749c08a4ff	Update README.md	2023-04-11 14:42:10 -03:00
IggoOnCode	09d8119e3c	Add CPU LoRA training (#938) ... (It's very slow)	2023-04-10 17:29:00 -03:00
oobabooga	f035b01823	Update README.md	2023-04-10 16:20:23 -03:00
Jeff Lefebvre	b7ca89ba3f	Mention that build-essential is required (#1013)	2023-04-10 16:19:10 -03:00
MarkovInequality	992663fa20	Added xformers support to Llama (#950)	2023-04-09 23:08:40 -03:00
oobabooga	bce1b7fbb2	Update README.md	2023-04-09 02:19:40 -03:00
oobabooga	f7860ce192	Update README.md	2023-04-09 02:19:17 -03:00
oobabooga	ece8ed2c84	Update README.md	2023-04-09 02:18:42 -03:00
MarlinMr	ec979cd9c4	Use updated docker compose (#877)	2023-04-07 10:48:47 -03:00
MarlinMr	2c0018d946	Cosmetic change of README.md (#878)	2023-04-07 10:47:10 -03:00
oobabooga	848c4edfd5	Update README.md	2023-04-06 22:52:35 -03:00
oobabooga	e047cd1def	Update README	2023-04-06 22:50:58 -03:00
loeken	08b9d1b23a	creating a layer with Docker/docker-compose (#633)	2023-04-06 22:46:04 -03:00
oobabooga	d9e7aba714	Update README.md	2023-04-06 13:42:24 -03:00
oobabooga	eec3665845	Add instructions for updating requirements	2023-04-06 13:24:01 -03:00
oobabooga	4a28f39823	Update README.md	2023-04-06 02:47:27 -03:00
eiery	19b516b11b	fix link to streaming api example (#803)	2023-04-05 14:50:23 -03:00
oobabooga	7617ed5bfd	Add AMD instructions	2023-04-05 14:42:58 -03:00
oobabooga	770ef5744f	Update README	2023-04-05 14:38:11 -03:00
oobabooga	65d8a24a6d	Show profile pictures in the Character tab	2023-04-04 22:28:49 -03:00
oobabooga	b24147c7ca	Document --pre_layer	2023-04-03 17:34:25 -03:00
oobabooga	525f729b8e	Update README.md	2023-04-02 21:12:41 -03:00
oobabooga	53084241b4	Update README.md	2023-04-02 20:50:06 -03:00
oobabooga	b6f817be45	Update README.md	2023-04-01 14:54:10 -03:00
oobabooga	88fa38ac01	Update README.md	2023-04-01 14:49:03 -03:00
oobabooga	4b57bd0d99	Update README.md	2023-04-01 14:38:04 -03:00
oobabooga	b53bec5a1f	Update README.md	2023-04-01 14:37:35 -03:00
oobabooga	9160586c04	Update README.md	2023-04-01 14:31:10 -03:00
oobabooga	7ec11ae000	Update README.md	2023-04-01 14:15:19 -03:00
oobabooga	012f4f83b8	Update README.md	2023-04-01 13:55:15 -03:00
oobabooga	2c52310642	Add --threads flag for llama.cpp	2023-03-31 21:18:05 -03:00
oobabooga	cbfe0b944a	Update README.md	2023-03-31 17:49:11 -03:00
oobabooga	5c4e44b452	llama.cpp documentation	2023-03-31 15:20:39 -03:00
oobabooga	d4a9b5ea97	Remove redundant preset (see the plot in #587)	2023-03-30 17:34:44 -03:00
oobabooga	41b58bc47e	Update README.md	2023-03-29 11:02:29 -03:00
oobabooga	3b4447a4fe	Update README.md	2023-03-29 02:24:11 -03:00
oobabooga	5d0b83c341	Update README.md	2023-03-29 02:22:19 -03:00
oobabooga	c2a863f87d	Mention the updated one-click installer	2023-03-29 02:11:51 -03:00
oobabooga	010b259dde	Update documentation	2023-03-28 17:46:00 -03:00
oobabooga	036163a751	Change description	2023-03-27 23:39:26 -03:00
oobabooga	30585b3e71	Update README	2023-03-27 23:35:01 -03:00
oobabooga	49c10c5570	Add support for the latest GPTQ models with group-size (#530) ... **Warning: old 4-bit weights will not work anymore!** See here how to get up to date weights: https://github.com/oobabooga/text-generation-webui/wiki/LLaMA-model#step-2-get-the-pre-converted-weights	2023-03-26 00:11:33 -03:00
oobabooga	70f9565f37	Update README.md	2023-03-25 02:35:30 -03:00
oobabooga	04417b658b	Update README.md	2023-03-24 01:40:43 -03:00
oobabooga	143b5b5edf	Mention one-click-bandaid in the README	2023-03-23 23:28:50 -03:00
oobabooga	6872ffd976	Update README.md	2023-03-20 16:53:14 -03:00
oobabooga	dd4374edde	Update README	2023-03-19 20:15:15 -03:00
oobabooga	9378754cc7	Update README	2023-03-19 20:14:50 -03:00
oobabooga	7ddf6147ac	Update README.md	2023-03-19 19:25:52 -03:00
oobabooga	ddb62470e9	--no-cache and --gpu-memory in MiB for fine VRAM control	2023-03-19 19:21:41 -03:00
oobabooga	0cbe2dd7e9	Update README.md	2023-03-18 12:24:54 -03:00
oobabooga	d2a7fac8ea	Use pip instead of conda for pytorch	2023-03-18 11:56:04 -03:00
oobabooga	a0b1a30fd5	Specify torchvision/torchaudio versions	2023-03-18 11:23:56 -03:00
oobabooga	a163807f86	Update README.md	2023-03-18 03:07:27 -03:00
oobabooga	a7acfa4893	Update README.md	2023-03-17 22:57:46 -03:00
oobabooga	dc35861184	Update README.md	2023-03-17 21:05:17 -03:00
oobabooga	f2a5ca7d49	Update README.md	2023-03-17 20:50:27 -03:00
oobabooga	8c8286b0e6	Update README.md	2023-03-17 20:49:40 -03:00
oobabooga	0c05e65e5c	Update README.md	2023-03-17 20:25:42 -03:00
oobabooga	66e8d12354	Update README.md	2023-03-17 19:59:37 -03:00
oobabooga	9a871117d7	Update README.md	2023-03-17 19:52:22 -03:00
oobabooga	d4f38b6a1f	Update README.md	2023-03-17 18:57:48 -03:00
oobabooga	ad7c829953	Update README.md	2023-03-17 18:55:01 -03:00
oobabooga	4426f941e0	Update the installation instructions. Tldr use WSL	2023-03-17 18:51:07 -03:00
oobabooga	ebef4a510b	Update README	2023-03-17 11:58:45 -03:00
oobabooga	cdfa787bcb	Update README	2023-03-17 11:53:28 -03:00
oobabooga	dd1c5963da	Update README	2023-03-16 12:45:27 -03:00
oobabooga	445ebf0ba8	Update README.md	2023-03-15 20:06:46 -03:00
oobabooga	09045e4bdb	Add WSL guide	2023-03-15 19:42:06 -03:00
oobabooga	128d18e298	Update README.md	2023-03-14 17:57:25 -03:00
oobabooga	1236c7f971	Update README.md	2023-03-14 17:56:15 -03:00
oobabooga	b419dffba3	Update README.md	2023-03-14 17:55:35 -03:00
oobabooga	87192e2813	Update README	2023-03-14 08:02:21 -03:00
oobabooga	3da73e409f	Merge branch 'main' into Zerogoki00-opt4-bit	2023-03-14 07:50:36 -03:00
Ayanami Rei	b746250b2f	Update README	2023-03-13 20:20:45 +03:00
oobabooga	66b6971b61	Update README	2023-03-13 12:44:18 -03:00
oobabooga	ddea518e0f	Document --auto-launch	2023-03-13 12:43:33 -03:00
oobabooga	d97bfb8713	Update README.md	2023-03-13 12:39:33 -03:00
oobabooga	bdff37f0bb	Update README.md	2023-03-13 11:05:51 -03:00
oobabooga	d168b6e1f7	Update README.md	2023-03-12 17:54:07 -03:00
oobabooga	54e8f0c31f	Update README.md	2023-03-12 16:58:00 -03:00
oobabooga	0a4d8a5cf6	Delete README.md	2023-03-12 16:43:06 -03:00
oobabooga	0b86ac38b1	Initial commit	2023-03-12 16:40:10 -03:00
oobabooga	3375eaece0	Update README	2023-03-12 15:01:32 -03:00
oobabooga	17210ff88f	Update README.md	2023-03-12 14:31:24 -03:00
oobabooga	4dc1d8c091	Update README.md	2023-03-12 12:46:53 -03:00
oobabooga	89e9493509	Update README	2023-03-12 11:23:20 -03:00
draff	28fd4fc970	Change wording to be consistent with other args	2023-03-10 23:34:13 +00:00
draff	804486214b	Re-implement --load-in-4bit and update --llama-bits arg description	2023-03-10 23:21:01 +00:00
draff	e6c631aea4	Replace --load-in-4bit with --llama-bits ... Replaces --load-in-4bit with a more flexible --llama-bits arg to allow for 2 and 3 bit models as well. This commit also fixes a loading issue with .pt files which are not in the root of the models folder	2023-03-10 21:36:45 +00:00
oobabooga	7c3d1b43c1	Merge pull request #204 from MichealC0/patch-1 ... Update README.md	2023-03-09 23:04:09 -03:00
oobabooga	1a3d25f75d	Merge pull request #206 from oobabooga/llama-4bit ... Add LLaMA 4-bit support	2023-03-09 21:07:32 -03:00
oobabooga	eb0cb9b6df	Update README	2023-03-09 20:53:52 -03:00
oobabooga	d41e3c233b	Update README.md	2023-03-09 18:02:44 -03:00
oobabooga	33414478bf	Update README	2023-03-09 11:13:03 -03:00
oobabooga	e7adf5fe4e	Add Contrastive Search preset #197	2023-03-09 10:27:11 -03:00
Chimdumebi Nebolisa	4dd14dcab4	Update README.md	2023-03-09 10:22:09 +01:00
oobabooga	b4bfd87319	Update README.md	2023-03-06 20:55:01 -03:00
oobabooga	d0e8780555	Update README.md	2023-03-06 20:17:59 -03:00
oobabooga	18ccfcd7fe	Update README.md	2023-03-06 20:15:55 -03:00
oobabooga	91823e1ed1	Update README.md	2023-03-06 16:48:31 -03:00
oobabooga	aa7ce0665e	Merge branch 'main' of github.com:oobabooga/text-generation-webui	2023-03-06 10:58:41 -03:00
oobabooga	bf56b6c1fb	Load settings.json without the need for --settings settings.json ... This is for setting UI defaults	2023-03-06 10:57:45 -03:00
oobabooga	2de9f122cd	Update README.md	2023-03-06 09:34:49 -03:00
oobabooga	736f61610b	Update README	2023-03-04 01:33:52 -03:00
oobabooga	76378c6cc2	Update README	2023-03-02 11:27:15 -03:00
oobabooga	f4b130e2bd	Update README.md	2023-02-27 15:15:45 -03:00
oobabooga	c183d2917c	Update README.md	2023-02-26 00:59:07 -03:00
oobabooga	cfe010b244	Update README.md	2023-02-26 00:54:37 -03:00
oobabooga	87d9f3e329	Update README.md	2023-02-26 00:54:19 -03:00
oobabooga	955997a90b	Update README.md	2023-02-26 00:54:07 -03:00
oobabooga	c593dfa827	Update README.md	2023-02-25 18:57:34 -03:00
oobabooga	7872a64f78	Update README.md	2023-02-25 18:56:43 -03:00
oobabooga	88cfc84ddb	Update README	2023-02-25 01:33:26 -03:00
oobabooga	0b90e0b3b6	Update README.md	2023-02-24 12:01:07 -03:00
oobabooga	1a23e6d185	Add Pythia to README	2023-02-24 11:38:01 -03:00
oobabooga	f4f508c8e2	Update README.md	2023-02-24 09:03:09 -03:00
oobabooga	ced5d9ab04	Update README.md	2023-02-23 10:04:07 -03:00
oobabooga	b18071330f	Update README.md	2023-02-23 01:32:05 -03:00
oobabooga	b4a7f5fa70	Update README.md	2023-02-22 01:54:12 -03:00
oobabooga	e195377050	Deprecate torch dumps, move to safetensors (they load even faster)	2023-02-20 15:03:19 -03:00
oobabooga	58520a1f75	Update README.md	2023-02-20 12:44:31 -03:00
oobabooga	05e9da0c12	Update README.md	2023-02-18 22:34:51 -03:00
oobabooga	b1add0e586	Update README.md	2023-02-18 22:32:16 -03:00
oobabooga	348acdf626	Mention deepspeed in the README	2023-02-16 17:29:48 -03:00
oobabooga	05b53e4626	Update README	2023-02-15 14:43:34 -03:00
oobabooga	ed73d00bd5	Update README	2023-02-15 14:43:13 -03:00
oobabooga	30fcb26737	Update README	2023-02-15 14:42:41 -03:00
oobabooga	5ee9283cae	Mention BLIP	2023-02-15 13:53:38 -03:00
oobabooga	8d3b3959e7	Document --picture option	2023-02-15 13:50:18 -03:00
oobabooga	01e5772302	Update README.md	2023-02-14 13:06:26 -03:00
oobabooga	210c918199	Update README.md	2023-02-13 21:49:19 -03:00
oobabooga	b7ddcab53a	Update README.md	2023-02-13 15:52:49 -03:00
oobabooga	939e9d00a2	Update README.md	2023-02-12 00:47:03 -03:00
oobabooga	bf9dd8f8ee	Add --text-only option to the download script	2023-02-12 00:42:56 -03:00
oobabooga	42cc307409	Update README.md	2023-02-12 00:34:55 -03:00
oobabooga	144857acfe	Update README	2023-02-11 14:49:11 -03:00
oobabooga	0dd1409f24	Add penalty_alpha parameter (contrastive search)	2023-02-11 14:48:12 -03:00
oobabooga	8aafb55693	1-click installer now also works for AMD GPUs ... (I think)	2023-02-11 14:24:47 -03:00
oobabooga	1176d64b13	Update README.md	2023-02-11 07:56:12 -03:00
Spencer-Dawson	c5324d653b	re-added missed README changes	2023-02-11 00:13:06 -07:00
oobabooga	cf89ef1c74	Update README.md	2023-02-10 21:46:29 -03:00
oobabooga	8782ac1911	Update README.md	2023-02-10 17:10:27 -03:00
oobabooga	7d7cc37560	Add Linux 1-click installer	2023-02-10 17:09:53 -03:00
oobabooga	991de5ed40	Update README.md	2023-02-09 14:36:47 -03:00
oobabooga	04d3d0aee6	Add 1-click windows installer (for #45)	2023-02-09 13:27:30 -03:00
oobabooga	a21620fc59	Update README	2023-02-08 01:17:50 -03:00
oobabooga	fc0493d885	Add credits	2023-02-08 00:09:41 -03:00
oobabooga	53af062fa5	Update README.md	2023-02-05 23:14:25 -03:00
oobabooga	90bb2caffd	Update README.md	2023-02-03 19:45:11 -03:00
oobabooga	93b0d1b1b8	Update README.md	2023-02-03 10:14:52 -03:00
oobabooga	6212b41930	Update README	2023-02-03 09:13:14 -03:00
oobabooga	7f4315b120	Mention 8bit fix for Windows users ... Closes #44, #20	2023-02-02 11:00:57 -03:00
oobabooga	7aa3d6583e	Update README.md	2023-01-30 09:45:31 -03:00
oobabooga	239f96a9c5	Add extensions guide	2023-01-30 09:44:57 -03:00
oobabooga	f92996b3c8	Update README.md	2023-01-29 14:37:05 -03:00
oobabooga	9e4db10cd0	Update README.md	2023-01-29 03:13:22 -03:00
oobabooga	1a139664f5	Grammar	2023-01-29 02:54:36 -03:00
oobabooga	89c862b179	Update README	2023-01-28 20:37:43 -03:00
oobabooga	6b5dcd46c5	Add support for extensions ... This is experimental.	2023-01-27 00:40:39 -03:00
oobabooga	d49710878e	Update README.md	2023-01-26 16:17:15 -03:00
oobabooga	ff180f3e60	Update installation instructions (for #15)	2023-01-26 12:32:21 -03:00
oobabooga	61611197e0	Add --verbose option (oops)	2023-01-26 02:18:06 -03:00
oobabooga	64f278d248	Update README	2023-01-25 19:43:30 -03:00
oobabooga	b77933d327	File names must be img_me.jpg and img_bot.jpg	2023-01-25 19:40:30 -03:00
oobabooga	fc73188ec7	Allow specifying your own profile picture in chat mode	2023-01-25 19:37:44 -03:00
oobabooga	651eb50dd1	Merge branch 'main' of github.com:oobabooga/text-generation-webui	2023-01-25 10:20:03 -03:00
oobabooga	3b8f0021cc	Stop generating at \nYou: in chat mode	2023-01-25 10:17:55 -03:00
oobabooga	befabbb862	Update README.md	2023-01-24 23:01:43 -03:00
oobabooga	7b98971df1	Update README.md	2023-01-24 18:39:29 -03:00
oobabooga	86b237eb0b	Update README.md	2023-01-24 09:29:34 -03:00
oobabooga	c2d1f04305	Update README.md	2023-01-23 23:34:20 -03:00
oobabooga	6c40f7eeb4	New NovelAI/KoboldAI preset selection	2023-01-23 20:44:27 -03:00
oobabooga	22845ba445	Update README	2023-01-23 13:41:50 -03:00
oobabooga	5b60691367	Update README	2023-01-23 10:05:25 -03:00
oobabooga	085d5cbcb9	Update README	2023-01-23 10:03:19 -03:00
oobabooga	8a68930220	Update README	2023-01-23 10:02:35 -03:00
oobabooga	3c5454c6f8	Update README	2023-01-22 19:38:07 -03:00
oobabooga	8f37383dc6	Update README	2023-01-22 19:29:24 -03:00
oobabooga	9592e7e618	Update README	2023-01-22 19:28:03 -03:00
oobabooga	c410fe5ab8	Add simplified colab notebook	2023-01-22 19:27:30 -03:00
oobabooga	41806fe40d	Update chat screenshot	2023-01-22 17:28:51 -03:00
oobabooga	00f3b0996b	Warn the user that chat mode becomes a lot slower with text streaming	2023-01-22 16:19:11 -03:00
oobabooga	5b50db9dee	Mention pygmalion support	2023-01-22 01:30:55 -03:00
oobabooga	6b06fca2f1	Mention pygmalion support	2023-01-22 01:28:52 -03:00
oobabooga	434d4b128c	Add refresh buttons for the model/preset/character menus	2023-01-22 00:02:46 -03:00
oobabooga	bc664ecf3b	Update the installation instructions for low attention span people	2023-01-21 22:54:35 -03:00
oobabooga	f9dbe7e08e	Update README	2023-01-21 03:05:55 -03:00
oobabooga	990ee54ddd	Move the example dialogue to the chat history, and keep it hidden. ... This greatly improves the performance of text generation, as histories can be quite long. It also makes more sense to implement it this way.	2023-01-21 02:48:06 -03:00
oobabooga	d7299df01f	Rename parameters	2023-01-21 00:33:41 -03:00
oobabooga	5df03bf0fd	Merge branch 'main' into main	2023-01-21 00:25:34 -03:00
oobabooga	faaafe7c0e	Better parameter naming	2023-01-20 23:45:16 -03:00
Silver267	f4634e4c32	Update.	2023-01-20 17:05:43 -05:00
oobabooga	83584ae2d7	Clearer installation instructions	2023-01-20 00:20:35 -03:00
oobabooga	8d4170826f	Update README	2023-01-19 21:08:26 -03:00
oobabooga	cd7b07239f	Add Colab guide	2023-01-19 17:58:04 -03:00
oobabooga	83808171d3	Add --share option for Colab	2023-01-19 17:31:29 -03:00
oobabooga	b054367be2	Update README	2023-01-19 16:54:58 -03:00
oobabooga	f9faad4cfa	Add low VRAM guide	2023-01-19 11:25:17 -03:00
oobabooga	7ace04864a	Implement sending layers to disk with --disk (#10)	2023-01-19 11:09:24 -03:00
oobabooga	1ce95ee817	Mention text streaming	2023-01-19 10:46:41 -03:00
oobabooga	93fa9bbe01	Clean up the streaming implementation	2023-01-19 10:43:05 -03:00
oobabooga	6456777b09	Clean things up	2023-01-16 16:35:45 -03:00
oobabooga	99d24bdbfe	Update README.md	2023-01-16 11:23:45 -03:00
oobabooga	ed1d2c0d38	Update README.md	2023-01-16 11:19:23 -03:00
oobabooga	82c50a09b2	Update README.md	2023-01-16 10:31:13 -03:00
oobabooga	3a28865eb2	Update README.md	2023-01-16 10:07:00 -03:00
oobabooga	18626c4788	Update README.md	2023-01-16 01:51:59 -03:00
oobabooga	a3bb18002a	Update README	2023-01-15 22:34:56 -03:00
oobabooga	ebf4d5f506	Add --max-gpu-memory parameter for #7	2023-01-15 22:33:35 -03:00
oobabooga	e6691bd920	Make chat mode more like cai	2023-01-15 18:16:46 -03:00
oobabooga	9f1b6e0398	Update README	2023-01-15 16:50:58 -03:00