From 7f4315b120e10fa2f012bf204fdd0bc5d344c64d Mon Sep 17 00:00:00 2001 From: oobabooga <112222186+oobabooga@users.noreply.github.com> Date: Thu, 2 Feb 2023 11:00:57 -0300 Subject: [PATCH] Mention 8bit fix for Windows users Closes #44, #20 --- README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/README.md b/README.md index 0c5a5929..889b9c27 100644 --- a/README.md +++ b/README.md @@ -20,7 +20,7 @@ Its goal is to become the [AUTOMATIC1111/stable-diffusion-webui](https://github. * Support for [Pygmalion](https://huggingface.co/models?search=pygmalionai/pygmalion) and custom characters in JSON or TavernAI Character Card formats ([see the FAQ](https://github.com/oobabooga/text-generation-webui/wiki/Pygmalion-chat-model-FAQ)). * Stream the text output in real time. * Load parameter presets from text files. -* Load large models in 8-bit mode. +* Load large models in 8-bit mode ([see here](https://github.com/oobabooga/text-generation-webui/issues/20#issuecomment-1411650652) if you are on Windows). * Split large models across your GPU(s), CPU, and disk. * CPU mode. * Get responses via API.