From a0b1a30fd563cc80fe653f6ba588ea19bde40fe7 Mon Sep 17 00:00:00 2001 From: oobabooga <112222186+oobabooga@users.noreply.github.com> Date: Sat, 18 Mar 2023 11:23:56 -0300 Subject: [PATCH 1/4] Specify torchvision/torchaudio versions --- README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/README.md b/README.md index 0d16fa35..407d8e46 100644 --- a/README.md +++ b/README.md @@ -63,7 +63,7 @@ conda activate textgen | System | GPU | Command | |--------|---------|---------| -| Linux/WSL | NVIDIA | `conda install pytorch torchvision torchaudio pytorch-cuda=11.7 -c pytorch -c nvidia` | +| Linux/WSL | NVIDIA | `conda install torchvision=0.14.1 torchaudio=0.13.1 pytorch-cuda=11.7 -c pytorch -c nvidia` | | Linux | AMD | `pip3 install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/rocm5.4.2` | | MacOS + MPS (untested) | Any | `conda install pytorch torchvision torchaudio -c pytorch` | From 705f513c4c1209651dac9242608399451ec6c06b Mon Sep 17 00:00:00 2001 From: ThisIsPIRI Date: Sat, 18 Mar 2023 23:33:24 +0900 Subject: [PATCH 2/4] Add loras to .gitignore --- .gitignore | 2 ++ 1 file changed, 2 insertions(+) diff --git a/.gitignore b/.gitignore index d98b81d8..702bb1eb 100644 --- a/.gitignore +++ b/.gitignore @@ -3,6 +3,7 @@ characters/* extensions/silero_tts/outputs/* extensions/elevenlabs_tts/outputs/* logs/* +loras/* models/* softprompts/* torch-dumps/* @@ -18,6 +19,7 @@ img_me* !characters/Example.json !characters/Example.png +!loras/place-your-loras-here.txt !models/place-your-models-here.txt !softprompts/place-your-softprompts-here.txt !torch-dumps/place-your-pt-models-here.txt From d2a7fac8ea673ec29c82e41f68b50ac63a6c3d2e Mon Sep 17 00:00:00 2001 From: oobabooga <112222186+oobabooga@users.noreply.github.com> Date: Sat, 18 Mar 2023 11:56:04 -0300 Subject: [PATCH 3/4] Use pip instead of conda for pytorch --- README.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/README.md b/README.md index 407d8e46..078671af 100644 --- a/README.md +++ b/README.md @@ -63,9 +63,9 @@ conda activate textgen | System | GPU | Command | |--------|---------|---------| -| Linux/WSL | NVIDIA | `conda install torchvision=0.14.1 torchaudio=0.13.1 pytorch-cuda=11.7 -c pytorch -c nvidia` | +| Linux/WSL | NVIDIA | `pip3 install torch torchvision torchaudio` | | Linux | AMD | `pip3 install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/rocm5.4.2` | -| MacOS + MPS (untested) | Any | `conda install pytorch torchvision torchaudio -c pytorch` | +| MacOS + MPS (untested) | Any | `pip3 install torch torchvision torchaudio` | The up to date commands can be found here: https://pytorch.org/get-started/locally/. From 0cbe2dd7e9614746073cb56233b40e2cc24031ca Mon Sep 17 00:00:00 2001 From: oobabooga <112222186+oobabooga@users.noreply.github.com> Date: Sat, 18 Mar 2023 12:24:54 -0300 Subject: [PATCH 4/4] Update README.md --- README.md | 5 ++++- 1 file changed, 4 insertions(+), 1 deletion(-) diff --git a/README.md b/README.md index 078671af..ded9b351 100644 --- a/README.md +++ b/README.md @@ -71,6 +71,7 @@ The up to date commands can be found here: https://pytorch.org/get-started/local MacOS users, refer to the comments here: https://github.com/oobabooga/text-generation-webui/pull/393 + #### 3. Install the web UI ``` @@ -79,7 +80,9 @@ cd text-generation-webui pip install -r requirements.txt ``` -If you experience bitsandbytes issues on WSL while trying to use `--load-in-8bit`, see this comment: https://github.com/TimDettmers/bitsandbytes/issues/156#issuecomment-1462329713 +> **Note** +> +> For bitsandbytes and `--load-in-8bit` to work on Linux/WSL, this dirty fix is currently necessary: https://github.com/oobabooga/text-generation-webui/issues/400#issuecomment-1474876859 ### Alternative: native Windows installation