diff --git a/.gitignore b/.gitignore index d98b81d8..702bb1eb 100644 --- a/.gitignore +++ b/.gitignore @@ -3,6 +3,7 @@ characters/* extensions/silero_tts/outputs/* extensions/elevenlabs_tts/outputs/* logs/* +loras/* models/* softprompts/* torch-dumps/* @@ -18,6 +19,7 @@ img_me* !characters/Example.json !characters/Example.png +!loras/place-your-loras-here.txt !models/place-your-models-here.txt !softprompts/place-your-softprompts-here.txt !torch-dumps/place-your-pt-models-here.txt diff --git a/README.md b/README.md index 0d16fa35..ded9b351 100644 --- a/README.md +++ b/README.md @@ -63,14 +63,15 @@ conda activate textgen | System | GPU | Command | |--------|---------|---------| -| Linux/WSL | NVIDIA | `conda install pytorch torchvision torchaudio pytorch-cuda=11.7 -c pytorch -c nvidia` | +| Linux/WSL | NVIDIA | `pip3 install torch torchvision torchaudio` | | Linux | AMD | `pip3 install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/rocm5.4.2` | -| MacOS + MPS (untested) | Any | `conda install pytorch torchvision torchaudio -c pytorch` | +| MacOS + MPS (untested) | Any | `pip3 install torch torchvision torchaudio` | The up to date commands can be found here: https://pytorch.org/get-started/locally/. MacOS users, refer to the comments here: https://github.com/oobabooga/text-generation-webui/pull/393 + #### 3. Install the web UI ``` @@ -79,7 +80,9 @@ cd text-generation-webui pip install -r requirements.txt ``` -If you experience bitsandbytes issues on WSL while trying to use `--load-in-8bit`, see this comment: https://github.com/TimDettmers/bitsandbytes/issues/156#issuecomment-1462329713 +> **Note** +> +> For bitsandbytes and `--load-in-8bit` to work on Linux/WSL, this dirty fix is currently necessary: https://github.com/oobabooga/text-generation-webui/issues/400#issuecomment-1474876859 ### Alternative: native Windows installation