Mirrors/text-generation-webui
1
0
Fork 0
mirror of https://github.com/oobabooga/text-generation-webui.git synced 2024-11-25 17:29:22 +01:00
Code Issues Packages Projects Releases Wiki Activity

Update README.md

Browse Source
This commit is contained in:
oobabooga 2023-05-11 09:42:39 -03:00 committed by GitHub
parent 943b5e5f80
commit 7a49ceab29
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 8 additions and 7 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

15
README.md
View File

@ -67,13 +67,6 @@ bash Miniconda3.sh
```
Source: https://educe-ubc.github.io/conda.html
#### 0.1 (Ubuntu/WSL) Install build tools
```
sudo apt install build-essential
```
#### 1. Create a new conda environment
```
@ -104,6 +97,14 @@ cd text-generation-webui
pip install -r requirements.txt
```
#### 4. Install GPTQ-for-LLaMa and the monkey patch
The base installation covers regular transformers models as well as llama.cpp (GGML) models.
To use 4-bit GPU models, the additional installation steps below are necessary:
[GPTQ models (4 bit mode)](https://github.com/oobabooga/text-generation-webui/blob/main/docs/GPTQ-models-(4-bit-mode).md)
### Alternative: manual Windows installation
As an alternative to the recommended WSL method, you can install the web UI natively on Windows using this guide. It will be a lot harder and the performance may be slower: [Windows installation guide](https://github.com/oobabooga/text-generation-webui/blob/main/docs/Windows-installation-guide.md).