diff --git a/README.md b/README.md index 98b296d1..531f373f 100644 --- a/README.md +++ b/README.md @@ -67,13 +67,6 @@ bash Miniconda3.sh ``` Source: https://educe-ubc.github.io/conda.html -#### 0.1 (Ubuntu/WSL) Install build tools - -``` -sudo apt install build-essential -``` - - #### 1. Create a new conda environment ``` @@ -104,6 +97,14 @@ cd text-generation-webui pip install -r requirements.txt ``` +#### 4. Install GPTQ-for-LLaMa and the monkey patch + +The base installation covers regular transformers models as well as llama.cpp (GGML) models. + +To use 4-bit GPU models, the additional installation steps below are necessary: + +[GPTQ models (4 bit mode)](https://github.com/oobabooga/text-generation-webui/blob/main/docs/GPTQ-models-(4-bit-mode).md) + ### Alternative: manual Windows installation As an alternative to the recommended WSL method, you can install the web UI natively on Windows using this guide. It will be a lot harder and the performance may be slower: [Windows installation guide](https://github.com/oobabooga/text-generation-webui/blob/main/docs/Windows-installation-guide.md).