diff --git a/docs/ExLlama.md b/docs/ExLlama.md index a0968927..a9fd016d 100644 --- a/docs/ExLlama.md +++ b/docs/ExLlama.md @@ -4,11 +4,12 @@ ExLlama is an extremely optimized GPTQ backend for LLaMA models. It features much lower VRAM usage and much higher speeds due to not relying on unoptimized transformers code. -# Installation: +## Installation: -1) Clone the ExLlama repository into your `repositories` folder: +1) Clone the ExLlama repository into your `text-generation-webui/repositories` folder: ``` +mkdir repositories cd repositories git clone https://github.com/turboderp/exllama ```