Mirrors/text-generation-webui
1
0
Fork 0
mirror of https://github.com/oobabooga/text-generation-webui.git synced 2024-11-22 08:07:56 +01:00
Code Issues Packages Projects Releases Wiki Activity

Update ExLlama.md

Browse Source
This commit is contained in:
oobabooga 2023-06-16 20:40:12 -03:00 committed by GitHub
parent 83be8eacf0
commit cb9be5db1c
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 3 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

5
docs/ExLlama.md
View File

@ -4,11 +4,12 @@
ExLlama is an extremely optimized GPTQ backend for LLaMA models. It features much lower VRAM usage and much higher speeds due to not relying on unoptimized transformers code. ExLlama is an extremely optimized GPTQ backend for LLaMA models. It features much lower VRAM usage and much higher speeds due to not relying on unoptimized transformers code.
# Installation: ## Installation:
1) Clone the ExLlama repository into your `repositories` folder: 1) Clone the ExLlama repository into your `text-generation-webui/repositories` folder:
``` ```
mkdir repositories
cd repositories cd repositories
git clone https://github.com/turboderp/exllama git clone https://github.com/turboderp/exllama
``` ```