From 35aaeb645a8679cefe79ba35aabe2cc23cb65e41 Mon Sep 17 00:00:00 2001 From: oobabooga <112222186+oobabooga@users.noreply.github.com> Date: Sat, 21 Oct 2023 18:18:31 -0300 Subject: [PATCH] Updated Home (markdown) --- Home.md | 5 +++-- 1 file changed, 3 insertions(+), 2 deletions(-) diff --git a/Home.md b/Home.md index f918f8d..ff7a399 100644 --- a/Home.md +++ b/Home.md @@ -8,7 +8,7 @@ | ExLlama | ✅ | ❌ | ❌ | ❌ | use ExLlama_HF | | ExLlamav2 | ✅ | ✅ | ❌ | ❌ | use ExLlamav2_HF | | AutoGPTQ | ✅ | ❌ | ❌ | ✅ | ✅ | -| GPTQ-for-LLaMa | ✅ | ❌ | ✅ | ✅ | ✅ | +| GPTQ-for-LLaMa | ✅** | ❌ | ✅ | ✅ | ✅ | | llama.cpp | ❌ | ❌ | ❌ | ❌ | use llamacpp_HF | | llamacpp_HF | ❌ | ❌ | ❌ | ❌ | ✅ | | ctransformers | ❌ | ❌ | ❌ | ❌ | ❌ | @@ -17,4 +17,5 @@ ✅ = implemented -\* Training LoRAs with GPTQ models also works with the Transformers loader. Make sure to check "auto-devices" and "disable_exllama" before loading the model. \ No newline at end of file +\* Training LoRAs with GPTQ models also works with the Transformers loader. Make sure to check "auto-devices" and "disable_exllama" before loading the model. +\*\* Requires the monkey-patch. The instructions can be found [here](https://github.com/oobabooga/text-generation-webui/wiki/08-%E2%80%90-Additional-Tips#using-loras-with-gptq-for-llama). \ No newline at end of file