From c7f2f490656a03eb9f815bac8756df3ab7c71e9c Mon Sep 17 00:00:00 2001 From: oobabooga <112222186+oobabooga@users.noreply.github.com> Date: Thu, 13 Jun 2024 00:43:18 -0300 Subject: [PATCH] Updated Home (markdown) --- Home.md | 19 ++++++++----------- 1 file changed, 8 insertions(+), 11 deletions(-) diff --git a/Home.md b/Home.md index 4f5defa..80abdc7 100644 --- a/Home.md +++ b/Home.md @@ -2,15 +2,14 @@ | Loader | Loading 1 LoRA | Loading 2 or more LoRAs | Training LoRAs | Multimodal extension | Perplexity evaluation | |----------------|----------------|-------------------------|----------------|----------------------|-----------------------| -| Transformers | ✅ | ✅*** | ✅* | ✅ | ✅ | -| ExLlamav2_HF | ✅ | ✅ | ❌ | ❌ | ✅ | -| ExLlamav2 | ✅ | ✅ | ❌ | ❌ | use ExLlamav2_HF | -| AutoGPTQ | ✅ | ❌ | ❌ | ✅ | ✅ | -| GPTQ-for-LLaMa | ✅** | ✅*** | ✅ | ✅ | ✅ | -| llama.cpp | ❌ | ❌ | ❌ | ❌ | use llamacpp_HF | +| Transformers | ✅ | ✅\*\* | ✅\* | ✅ | ✅ | +| llama.cpp | ❌ | ❌ | ❌ | ❌ | use llamacpp_HF | | llamacpp_HF | ❌ | ❌ | ❌ | ❌ | ✅ | -| ctransformers | ❌ | ❌ | ❌ | ❌ | ❌ | -| AutoAWQ | ? | ❌ | ? | ? | ✅ | +| ExLlamav2_HF | ✅ | ✅ | ❌ | ❌ | ✅ | +| ExLlamav2 | ✅ | ✅ | ❌ | ❌ | use ExLlamav2_HF | +| AutoGPTQ | ✅ | ❌ | ❌ | ✅ | ✅ | +| AutoAWQ | ? | ❌ | ? | ? | ✅ | +| HQQ | ? | ? | ? | ? | ✅ | ❌ = not implemented @@ -18,6 +17,4 @@ \* Training LoRAs with GPTQ models also works with the Transformers loader. Make sure to check "auto-devices" and "disable_exllama" before loading the model. -\*\* Requires the monkey-patch. The instructions can be found [here](https://github.com/oobabooga/text-generation-webui/wiki/08-%E2%80%90-Additional-Tips#using-loras-with-gptq-for-llama). - -\*\*\* Multi-LoRA in PEFT is tricky and the current implementation does not work reliably in all cases. +\*\* Multi-LoRA in PEFT is tricky and the current implementation does not work reliably in all cases.