mirror of
https://github.com/oobabooga/text-generation-webui.git
synced 2024-12-23 21:18:00 +01:00
e6c631aea4
Replaces --load-in-4bit with a more flexible --llama-bits arg to allow for 2 and 3 bit models as well. This commit also fixes a loading issue with .pt files which are not in the root of the models folder |
||
---|---|---|
.. | ||
chat.py | ||
deepspeed_parameters.py | ||
extensions.py | ||
html_generator.py | ||
models.py | ||
RWKV.py | ||
shared.py | ||
stopping_criteria.py | ||
text_generation.py | ||
ui.py |