Mirrors/text-generation-webui
1
0
Fork 0
mirror of https://github.com/oobabooga/text-generation-webui.git synced 2024-11-26 17:50:22 +01:00
Code Issues Packages Projects Releases Wiki Activity
A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.
10 Commits 3 Branches 52 Tags 67 MiB
Python 90.6%
CSS 3.3%
JavaScript 3.1%
Shell 1.3%
Batchfile 0.7%
Other 1%
a80a5465f2
Go to file
jllllll a80a5465f2
Update install.bat 
Updated Conda packages and channels to install cuda-toolkit and override 12.0 cuda packages requested by pytorch with their 11.7 equivalent.
Removed Conda installation since we can use the downloaded Micromamba.exe for the same purpose with a smaller footprint.
Removed redundant PATH changes.
Changed %gpuchoice% comparisons to be case-insensitive.
Added additional error handling and removed the use of .tmp files.
Added missing extension requirements.
Added GPTQ installation. Will attempt to compile locally and, if failed, will download and install a precompiled wheel.
Incorporated fixes from one-click-bandaid.
Fixed and expanded first sed command from one-click-bandaid.
libbitsandbytes_cudaall.dll is used here as the cuda116.dll used by one-click-bandaid does not work on my 1080ti. This can be changed if needed.
2023-03-24 17:27:29 -05:00
download-model.bat Add files via upload 2023-03-12 16:42:50 -03:00
install.bat Update install.bat 2023-03-24 17:27:29 -05:00
INSTRUCTIONS.txt Add files via upload 2023-03-12 16:42:50 -03:00
start-webui.bat Add files via upload 2023-03-12 16:42:50 -03:00