2023-08-03 19:39:46 +02:00
|
|
|
Thank you for downloading oobabooga/text-generation-webui!
|
|
|
|
|
|
|
|
|
|
# Installation
|
|
|
|
|
|
|
|
|
|
Run the "start" script. It will install the web UI and all of its
|
|
|
|
|
dependencies inside this folder.
|
|
|
|
|
|
|
|
|
|
To launch the web UI in the future after it is already installed, run the
|
|
|
|
|
"start" script again.
|
|
|
|
|
|
|
|
|
|
# Updating the web UI
|
|
|
|
|
|
|
|
|
|
Run the "update" script. It will install the updates only, so it should
|
|
|
|
|
be much faster than the initial installation.
|
|
|
|
|
|
2023-08-13 06:13:50 +02:00
|
|
|
# Adding flags like --model, --api, etc
|
2023-08-03 19:39:46 +02:00
|
|
|
|
|
|
|
|
Open the "CMD_FLAGS.txt" file with a text editor, add your flags, and
|
|
|
|
|
save the file. For instance, to add the --api flag, change the file
|
|
|
|
|
contents to
|
|
|
|
|
|
2023-08-13 06:13:50 +02:00
|
|
|
--api
|
2023-08-03 19:39:46 +02:00
|
|
|
|
|
|
|
|
# Running an interactive shell
|
|
|
|
|
|
|
|
|
|
Sometimes you may need to install some additional Python package. To do
|
|
|
|
|
that, run the "cmd" script and type your commands inside the terminal
|
|
|
|
|
window that will appear.
|
|
|
|
|
|
|
|
|
|
# Using an AMD GPU in Linux
|
|
|
|
|
|
|
|
|
|
Requires ROCm SDK 5.4.2 or 5.4.3 to be installed. Some systems may also
|
|
|
|
|
need: sudo apt-get install libstdc++-12-dev
|
|
|
|
|
|
|
|
|
|
Edit the "webui.py" script using a text editor and un-comment and
|
|
|
|
|
modify the lines near the top of the script according to your setup. In
|
|
|
|
|
particular, modify the os.environ["ROCM_PATH"] = '/opt/rocm' line to
|
|
|
|
|
point to your ROCm installation.
|
