2.5 KiB
Additional one-click installers info
Installing nvcc
If you have an NVIDIA GPU and ever need to compile something, like ExLlamav2 (that currently doesn't have pre-built wheels), you can install nvcc by running the cmd_ script for your OS and entering this command:
conda install cuda -c nvidia/label/cuda-11.7.1
Using an AMD GPU in Linux
Requires ROCm SDK 5.4.2 or 5.4.3 to be installed. Some systems may also need: sudo apt-get install libstdc++-12-dev
Edit the "one_click.py" script using a text editor and un-comment and modify the lines near the top of the script according to your setup. In particular, modify the os.environ["ROCM_PATH"] = '/opt/rocm' line to point to your ROCm installation.
WSL instructions
If you do not have WSL installed, see here: https://learn.microsoft.com/en-us/windows/wsl/install
If you want to install Linux to a drive other than C Open powershell and enter these commands:
cd D:\Path\To\Linux $ProgressPreference = 'SilentlyContinue' Invoke-WebRequest -Uri -OutFile Linux.appx -UseBasicParsing mv Linux.appx Linux.zip
Then open Linux.zip and you should see several .appx files inside. The one with _x64.appx contains the exe installer that you need. Extract the contents of that _x64.appx file and run .exe to install.
Linux Distro URLs: https://learn.microsoft.com/en-us/windows/wsl/install-manual#downloading-distributions
ENSURE THAT THE WSL LINUX DISTRO THAT YOU WISH TO USE IS SET AS THE DEFAULT!
Do this by using these commands: wsl -l wsl -s
Web UI Installation
Run the "start" script. By default it will install the web UI in WSL: /home/{username}/text-gen-install
To launch the web UI in the future after it is already installed, run the same "start" script. Ensure that one_click.py and wsl.sh are next to it!
Updating the web UI
As an alternative to running the "update" script, you can also run "wsl.sh update" in WSL.
Running an interactive shell
As an alternative to running the "cmd" script, you can also run "wsl.sh cmd" in WSL.
Changing the default install location
To change this, you will need to edit the scripts as follows: wsl.sh: line ~22 INSTALL_DIR="/path/to/install/dir"
Keep in mind that there is a long-standing bug in WSL that significantly slows drive read/write speeds when using a physical drive as opposed to the virtual one that Linux is installed in.