Mirrors/text-generation-webui
1
0
Fork 0
mirror of https://github.com/oobabooga/text-generation-webui.git synced 2024-12-01 20:04:04 +01:00
Code Issues Packages Projects Releases Wiki Activity

Add low VRAM guide

Browse Source
This commit is contained in:
oobabooga 2023-01-19 11:25:17 -03:00
parent 7ace04864a
commit f9faad4cfa
1 changed files with 2 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
README.md
View File

@ -138,6 +138,8 @@ Optionally, you can use the following command-line flags:
| `--no-stream` | Don't stream the text output in real time. This slightly improves the text generation performance.| | `--no-stream` | Don't stream the text output in real time. This slightly improves the text generation performance.|
| `--settings SETTINGS_FILE` | Load the default interface settings from this json file. See `settings-template.json` for an example.| | `--settings SETTINGS_FILE` | Load the default interface settings from this json file. See `settings-template.json` for an example.|
Out of memory errors? [Check this guide](https://github.com/oobabooga/text-generation-webui/wiki/Low-VRAM-guide).
## Presets ## Presets
Inference settings presets can be created under `presets/` as text files. These files are detected automatically at startup. Inference settings presets can be created under `presets/` as text files. These files are detected automatically at startup.