Mirrors/text-generation-webui
1
0
Fork 0
mirror of https://github.com/oobabooga/text-generation-webui.git synced 2024-11-26 01:30:20 +01:00
Code Issues Packages Projects Releases Wiki Activity

Add back low_cpu_mem_usage=True

Browse Source 
Removing it didn't help with anything, so I am adding it bad on a purely
superstiticious basis.
This commit is contained in:
oobabooga 2023-02-01 10:01:44 -03:00
parent d4a0b377ab
commit 119be56390
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
server.py
View File

@ -88,7 +88,7 @@ def load_model(model_name):
# Custom # Custom
else: else:
command = "AutoModelForCausalLM.from_pretrained" command = "AutoModelForCausalLM.from_pretrained"
settings = [] settings = ["low_cpu_mem_usage=True"]
if args.cpu: if args.cpu:
settings.append("low_cpu_mem_usage=True") settings.append("low_cpu_mem_usage=True")