Mirrors/text-generation-webui
1
0
Fork 0
mirror of https://github.com/oobabooga/text-generation-webui.git synced 2024-11-25 17:29:22 +01:00
Code Issues Packages Projects Releases Wiki Activity

Fix API example for loading models (#3101)

Browse Source
This commit is contained in:
Vadim Peretokin 2023-07-11 23:40:55 +02:00 committed by GitHub
parent f4aa11cef6
commit 987d522b55
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 4 additions and 4 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
api-examples/api-example-model.py
View File

@ -54,7 +54,7 @@ def complex_model_load(model):
'action': 'load', 'action': 'load',
'model_name': model, 'model_name': model,
'args': { 'args': {
'gptq_for_llama': False, # Use AutoGPTQ by default, set to True for gptq-for-llama 'loader': 'AutoGPTQ',
'bf16': False, 'bf16': False,
'load_in_8bit': False, 'load_in_8bit': False,