Mirrors/text-generation-webui
1
0
Fork 0
mirror of https://github.com/oobabooga/text-generation-webui.git synced 2025-02-05 16:30:44 +01:00
Code Issues Packages Projects Releases Wiki Activity

UI: Activate auto_max_new_tokens by default

Browse Source
This commit is contained in:
oobabooga 2025-01-14 05:59:55 -08:00
parent 53b838d6c5
commit c832953ff7
2 changed files with 2 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
modules/shared.py
View File

@ -47,7 +47,7 @@ settings = {
'prompt_lookup_num_tokens': 0, 'prompt_lookup_num_tokens': 0,
'max_tokens_second': 0, 'max_tokens_second': 0,
'max_updates_second': 0, 'max_updates_second': 0,
'auto_max_new_tokens': False, 'auto_max_new_tokens': True,
'ban_eos_token': False, 'ban_eos_token': False,
'add_bos_token': True, 'add_bos_token': True,
'skip_special_tokens': True, 'skip_special_tokens': True,

2
settings-template.yaml
View File

@ -19,7 +19,7 @@ max_new_tokens_max: 4096
prompt_lookup_num_tokens: 0 prompt_lookup_num_tokens: 0
max_tokens_second: 0 max_tokens_second: 0
max_updates_second: 0 max_updates_second: 0
auto_max_new_tokens: false auto_max_new_tokens: true
ban_eos_token: false ban_eos_token: false
add_bos_token: true add_bos_token: true
skip_special_tokens: true skip_special_tokens: true