Mirrors/text-generation-webui
1
0
Fork 0
mirror of https://github.com/oobabooga/text-generation-webui.git synced 2025-01-27 12:33:17 +01:00
Code Issues Packages Projects Releases Wiki Activity

min_length has to be 0 when streaming is on

Browse Source
This commit is contained in:
oobabooga 2023-02-08 00:23:35 -03:00
parent 6be571cff7
commit cadd100405
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
server.py
View File

@ -267,7 +267,7 @@ def generate_reply(question, tokens, do_sample, max_new_tokens, temperature, top
f"typical_p={typical_p}", f"typical_p={typical_p}",
f"repetition_penalty={repetition_penalty}", f"repetition_penalty={repetition_penalty}",
f"top_k={top_k}", f"top_k={top_k}",
f"min_length={min_length}", f"min_length={min_length if args.no_stream else 0}",
f"no_repeat_ngram_size={no_repeat_ngram_size}", f"no_repeat_ngram_size={no_repeat_ngram_size}",
f"num_beams={num_beams}", f"num_beams={num_beams}",
f"length_penalty={length_penalty}", f"length_penalty={length_penalty}",