Mirrors/text-generation-webui
1
0
Fork 0
mirror of https://github.com/oobabooga/text-generation-webui.git synced 2024-11-22 08:07:56 +01:00
Code Issues Packages Projects Releases Wiki Activity

Credit turboderp

Browse Source
This commit is contained in:
oobabooga 2023-08-06 13:42:43 -07:00
parent 0af10ab49b
commit d4b851bdc8
1 changed files with 1 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

1
modules/exllama.py
View File

@ -136,6 +136,7 @@ class ExllamaModel:
break
# Case 2: CFG
# Copied from https://github.com/turboderp/exllama/blob/master/example_cfg.py
else:
alpha = state['guidance_scale']
prompts = [prompt, state['negative_prompt'] or '']