Mirrors/text-generation-webui
1
0
Fork 0
mirror of https://github.com/oobabooga/text-generation-webui.git synced 2024-11-26 17:50:22 +01:00
Code Issues Packages Projects Releases Wiki Activity

Added UnicodeDecodeError workaround for modules/llamacpp_model.py

Browse Source
This commit is contained in:
nclok1405 2024-05-22 09:54:35 +09:00
parent 8aaa0a6f4e
commit 39db799bf1
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
modules/llamacpp_model.py
View File

@ -114,7 +114,7 @@ class LlamaCppModel:
return self.model.tokenize(string) return self.model.tokenize(string)
def decode(self, ids, **kwargs): def decode(self, ids, **kwargs):
return self.model.detokenize(ids).decode('utf-8') return self.model.detokenize(ids).decode('utf-8', 'replace')
def get_logits(self, tokens): def get_logits(self, tokens):
self.model.reset() self.model.reset()