Mirrors/text-generation-webui
1
0
Fork 0
mirror of https://github.com/oobabooga/text-generation-webui.git synced 2024-11-25 09:19:23 +01:00
Code Issues Packages Projects Releases Wiki Activity

fix websocket batching (#1511)

Browse Source
This commit is contained in:
MajdajkD 2023-04-24 08:51:32 +02:00 committed by GitHub
parent 78d1977ebf
commit c86e9a3372
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 2 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
extensions/api/streaming_api.py
View File

@ -44,6 +44,8 @@ async def _handle_connection(websocket, path):
'text': to_send 'text': to_send
})) }))
await asyncio.sleep(0)
skip_index += len(to_send) skip_index += len(to_send)
message_num += 1 message_num += 1