mirror of
https://github.com/oobabooga/text-generation-webui.git
synced 2024-11-22 08:07:56 +01:00
SD_api_pictures: Fix for metadata (#1082)
This commit is contained in:
parent
5ad92c940e
commit
1d8526849b
@ -1,38 +1,50 @@
|
|||||||
## Description:
|
## Description:
|
||||||
TL;DR: Lets the bot answer you with a picture!
|
TL;DR: Lets the bot answer you with a picture!
|
||||||
|
|
||||||
Stable Diffusion API pictures for TextGen, v.1.1.0
|
Stable Diffusion API pictures for TextGen, v.1.1.1
|
||||||
An extension to [oobabooga's textgen-webui](https://github.com/oobabooga/text-generation-webui) allowing you to receive pics generated by [Automatic1111's SD-WebUI API](https://github.com/AUTOMATIC1111/stable-diffusion-webui)
|
An extension to [oobabooga's textgen-webui](https://github.com/oobabooga/text-generation-webui) allowing you to receive pics generated by [Automatic1111's SD-WebUI API](https://github.com/AUTOMATIC1111/stable-diffusion-webui)
|
||||||
|
|
||||||
<details>
|
<details>
|
||||||
<summary>Interface overview</summary>
|
<summary>Interface overview</summary>
|
||||||
|
|
||||||
![Interface](https://raw.githubusercontent.com/Brawlence/texgen-webui-SD_api_pics/main/illust/Interface.jpg)
|
![Interface](https://raw.githubusercontent.com/Brawlence/SD_api_pics/main/illust/Interface.jpg)
|
||||||
|
|
||||||
</details>
|
</details>
|
||||||
|
|
||||||
Load it in the `--chat` mode with `--extension sd_api_pictures` alongside `send_pictures` (it's not really required, but completes the picture, *pun intended*).
|
Load it in the `--chat` mode with `--extension sd_api_pictures` alongside `send_pictures`
|
||||||
|
(it's not really required, but completes the picture, *pun intended*).
|
||||||
|
|
||||||
The image generation is triggered either:
|
|
||||||
|
## History
|
||||||
|
|
||||||
|
Consider the version included with [oobabooga's repository](https://github.com/oobabooga/text-generation-webui/tree/main/extensions/sd_api_pictures) to be STABLE, experimental developments and untested features are pushed in [Brawlence/SD_api_pics](https://github.com/Brawlence/SD_api_pics)
|
||||||
|
|
||||||
|
Lastest change:
|
||||||
|
1.1.0 → 1.1.1 Fixed not having Auto1111's metadata in received images
|
||||||
|
|
||||||
|
## Details
|
||||||
|
|
||||||
|
The image generation is triggered:
|
||||||
- manually through the 'Force the picture response' button while in `Manual` or `Immersive/Interactive` modes OR
|
- manually through the 'Force the picture response' button while in `Manual` or `Immersive/Interactive` modes OR
|
||||||
- automatically in `Immersive/Interactive` mode if the words `'send|main|message|me'` are followed by `'image|pic|picture|photo|snap|snapshot|selfie|meme'` in the user's prompt
|
- automatically in `Immersive/Interactive` mode if the words `'send|main|message|me'` are followed by `'image|pic|picture|photo|snap|snapshot|selfie|meme'` in the user's prompt
|
||||||
- always on in Picturebook/Adventure mode (if not currently suppressed by 'Suppress the picture response')
|
- always on in `Picturebook/Adventure` mode (if not currently suppressed by 'Suppress the picture response')
|
||||||
|
|
||||||
## Prerequisites
|
## Prerequisites
|
||||||
|
|
||||||
One needs an available instance of Automatic1111's webui running with an `--api` flag. Ain't tested with a notebook / cloud hosted one but should be possible.
|
One needs an available instance of Automatic1111's webui running with an `--api` flag. Ain't tested with a notebook / cloud hosted one but should be possible.
|
||||||
To run it locally in parallel on the same machine, specify custom `--listen-port` for either Auto1111's or ooba's webUIs.
|
To run it locally in parallel on the same machine, specify custom `--listen-port` for either Auto1111's or ooba's webUIs.
|
||||||
|
|
||||||
## Features:
|
## Features overview
|
||||||
- API detection (press enter in the API box)
|
- Connection to API check (press enter in the address box)
|
||||||
- VRAM management (model shuffling)
|
- [VRAM management (model shuffling)](https://github.com/Brawlence/SD_api_pics/wiki/VRAM-management-feature)
|
||||||
- Three different operation modes (manual, interactive, always-on)
|
- [Three different operation modes](https://github.com/Brawlence/SD_api_pics/wiki/Modes-of-operation) (manual, interactive, always-on)
|
||||||
- persistent settings via settings.json
|
- User-defined persistent settings via settings.json
|
||||||
|
|
||||||
The model input is modified only in the interactive mode; other two are unaffected. The output pic description is presented differently for Picture-book / Adventure mode.
|
### Connection check
|
||||||
|
|
||||||
Connection check (insert the Auto1111's address and press Enter):
|
Insert the Automatic1111's WebUI address and press Enter:
|
||||||
![API-check](https://raw.githubusercontent.com/Brawlence/texgen-webui-SD_api_pics/main/illust/API-check.gif)
|
![API-check](https://raw.githubusercontent.com/Brawlence/SD_api_pics/main/illust/API-check.gif)
|
||||||
|
Green mark confirms the ability to communicate with Auto1111's API on this address. Red cross means something's not right (the ext won't work).
|
||||||
|
|
||||||
### Persistents settings
|
### Persistents settings
|
||||||
|
|
||||||
|
@ -138,14 +138,19 @@ def get_SD_pictures(description):
|
|||||||
|
|
||||||
visible_result = ""
|
visible_result = ""
|
||||||
for img_str in r['images']:
|
for img_str in r['images']:
|
||||||
image = Image.open(io.BytesIO(base64.b64decode(img_str.split(",", 1)[0])))
|
|
||||||
if params['save_img']:
|
if params['save_img']:
|
||||||
|
img_data = base64.b64decode(img_str)
|
||||||
|
|
||||||
variadic = f'{date.today().strftime("%Y_%m_%d")}/{shared.character}_{int(time.time())}'
|
variadic = f'{date.today().strftime("%Y_%m_%d")}/{shared.character}_{int(time.time())}'
|
||||||
output_file = Path(f'extensions/sd_api_pictures/outputs/{variadic}.png')
|
output_file = Path(f'extensions/sd_api_pictures/outputs/{variadic}.png')
|
||||||
output_file.parent.mkdir(parents=True, exist_ok=True)
|
output_file.parent.mkdir(parents=True, exist_ok=True)
|
||||||
image.save(output_file.as_posix())
|
|
||||||
|
with open(output_file.as_posix(), 'wb') as f:
|
||||||
|
f.write(img_data)
|
||||||
|
|
||||||
visible_result = visible_result + f'<img src="/file/extensions/sd_api_pictures/outputs/{variadic}.png" alt="{description}" style="max-width: unset; max-height: unset;">\n'
|
visible_result = visible_result + f'<img src="/file/extensions/sd_api_pictures/outputs/{variadic}.png" alt="{description}" style="max-width: unset; max-height: unset;">\n'
|
||||||
else:
|
else:
|
||||||
|
image = Image.open(io.BytesIO(base64.b64decode(img_str.split(",", 1)[0])))
|
||||||
# lower the resolution of received images for the chat, otherwise the log size gets out of control quickly with all the base64 values in visible history
|
# lower the resolution of received images for the chat, otherwise the log size gets out of control quickly with all the base64 values in visible history
|
||||||
image.thumbnail((300, 300))
|
image.thumbnail((300, 300))
|
||||||
buffered = io.BytesIO()
|
buffered = io.BytesIO()
|
||||||
|
Loading…
Reference in New Issue
Block a user