text-generation-webui/extensions/api/script.py

import time

import extensions.api.blocking_api as blocking_api
import extensions.api.streaming_api as streaming_api
from modules import shared


def setup():
    blocking_api.start_server(shared.args.api_blocking_port, share=shared.args.public_api, tunnel_id=shared.args.public_api_id)
    if shared.args.public_api:
        time.sleep(5)

    streaming_api.start_server(shared.args.api_streaming_port, share=shared.args.public_api, tunnel_id=shared.args.public_api_id)
Cloudfare fix Credits: https://github.com/oobabooga/text-generation-webui/issues/1524#issuecomment-1698255209 2023-08-29 16:35:44 -07:00			`import time`

New universal API with streaming/blocking endpoints (#990) Previous title: Add api_streaming extension and update api-example-stream to use it * Merge with latest main * Add parameter capturing encoder_repetition_penalty * Change some defaults, minor fixes * Add --api, --public-api flags * remove unneeded/broken comment from blocking API startup. The comment is already correctly emitted in try_start_cloudflared by calling the lambda we pass in. * Update on_start message for blocking_api, it should say 'non-streaming' and not 'streaming' * Update the API examples * Change a comment * Update README * Remove the gradio API * Remove unused import * Minor change * Remove unused import --------- Co-authored-by: oobabooga <112222186+oobabooga@users.noreply.github.com> 2023-04-23 11:52:43 -07:00			`import extensions.api.blocking_api as blocking_api`
			`import extensions.api.streaming_api as streaming_api`
KoboldAI api 2023-03-15 23:52:46 +03:00			`from modules import shared`

Add chat API (#2233) 2023-05-20 18:42:17 -03:00
Add setup method to extensions 2023-03-19 13:22:24 +00:00			`def setup():`
Add option for named cloudflare tunnels (#3364) 2023-08-09 03:20:27 +02:00			`blocking_api.start_server(shared.args.api_blocking_port, share=shared.args.public_api, tunnel_id=shared.args.public_api_id)`
Cloudfare fix 2 2023-08-29 19:54:43 -07:00			`if shared.args.public_api:`
Cloudfare fix Credits: https://github.com/oobabooga/text-generation-webui/issues/1524#issuecomment-1698255209 2023-08-29 16:35:44 -07:00			`time.sleep(5)`

Add option for named cloudflare tunnels (#3364) 2023-08-09 03:20:27 +02:00			`streaming_api.start_server(shared.args.api_streaming_port, share=shared.args.public_api, tunnel_id=shared.args.public_api_id)`