Mirrors/text-generation-webui
1
0
Fork 0
mirror of https://github.com/oobabooga/text-generation-webui.git synced 2024-11-25 01:09:22 +01:00
Code Issues Packages Projects Releases Wiki Activity

Update 12 - OpenAI API.md

Browse Source
This commit is contained in:
oobabooga 2023-11-07 12:38:39 -03:00 committed by GitHub
parent 6ec997f195
commit 40e73aafce
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 8 additions and 9 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

17
docs/12 - OpenAI API.md
View File

@ -215,8 +215,7 @@ for event in client.events():
print()
```
### Client Application Setup
### Third-party application setup
You can usually force an application that uses the OpenAI API to connect to the local API by using the following environment variables:
@ -228,18 +227,18 @@ or
```shell
OPENAI_API_KEY=sk-111111111111111111111111111111111111111111111111
OPENAI_API_BASE=http://127.0.0.1:500/v1
OPENAI_API_BASE=http://127.0.0.1:5000/v1
```
With the [official python openai client](https://github.com/openai/openai-python), set the `OPENAI_API_BASE` environment variables:
With the [official python openai client](https://github.com/openai/openai-python), the address can be set like this:
```shell
# Sample .env file:
OPENAI_API_KEY=sk-111111111111111111111111111111111111111111111111
OPENAI_API_BASE=http://0.0.0.0:5001/v1
```
import openai
If needed, replace 127.0.0.1 with the IP/port of your server.
openai.api_key = "..."
openai.api_base = "http://127.0.0.1:5000/v1"
openai.api_version = "2023-05-15"
```
If using .env files to save the `OPENAI_API_BASE` and `OPENAI_API_KEY` variables, make sure the .env file is loaded before the openai module is imported: