oobabooga
d86f1fd2c3
OpenAI API: stop streaming on client disconnect ( closes #4521 )
2023-11-09 06:37:32 -08:00
oobabooga
effb3aef42
Prevent deadlocks in OpenAI API with simultaneous requests
2023-11-08 20:55:39 -08:00
oobabooga
678fd73aef
Document /v1/internal/model/load and fix a bug
2023-11-08 17:41:12 -08:00
MrMojoR
1754a3761b
Include trust remote code usage in openai api's embedder ( #4513 )
2023-11-08 11:25:43 -03:00
hronoas
6c7aad11f3
openai extension: wrong frequency_penalty type ( #4512 )
2023-11-08 11:23:51 -03:00
oobabooga
881e8a6e70
Small bug fix in /v1/internal/model/load
2023-11-08 02:34:13 -03:00
oobabooga
050ff36bd6
Revert "Add a comment to /v1/models"
...
This reverts commit 38b07493a0
2023-11-07 21:09:47 -08:00
oobabooga
38b07493a0
Add a comment to /v1/models
2023-11-07 21:07:12 -08:00
oobabooga
2358706453
Add /v1/internal/model/load endpoint (tentative)
2023-11-07 20:58:06 -08:00
oobabooga
43c53a7820
Refactor the /v1/models endpoint
2023-11-07 19:59:27 -08:00
oobabooga
1b69694fe9
Add types to the encode/decode/token-count endpoints
2023-11-07 19:32:14 -08:00
oobabooga
f6ca9cfcdc
Add /v1/internal/model-info endpoint
2023-11-07 18:59:02 -08:00
oobabooga
6e2e0317af
Separate context and system message in instruction formats ( #4499 )
2023-11-07 20:02:58 -03:00
oobabooga
3fc505dc0f
Document unused parameters
2023-11-07 08:56:09 -08:00
oobabooga
3d59346871
Implement echo/suffix parameters
2023-11-07 08:43:45 -08:00
oobabooga
48c9c31440
Document the "preset" option in the API
2023-11-07 08:23:17 -08:00
oobabooga
79b3f5a546
Add /v1/internal/stop-generation to OpenAI API ( #4498 )
2023-11-07 00:10:42 -03:00
oobabooga
97c21e5667
Don't strip leading spaces in OpenAI API
2023-11-06 19:09:41 -08:00
oobabooga
4a45dc4041
Reorder the parameters in the FastAPI documentation
2023-11-06 09:55:36 -08:00
oobabooga
0ed6a17ed4
Update warning
2023-11-06 07:17:49 -08:00
oobabooga
0db81355bc
Reorder a parameter
2023-11-06 07:11:49 -08:00
oobabooga
b87c6213ae
Remove obsolete endpoint
2023-11-06 05:45:45 -08:00
oobabooga
28fd535f9c
Make chat API more robust
2023-11-06 05:22:01 -08:00
oobabooga
ec17a5d2b7
Make OpenAI API the default API ( #4430 )
2023-11-06 02:38:29 -03:00
俞航
84d957ba62
[Fix] fix openai embedding_model loading as str ( #4147 )
2023-11-05 20:42:45 -03:00
kabachuha
e18a0460d4
fix openai extension not working because of absent new defaults ( #4477 )
2023-11-04 16:12:51 -03:00
oobabooga
aa5d671579
Add temperature_last parameter ( #4472 )
2023-11-04 13:09:07 -03:00
oobabooga
7f9c1cbb30
Change min_p default to 0.0
2023-11-03 08:25:22 -07:00
kalomaze
367e5e6e43
Implement Min P as a sampler option in HF loaders ( #4449 )
2023-11-02 16:32:51 -03:00
Abhilash Majumder
778a010df8
Intel Gpu support initialization ( #4340 )
2023-10-26 23:39:51 -03:00
GuizzyQC
317e2c857e
sd_api_pictures: fix Gradio warning message regarding custom value ( #4391 )
2023-10-26 23:03:21 -03:00
tdrussell
72f6fc6923
Rename additive_repetition_penalty to presence_penalty, add frequency_penalty ( #4376 )
2023-10-25 12:10:28 -03:00
tdrussell
4440f87722
Add additive_repetition_penalty sampler setting. ( #3627 )
2023-10-23 02:28:07 -03:00
Jiashu Xu
c544f5cc51
Support LLaVA v1.5 7B ( #4348 )
2023-10-22 12:49:04 -03:00
FartyPants (FP HAM)
6a61158adf
Training PRO a month worth of updates ( #4345 )
2023-10-22 12:38:09 -03:00
oobabooga
1a34927314
Make API URLs more visible
2023-10-21 21:11:07 -07:00
Haotian Liu
32984ea2f0
Support LLaVA v1.5 ( #4305 )
2023-10-20 02:28:14 -03:00
missionfloyd
c0ffb77fd8
More silero languages ( #3950 )
2023-10-16 17:12:32 -03:00
hronoas
db7ecdd274
openai: fix empty models list on query present in url ( #4139 )
2023-10-16 17:02:47 -03:00
Jesus Alvarez
ed66ca3cdf
Add HTTPS support to APIs (openai and default) ( #4270 )
...
---------
Co-authored-by: oobabooga <112222186+oobabooga@users.noreply.github.com>
2023-10-13 01:31:13 -03:00
Haotian Liu
2b75d725e6
Initial support for LLaVA-LLaMA-2. ( #3377 )
2023-10-10 18:40:52 -03:00
James Braza
8614c9d085
README for superboogav2 ( #4212 )
...
---------
Co-authored-by: oobabooga <112222186+oobabooga@users.noreply.github.com>
2023-10-07 19:50:39 -03:00
oobabooga
2a7cb346dd
Update the whisper_stt requirements
2023-10-06 21:01:26 -07:00
oobabooga
d33facc9fe
Bump to pytorch 11.8 ( #4209 )
2023-10-07 00:23:49 -03:00
Chenxiao Wang
3fb1e0236a
fix: update superboogav2 requirements.txt ( #4100 )
2023-09-27 23:45:59 -03:00
missionfloyd
86e7c05429
Delete extensions/Training_PRO/readme.md ( #4112 )
2023-09-27 23:45:13 -03:00
Sam
a0d99dcf90
fix: add missing superboogav2 dep ( #4099 )
2023-09-26 23:37:22 -03:00
HideLord
0845724a89
Supercharging superbooga ( #3272 )
2023-09-26 21:30:19 -03:00
oobabooga
08cf150c0c
Add a grammar editor to the UI ( #4061 )
2023-09-24 18:05:24 -03:00
oobabooga
b227e65d86
Add grammar to llama.cpp loader ( closes #4019 )
2023-09-24 07:10:45 -07:00
Chenxiao Wang
9de2dfa887
extensions/openai: Fix error when preparing cache for embedding models ( #3995 )
2023-09-24 00:58:28 -03:00
oobabooga
5dd212cf52
TTS extensions fixes after #4022
2023-09-22 14:58:51 -07:00
FartyPants
26f10854f3
Training PRO extension update ( #4036 )
2023-09-22 18:51:31 -03:00
oobabooga
d43d150b1e
Fix a bug in the chat API ( closes #4034 )
2023-09-22 09:40:07 -07:00
oobabooga
d6814d7c15
Fix a bug in the API ( closes #4027 )
2023-09-21 17:54:53 -07:00
Chenxiao Wang
347aed4254
extensions/openai: load extension settings via settings.yaml ( #3953 )
2023-09-17 22:39:29 -03:00
FartyPants
230b562d53
Training_PRO extension - added target selector ( #3969 )
2023-09-17 17:00:00 -03:00
oobabooga
763ea3bcb2
Improved multimodal error message
2023-09-17 09:22:16 -07:00
FartyPants
e34c6e6938
Training PRO extension ( #3961 )
2023-09-17 11:09:31 -03:00
Shulzhenko Anatolii
0668f4e67f
Add speechrecognition dependency for OpenAI extension ( #3959 )
2023-09-16 13:49:48 -03:00
wizd
cc7f345c29
add whisper api to openai plugin ( #3958 )
2023-09-16 12:04:04 -03:00
Lu Guanghua
cd534ba46e
Fix Google Translate escaping ( #3827 )
...
---------
Co-authored-by: oobabooga <112222186+oobabooga@users.noreply.github.com>
2023-09-16 10:18:06 -03:00
oobabooga
f5fb1ee666
Change a comment
2023-09-15 20:16:30 -07:00
oobabooga
2c1b548cea
Minor fix
2023-09-15 20:14:32 -07:00
oobabooga
8f97e87cac
Lint the openai extension
2023-09-15 20:11:16 -07:00
saltacc
f01b9aa71f
Add customizable ban tokens ( #3899 )
2023-09-15 18:27:27 -03:00
jllllll
8250d0149d
Fix pydantic version conflict in elevenlabs extension ( #3927 )
2023-09-14 13:42:13 -03:00
Chang Chi, Meng
b61d9aef19
openai API: add support for chunked transfer encoding in POST requests ( #3870 )
2023-09-12 15:54:42 -03:00
missionfloyd
43ec9d1619
silero_tts: Add language option ( #3878 )
2023-09-12 15:49:46 -03:00
oobabooga
df123a20fc
Prevent extra keys from being saved to settings.yaml
2023-09-11 20:13:10 -07:00
oobabooga
47d1ca467b
Pin pandas version in superbooga
2023-09-11 18:34:34 -07:00
oobabooga
9331ab4798
Read GGUF metadata ( #3873 )
2023-09-11 18:49:30 -03:00
oobabooga
b2f7ca0d18
Cloudfare fix 2
2023-08-29 19:54:43 -07:00
oobabooga
6c16e4cecf
Cloudfare fix
...
Credits: https://github.com/oobabooga/text-generation-webui/issues/1524#issuecomment-1698255209
2023-08-29 16:35:44 -07:00
oobabooga
cec8db52e5
Add max_tokens_second param ( #3533 )
2023-08-29 17:44:31 -03:00
oobabooga
1a642c12b5
Fix silero_tts HTML unescaping
2023-08-26 00:45:07 -07:00
oobabooga
a2c67262c7
Unescape model output for silero/elevenlabs
2023-08-24 17:27:12 -07:00
tdrussell
2da38e89e6
Fix whitespace formatting in perplexity_colors extension. ( #3643 )
2023-08-22 16:49:37 -03:00
oobabooga
6394fef1db
Rewrite tab detection js
2023-08-20 21:02:53 -07:00
SeanScripts
2c1fd0d72b
Add probability dropdown to perplexity_colors extension ( #3148 )
2023-08-20 20:28:14 -03:00
oobabooga
eaf5f0f089
Merge remote-tracking branch 'refs/remotes/origin/main'
2023-08-17 11:38:29 -07:00
oobabooga
669c640eb4
Fix extensions block appearing where it shouldn't
2023-08-17 11:37:14 -07:00
ausboss
a954b3e7de
fixes error when not specifying tunnel id ( #3606 )
2023-08-17 15:20:36 -03:00
oobabooga
2a29208224
Add a "Show controls" button to chat UI ( #3590 )
2023-08-16 02:39:58 -03:00
oobabooga
3ae2cee446
Fix empty space when the gallery is hidden
2023-08-13 06:09:27 -07:00
oobabooga
919a3cf9d0
Fix the gallery
2023-08-13 05:43:09 -07:00
oobabooga
a1a9ec895d
Unify the 3 interface modes ( #3554 )
2023-08-13 01:12:15 -03:00
Hans Raaf
f4caaf337a
Fix superbooga when using regenerate ( #3362 )
2023-08-08 23:26:28 -03:00
Friedemann Lipphardt
901b028d55
Add option for named cloudflare tunnels ( #3364 )
2023-08-08 22:20:27 -03:00
jllllll
2cf64474f2
Use chat_instruct_command in API ( #3482 )
2023-08-06 23:46:25 -03:00
oobabooga
c237ce607e
Move characters/instruction-following to instruction-templates
2023-08-06 17:50:32 -07:00
oobabooga
0af10ab49b
Add Classifier Free Guidance (CFG) for Transformers/ExLlama ( #3325 )
2023-08-06 17:22:48 -03:00
SodaPrettyCold
23055b21ee
[Bug fix] Remove html tags form the Prompt sent to Stable Diffusion ( #3151 )
2023-08-04 20:20:28 -03:00
oobabooga
ed57a79c6e
Add back silero preview by @missionfloyd ( #3446 )
2023-08-04 02:29:14 -03:00
matatonic
8f98268252
extensions/openai: include content-length for json replies ( #3416 )
2023-08-03 16:10:49 -03:00
rafa-9
d578baeb2c
Use character settings from API properties if present ( #3428 )
2023-08-03 15:56:40 -03:00
oobabooga
e074538b58
Revert "Make long_replies ban the eos token as well"
...
This reverts commit 6c521ce967
2023-08-02 21:45:10 -07:00
oobabooga
e931844fe2
Add auto_max_new_tokens parameter ( #3419 )
2023-08-02 14:52:20 -03:00
oobabooga
6c521ce967
Make long_replies ban the eos token as well
2023-08-01 18:47:49 -07:00
matatonic
9ae0eab989
extensions/openai: +Array input (batched) , +Fixes ( #3309 )
2023-08-01 22:26:00 -03:00
oobabooga
d06c34dea5
Add an extension that makes chat replies longer ( #3363 )
2023-07-31 13:34:41 -03:00
oobabooga
ca4188aabc
Update the example extension
2023-07-29 18:57:22 -07:00
GuizzyQC
4b37a2b397
sd_api_pictures: Widen sliders for image size minimum and maximum ( #3326 )
2023-07-26 13:49:46 -03:00
oobabooga
f24f87cfb0
Change a comment
2023-07-26 09:38:13 -07:00
oobabooga
b553c33dd0
Add a link to the gradio docs
2023-07-26 07:49:22 -07:00
oobabooga
b11f63cb18
update extensions docs
2023-07-26 07:00:33 -07:00
oobabooga
ef8637e32d
Add extension example, replace input_hijack with chat_input_modifier ( #3307 )
2023-07-25 18:49:56 -03:00
matatonic
90a4ab631c
extensions/openai: Fixes for: embeddings, tokens, better errors. +Docs update, +Images, +logit_bias/logprobs, +more. ( #3122 )
2023-07-24 11:28:12 -03:00
iongpt
74fc5dd873
Add user-agent to download-model.py requests ( #3243 )
2023-07-24 11:19:13 -03:00
SeanScripts
9800745db9
Color tokens by probability and/or perplexity ( #3078 )
2023-07-13 17:30:22 -03:00
oobabooga
2463d7c098
Spaces
2023-07-12 11:35:43 -07:00
oobabooga
e202190c4f
lint
2023-07-12 11:33:25 -07:00
oobabooga
180420d2c9
Fix send_pictures extension
2023-07-11 20:56:01 -07:00
atriantafy
d9fabdde40
Add context_instruct to API. Load default model instruction template … ( #2688 )
2023-07-12 00:01:03 -03:00
Keith Kjer
37bffb2e1a
Add reference to new pipeline in multimodal readme ( #2947 )
2023-07-11 19:04:15 -03:00
Juliano Henriquez
1fc0b5041e
substitu superboog Beatiful Soup Parser ( #2996 )
...
* add lxml to requirments
add lxml to requirments
* Change Beaitful Soup Parser
"lxml" parser which might be more tolerant of certain kinds of parsing errors than "html.parser" and quicker at the same time.
2023-07-11 19:02:49 -03:00
Salvador E. Tropea
ab044a5a44
Elevenlabs tts fixes ( #2959 )
...
* [Fixed] Keep setting option for the voice
- It was always changed to the first available voice
- Also added an error if the selected voice isn't valid
* [Fixed] elevenlabs_tts API key handling
- The one from the settings wasn't applied
- We always got "Enter your API key", even when the settings specified
an api_key
* [Added] elevenlabs_tts model selection
- Now we can also use the "eleven_multilingual_v1" model.
Used for anything but english.
2023-07-11 19:00:37 -03:00
matatonic
3e7feb699c
extensions/openai: Major openai extension updates & fixes ( #3049 )
...
* many openai updates
* total reorg & cleanup.
* fixups
* missing import os for images
* +moderations, custom_stopping_strings, more fixes
* fix bugs in completion streaming
* moderation fix (flagged)
* updated moderation categories
---------
Co-authored-by: Matthew Ashton <mashton-gitlab@zhero.org>
2023-07-11 18:50:08 -03:00
Salvador E. Tropea
463aac2d65
[Added] google_translate activate param ( #2961 )
...
- So you can quickly enable/disable it, otherwise you must select
English to disable it, and then your language to enable it again.
2023-07-09 01:08:20 -03:00
Chris Rude
70b088843d
fix for issue #2475 : Streaming api deadlock ( #3048 )
2023-07-08 23:21:20 -03:00
Brandon McClure
acf24ebb49
Whisper_stt params for model, language, and auto_submit ( #3031 )
2023-07-07 20:54:53 -03:00
oobabooga
70a4d5dbcf
Update chat API ( fixes #3006 )
2023-07-04 17:36:47 -07:00
oobabooga
463ddfffd0
Fix start_with
2023-07-03 23:32:02 -07:00
oobabooga
4b1804a438
Implement sessions + add basic multi-user support ( #2991 )
2023-07-04 00:03:30 -03:00
oobabooga
3443219cbc
Add repetition penalty range parameter to transformers ( #2916 )
2023-06-29 13:40:13 -03:00
missionfloyd
5008daa0ff
Add exception handler to load_checkpoint() ( #2904 )
2023-06-27 22:00:29 -03:00
oobabooga
67a83f3ad9
Use DPM++ 2M Karras for Stable Diffusion
2023-06-27 18:47:35 -03:00
Minecrafter20
40bbd53640
Add custom prompt format for SD API pictures ( #1964 )
2023-06-27 17:49:18 -03:00
missionfloyd
cb029cf65f
Get SD samplers from API ( #2889 )
2023-06-27 17:31:54 -03:00
GuizzyQC
d7a7f7896b
Add SD checkpoint selection in sd_api_pictures ( #2872 )
2023-06-27 17:29:27 -03:00
oobabooga
c52290de50
ExLlama with long context ( #2875 )
2023-06-25 22:49:26 -03:00
matatonic
b45baeea41
extensions/openai: Major docs update, fix #2852 (critical bug), minor improvements ( #2849 )
2023-06-24 22:50:04 -03:00
rizerphe
77baf43f6d
Add CORS support to the API ( #2718 )
2023-06-24 10:16:06 -03:00
matatonic
1e97aaac95
extensions/openai: docs update, model loader, minor fixes ( #2557 )
2023-06-17 19:15:24 -03:00
oobabooga
7ef6a50e84
Reorganize model loading UI completely ( #2720 )
2023-06-16 19:00:37 -03:00
oobabooga
134430bbe2
Minor change
2023-06-14 11:34:42 -03:00
oobabooga
474dc7355a
Allow API requests to use parameter presets
2023-06-14 11:32:20 -03:00
oobabooga
c6552785af
Minor cleanup
2023-06-09 00:30:22 -03:00
matatonic
7be6fe126b
extensions/api: models api for blocking_api (updated) ( #2539 )
2023-06-08 11:34:36 -03:00
bobzilla
643c44e975
Add ngrok shared URL ingress support ( #1944 )
2023-06-06 07:34:20 -03:00
matatonic
4a17a5db67
[extensions/openai] various fixes ( #2533 )
2023-06-06 01:43:04 -03:00
oobabooga
d183c7d29e
Fix streaming japanese/chinese characters
...
Credits to matasonic for the idea
2023-06-02 02:09:52 -03:00
matatonic
a6d3f010a5
extensions/openai: include all available models in Model.list ( #2368 )
...
Co-authored-by: Matthew Ashton <mashton-gitlab@zhero.org>
2023-05-30 22:13:37 -03:00
matatonic
e5b756ecfe
Fixes #2331 , IndexError: string index out of range ( #2383 )
2023-05-30 22:07:40 -03:00
Yiximail
4715123f55
Add a /api/v1/stop-stream API that allows the user to interrupt the generation ( #2392 )
2023-05-30 22:03:40 -03:00
matatonic
ebcadc0042
extensions/openai: cross_origin + chunked_response (updated fix) ( #2423 )
2023-05-30 21:54:24 -03:00
matatonic
df50f077db
fixup missing tfs top_a params, defaults reorg ( #2443 )
2023-05-30 21:52:33 -03:00
oobabooga
8e0a997c60
Add new parameters to API extension
2023-05-29 22:03:08 -03:00
matatonic
2b7ba9586f
Fixes #2326 , KeyError: 'assistant' ( #2382 )
2023-05-29 14:19:57 -03:00
Elias Vincent Simon
2cf711f35e
update SpeechRecognition dependency ( #2345 )
2023-05-26 00:34:57 -03:00
