oobabooga
c237ce607e
Move characters/instruction-following to instruction-templates
2023-08-06 17:50:32 -07:00
oobabooga
0af10ab49b
Add Classifier Free Guidance (CFG) for Transformers/ExLlama ( #3325 )
2023-08-06 17:22:48 -03:00
SodaPrettyCold
23055b21ee
[Bug fix] Remove html tags form the Prompt sent to Stable Diffusion ( #3151 )
2023-08-04 20:20:28 -03:00
oobabooga
ed57a79c6e
Add back silero preview by @missionfloyd ( #3446 )
2023-08-04 02:29:14 -03:00
matatonic
8f98268252
extensions/openai: include content-length for json replies ( #3416 )
2023-08-03 16:10:49 -03:00
rafa-9
d578baeb2c
Use character settings from API properties if present ( #3428 )
2023-08-03 15:56:40 -03:00
oobabooga
e074538b58
Revert "Make long_replies ban the eos token as well"
...
This reverts commit 6c521ce967
2023-08-02 21:45:10 -07:00
oobabooga
e931844fe2
Add auto_max_new_tokens parameter ( #3419 )
2023-08-02 14:52:20 -03:00
oobabooga
6c521ce967
Make long_replies ban the eos token as well
2023-08-01 18:47:49 -07:00
matatonic
9ae0eab989
extensions/openai: +Array input (batched) , +Fixes ( #3309 )
2023-08-01 22:26:00 -03:00
oobabooga
d06c34dea5
Add an extension that makes chat replies longer ( #3363 )
2023-07-31 13:34:41 -03:00
oobabooga
ca4188aabc
Update the example extension
2023-07-29 18:57:22 -07:00
GuizzyQC
4b37a2b397
sd_api_pictures: Widen sliders for image size minimum and maximum ( #3326 )
2023-07-26 13:49:46 -03:00
oobabooga
f24f87cfb0
Change a comment
2023-07-26 09:38:13 -07:00
oobabooga
b553c33dd0
Add a link to the gradio docs
2023-07-26 07:49:22 -07:00
oobabooga
b11f63cb18
update extensions docs
2023-07-26 07:00:33 -07:00
oobabooga
ef8637e32d
Add extension example, replace input_hijack with chat_input_modifier ( #3307 )
2023-07-25 18:49:56 -03:00
matatonic
90a4ab631c
extensions/openai: Fixes for: embeddings, tokens, better errors. +Docs update, +Images, +logit_bias/logprobs, +more. ( #3122 )
2023-07-24 11:28:12 -03:00
iongpt
74fc5dd873
Add user-agent to download-model.py requests ( #3243 )
2023-07-24 11:19:13 -03:00
SeanScripts
9800745db9
Color tokens by probability and/or perplexity ( #3078 )
2023-07-13 17:30:22 -03:00
oobabooga
2463d7c098
Spaces
2023-07-12 11:35:43 -07:00
oobabooga
e202190c4f
lint
2023-07-12 11:33:25 -07:00
oobabooga
180420d2c9
Fix send_pictures extension
2023-07-11 20:56:01 -07:00
atriantafy
d9fabdde40
Add context_instruct to API. Load default model instruction template … ( #2688 )
2023-07-12 00:01:03 -03:00
Keith Kjer
37bffb2e1a
Add reference to new pipeline in multimodal readme ( #2947 )
2023-07-11 19:04:15 -03:00
Juliano Henriquez
1fc0b5041e
substitu superboog Beatiful Soup Parser ( #2996 )
...
* add lxml to requirments
add lxml to requirments
* Change Beaitful Soup Parser
"lxml" parser which might be more tolerant of certain kinds of parsing errors than "html.parser" and quicker at the same time.
2023-07-11 19:02:49 -03:00
Salvador E. Tropea
ab044a5a44
Elevenlabs tts fixes ( #2959 )
...
* [Fixed] Keep setting option for the voice
- It was always changed to the first available voice
- Also added an error if the selected voice isn't valid
* [Fixed] elevenlabs_tts API key handling
- The one from the settings wasn't applied
- We always got "Enter your API key", even when the settings specified
an api_key
* [Added] elevenlabs_tts model selection
- Now we can also use the "eleven_multilingual_v1" model.
Used for anything but english.
2023-07-11 19:00:37 -03:00
matatonic
3e7feb699c
extensions/openai: Major openai extension updates & fixes ( #3049 )
...
* many openai updates
* total reorg & cleanup.
* fixups
* missing import os for images
* +moderations, custom_stopping_strings, more fixes
* fix bugs in completion streaming
* moderation fix (flagged)
* updated moderation categories
---------
Co-authored-by: Matthew Ashton <mashton-gitlab@zhero.org>
2023-07-11 18:50:08 -03:00
Salvador E. Tropea
463aac2d65
[Added] google_translate activate param ( #2961 )
...
- So you can quickly enable/disable it, otherwise you must select
English to disable it, and then your language to enable it again.
2023-07-09 01:08:20 -03:00
Chris Rude
70b088843d
fix for issue #2475 : Streaming api deadlock ( #3048 )
2023-07-08 23:21:20 -03:00
Brandon McClure
acf24ebb49
Whisper_stt params for model, language, and auto_submit ( #3031 )
2023-07-07 20:54:53 -03:00
oobabooga
70a4d5dbcf
Update chat API ( fixes #3006 )
2023-07-04 17:36:47 -07:00
oobabooga
463ddfffd0
Fix start_with
2023-07-03 23:32:02 -07:00
oobabooga
4b1804a438
Implement sessions + add basic multi-user support ( #2991 )
2023-07-04 00:03:30 -03:00
oobabooga
3443219cbc
Add repetition penalty range parameter to transformers ( #2916 )
2023-06-29 13:40:13 -03:00
missionfloyd
5008daa0ff
Add exception handler to load_checkpoint() ( #2904 )
2023-06-27 22:00:29 -03:00
oobabooga
67a83f3ad9
Use DPM++ 2M Karras for Stable Diffusion
2023-06-27 18:47:35 -03:00
Minecrafter20
40bbd53640
Add custom prompt format for SD API pictures ( #1964 )
2023-06-27 17:49:18 -03:00
missionfloyd
cb029cf65f
Get SD samplers from API ( #2889 )
2023-06-27 17:31:54 -03:00
GuizzyQC
d7a7f7896b
Add SD checkpoint selection in sd_api_pictures ( #2872 )
2023-06-27 17:29:27 -03:00
oobabooga
c52290de50
ExLlama with long context ( #2875 )
2023-06-25 22:49:26 -03:00
matatonic
b45baeea41
extensions/openai: Major docs update, fix #2852 (critical bug), minor improvements ( #2849 )
2023-06-24 22:50:04 -03:00
rizerphe
77baf43f6d
Add CORS support to the API ( #2718 )
2023-06-24 10:16:06 -03:00
matatonic
1e97aaac95
extensions/openai: docs update, model loader, minor fixes ( #2557 )
2023-06-17 19:15:24 -03:00
oobabooga
7ef6a50e84
Reorganize model loading UI completely ( #2720 )
2023-06-16 19:00:37 -03:00
oobabooga
134430bbe2
Minor change
2023-06-14 11:34:42 -03:00
oobabooga
474dc7355a
Allow API requests to use parameter presets
2023-06-14 11:32:20 -03:00
oobabooga
c6552785af
Minor cleanup
2023-06-09 00:30:22 -03:00
matatonic
7be6fe126b
extensions/api: models api for blocking_api (updated) ( #2539 )
2023-06-08 11:34:36 -03:00
bobzilla
643c44e975
Add ngrok shared URL ingress support ( #1944 )
2023-06-06 07:34:20 -03:00
matatonic
4a17a5db67
[extensions/openai] various fixes ( #2533 )
2023-06-06 01:43:04 -03:00
oobabooga
d183c7d29e
Fix streaming japanese/chinese characters
...
Credits to matasonic for the idea
2023-06-02 02:09:52 -03:00
matatonic
a6d3f010a5
extensions/openai: include all available models in Model.list ( #2368 )
...
Co-authored-by: Matthew Ashton <mashton-gitlab@zhero.org>
2023-05-30 22:13:37 -03:00
matatonic
e5b756ecfe
Fixes #2331 , IndexError: string index out of range ( #2383 )
2023-05-30 22:07:40 -03:00
Yiximail
4715123f55
Add a /api/v1/stop-stream API that allows the user to interrupt the generation ( #2392 )
2023-05-30 22:03:40 -03:00
matatonic
ebcadc0042
extensions/openai: cross_origin + chunked_response (updated fix) ( #2423 )
2023-05-30 21:54:24 -03:00
matatonic
df50f077db
fixup missing tfs top_a params, defaults reorg ( #2443 )
2023-05-30 21:52:33 -03:00
oobabooga
8e0a997c60
Add new parameters to API extension
2023-05-29 22:03:08 -03:00
matatonic
2b7ba9586f
Fixes #2326 , KeyError: 'assistant' ( #2382 )
2023-05-29 14:19:57 -03:00
Elias Vincent Simon
2cf711f35e
update SpeechRecognition dependency ( #2345 )
2023-05-26 00:34:57 -03:00
Luis Lopez
0dbc3d9b2c
Fix get_documents_ids_distances return error when n_results = 0 ( #2347 )
2023-05-25 23:25:36 -03:00
Luis Lopez
ee674afa50
Add superbooga time weighted history retrieval ( #2080 )
2023-05-25 10:22:45 -03:00
Gabriel Terrien
e50ade438a
FIX silero_tts/elevenlabs_tts activation/deactivation ( #2313 )
2023-05-24 10:06:38 -03:00
Anthony K
7dc87984a2
Fix spelling mistake in new name var of chat api ( #2309 )
2023-05-23 23:03:03 -03:00
matatonic
9714072692
[extensions/openai] use instruction templates with chat_completions ( #2291 )
2023-05-23 19:58:41 -03:00
oobabooga
74aae34beb
Allow passing your name to the chat API
2023-05-23 19:39:18 -03:00
oobabooga
4d94a111d4
memoize load_character to speed up the chat API
2023-05-23 00:50:58 -03:00
oobabooga
c0fd7f3257
Add mirostat parameters for llama.cpp ( #2287 )
2023-05-22 19:37:24 -03:00
oobabooga
e116d31180
Prevent unwanted log messages from modules
2023-05-21 22:42:34 -03:00
oobabooga
8ac3636966
Add epsilon_cutoff/eta_cutoff parameters ( #2258 )
2023-05-21 15:11:57 -03:00
oobabooga
767a767989
Fix elevenlabs_tts too
2023-05-21 14:11:46 -03:00
oobabooga
1e5821bd9e
Fix silero tts autoplay (attempt #2 )
2023-05-21 13:25:11 -03:00
oobabooga
a5d5bb9390
Fix silero tts autoplay
2023-05-21 12:11:59 -03:00
matatonic
78b2478d9c
assistant: space fix, system: prompt fix ( #2219 )
2023-05-20 23:32:34 -03:00
Luis Lopez
9c53517d2c
Fix superbooga error when querying empty DB (Issue #2160 ) ( #2212 )
2023-05-20 22:27:22 -03:00
oobabooga
c5af549d4b
Add chat API ( #2233 )
2023-05-20 18:42:17 -03:00
oobabooga
ad0b71af11
Add missing file
2023-05-17 00:37:34 -03:00
oobabooga
a84f499718
Allow extensions to define custom CSS and JS
2023-05-17 00:30:54 -03:00
pixel
458a627ab9
fix: elevenlabs cloned voices do not show up in webui after entering API key ( #2107 )
2023-05-16 20:21:36 -03:00
Orbitoid
428261eede
fix: elevenlabs removed the need for the api key for refreshing voices ( #2097 )
2023-05-16 13:34:49 -03:00
atriantafy
26cf8c2545
add api port options ( #1990 )
2023-05-15 20:44:16 -03:00
oobabooga
897fa60069
Sort selected superbooga chunks by insertion order
...
For better coherence
2023-05-14 22:19:29 -03:00
Luis Lopez
b07f849e41
Add superbooga chunk separator option ( #2051 )
2023-05-14 21:44:52 -03:00
matatonic
ab08cf6465
[extensions/openai] clip extra leading space ( #2042 )
2023-05-14 12:57:52 -03:00
oobabooga
5f6cf39f36
Change the injection context string
2023-05-13 14:23:02 -03:00
oobabooga
7cc17e3f1f
Refactor superbooga
2023-05-13 14:15:40 -03:00
oobabooga
826c74c201
Expand superbooga to instruct mode and change the chat implementation
2023-05-13 12:50:19 -03:00
oobabooga
c746a5bd00
Add .rstrip(' ') to openai api
2023-05-12 14:40:48 -03:00
Damian Stewart
3f1bfba718
Clarify how to start server.py with multimodal API support ( #2025 )
2023-05-12 14:37:49 -03:00
oobabooga
146a9cb393
Allow superbooga to download URLs in parallel
2023-05-12 14:19:55 -03:00
matatonic
f98fd01dcd
is_chat=False for /edits ( #2011 )
2023-05-11 19:15:11 -03:00
oobabooga
0d36c18f5d
Always return only the new tokens in generation functions
2023-05-11 17:07:20 -03:00
matatonic
c4f0e6d740
is_chat changes fix for openai extension ( #2008 )
2023-05-11 16:32:25 -03:00
oobabooga
638c6a65a2
Refactor chat functions ( #2003 )
2023-05-11 15:37:04 -03:00
matatonic
309b72e549
[extension/openai] add edits & image endpoints & fix prompt return in non --chat modes ( #1935 )
2023-05-11 11:06:39 -03:00
oobabooga
943b5e5f80
Minor bug fix
2023-05-10 23:54:25 -03:00
oobabooga
9695bfe117
Add an option for cleaning up html in superbooga
2023-05-10 23:51:52 -03:00
oobabooga
f1d10edcb7
Update README.md
2023-05-10 12:13:14 -03:00
oobabooga
c35860ff2f
Add a link to silero samples
2023-05-10 01:39:35 -03:00
oobabooga
3913155c1f
Style improvements ( #1957 )
2023-05-09 22:49:39 -03:00
missionfloyd
fe4dfc647d
SileroTTS preview ( #1934 )
2023-05-09 20:28:59 -03:00
oobabooga
8fa5f651d6
Style changes
2023-05-09 20:20:35 -03:00
Wojtab
e9e75a9ec7
Generalize multimodality (llava/minigpt4 7b and 13b now supported) ( #1741 )
2023-05-09 20:18:02 -03:00
Jeffrey Lin
791a38bad1
[extensions/openai] Support undocumented base64 'encoding_format' param for compatibility with official OpenAI client ( #1876 )
2023-05-08 22:31:34 -03:00
kaiokendev
0e27b660e8
Fix issue where n_results/k > index size ( #1929 )
2023-05-08 21:16:00 -03:00
oobabooga
b5260b24f1
Add support for custom chat styles ( #1917 )
2023-05-08 12:35:03 -03:00
oobabooga
82eb284a3f
Fix a bug in silero tts
2023-05-07 23:59:43 -03:00
oobabooga
b3bbda22d1
Exception handling
2023-05-07 16:50:45 -03:00
oobabooga
8515f19078
Fix typing error
2023-05-07 16:25:39 -03:00
oobabooga
6b67cb6611
Generalize superbooga to chat mode
2023-05-07 15:05:26 -03:00
oobabooga
ec1cda0e1f
Rename superbig to superbooga
2023-05-07 13:29:49 -03:00
oobabooga
8216c8f732
Handle multiline inputs
2023-05-07 11:54:26 -03:00
oobabooga
a35a2fab02
Reorganize superbig ui
2023-05-07 11:30:16 -03:00
oobabooga
befa307c42
Add support for loading multiple URLs into superbig
2023-05-07 11:08:02 -03:00
oobabooga
04eca9b65b
Make chunk length/count customizable
2023-05-07 05:02:04 -03:00
oobabooga
8c06eeaf84
Add requirement
2023-05-07 04:50:12 -03:00
oobabooga
58f9a30be1
Add support for input file/url in superbig
2023-05-07 04:49:02 -03:00
oobabooga
6afba065a1
Only update the chroma database when necessary
2023-05-07 04:03:17 -03:00
kaiokendev
5a4bd3918c
Add SuperBIG extension (alpha) ( #1548 )
...
---------
Co-authored-by: kaiokendev <>
Co-authored-by: oobabooga <112222186+oobabooga@users.noreply.github.com>
2023-05-07 03:50:12 -03:00
oobabooga
85238de421
Remove unused variable
2023-05-06 11:03:12 -03:00
oobabooga
de9c4e260e
Minor fixes to elevenlabs_tts
2023-05-06 10:57:34 -03:00
Steve Randall
b03a2ac512
Elevenlabs Extension Improvement and migration to official API ( #1830 )
2023-05-06 10:56:31 -03:00
oobabooga
8aafb1f796
Refactor text_generation.py, add support for custom generation functions ( #1817 )
2023-05-05 18:53:03 -03:00
oobabooga
4bf7253ec5
Fix typing bug in api
2023-05-03 19:27:20 -03:00
Thireus ☠
4883e20fa7
Fix openai extension script.py - TypeError: '_Environ' object is not callable ( #1753 )
2023-05-03 09:51:49 -03:00
Wojtab
80c2f25131
LLaVA: small fixes ( #1664 )
...
* change multimodal projector to the correct one
* remove reference to custom stopping strings from readme
* fix stopping strings if tokenizer extension adds/removes tokens
* add API example
* LLaVA 7B just dropped, add to readme that there is no support for it currently
2023-05-02 23:12:22 -03:00
oobabooga
c31b0f15a7
Remove some spaces
2023-05-02 23:07:07 -03:00
oobabooga
320fcfde4e
Style/pep8 improvements
2023-05-02 23:05:38 -03:00
matatonic
7ac41b87df
add openai compatible api ( #1475 )
2023-05-02 22:49:53 -03:00
oobabooga
88cdf6ed3d
Prevent websocket from disconnecting
2023-05-02 19:03:19 -03:00
oobabooga
d87ca8f2af
LLaVA fixes
2023-04-26 03:47:34 -03:00
oobabooga
68ed73dd89
Make API extension print its exceptions
2023-04-25 23:23:47 -03:00
Wojtab
65beb51b0b
fix returned dtypes for LLaVA ( #1547 )
2023-04-25 21:25:34 -03:00
MajdajkD
c86e9a3372
fix websocket batching ( #1511 )
2023-04-24 03:51:32 -03:00
Wojtab
04b98a8485
Fix Continue for LLaVA ( #1507 )
2023-04-23 22:58:15 -03:00
Wojtab
12212cf6be
LLaVA support ( #1487 )
2023-04-23 20:32:22 -03:00
Andy Salerno
654933c634
New universal API with streaming/blocking endpoints ( #990 )
...
Previous title: Add api_streaming extension and update api-example-stream to use it
* Merge with latest main
* Add parameter capturing encoder_repetition_penalty
* Change some defaults, minor fixes
* Add --api, --public-api flags
* remove unneeded/broken comment from blocking API startup. The comment is already correctly emitted in try_start_cloudflared by calling the lambda we pass in.
* Update on_start message for blocking_api, it should say 'non-streaming' and not 'streaming'
* Update the API examples
* Change a comment
* Update README
* Remove the gradio API
* Remove unused import
* Minor change
* Remove unused import
---------
Co-authored-by: oobabooga <112222186+oobabooga@users.noreply.github.com>
2023-04-23 15:52:43 -03:00
oobabooga
7ff645899e
Fix bug in api extension
2023-04-22 17:33:36 -03:00
AICatgirls
b992c9236a
Prevent API extension responses from getting cut off with --chat enabled ( #1467 )
2023-04-22 16:06:43 -03:00
Φφ
143e88694d
SD_api_pictures: Modefix, +hires options, UI layout change ( #1400 )
2023-04-21 17:49:18 -03:00
oobabooga
ff0d0ac552
Api extension bug fix
2023-04-20 13:26:58 -03:00
oobabooga
96ba55501c
Rename custom_stopping_strings in the api extension
2023-04-20 00:15:32 -03:00
oobabooga
b0c762ceba
Revert a change
...
I think that this may be needed for some clients
2023-04-18 04:10:45 -03:00
oobabooga
163ea295e7
Fix but in API extension
2023-04-17 13:54:15 -03:00
oobabooga
19e3a59997
Remove unused extension
2023-04-17 11:06:08 -03:00
GuizzyQC
5011f94659
Improved compatibility between silero and sd_api_pictures ( #1196 )
2023-04-16 21:18:52 -03:00
oobabooga
b937c9d8c2
Add skip_special_tokens checkbox for Dolly model ( #1218 )
2023-04-16 14:24:49 -03:00
Lou Bernardi
4d13cc0a1f
Suppress whisper_stt pip warning ( #1215 )
2023-04-15 01:15:59 -03:00
oobabooga
7a0ef1c941
Reorganize whisper extension
2023-04-13 10:40:27 -03:00
Φφ
1d8526849b
SD_api_pictures: Fix for metadata ( #1082 )
2023-04-12 11:42:30 -03:00
