matatonic
b45baeea41
extensions/openai: Major docs update, fix #2852 (critical bug), minor improvements ( #2849 )
2023-06-24 22:50:04 -03:00
rizerphe
77baf43f6d
Add CORS support to the API ( #2718 )
2023-06-24 10:16:06 -03:00
matatonic
1e97aaac95
extensions/openai: docs update, model loader, minor fixes ( #2557 )
2023-06-17 19:15:24 -03:00
oobabooga
7ef6a50e84
Reorganize model loading UI completely ( #2720 )
2023-06-16 19:00:37 -03:00
oobabooga
134430bbe2
Minor change
2023-06-14 11:34:42 -03:00
oobabooga
474dc7355a
Allow API requests to use parameter presets
2023-06-14 11:32:20 -03:00
oobabooga
c6552785af
Minor cleanup
2023-06-09 00:30:22 -03:00
matatonic
7be6fe126b
extensions/api: models api for blocking_api (updated) ( #2539 )
2023-06-08 11:34:36 -03:00
bobzilla
643c44e975
Add ngrok shared URL ingress support ( #1944 )
2023-06-06 07:34:20 -03:00
matatonic
4a17a5db67
[extensions/openai] various fixes ( #2533 )
2023-06-06 01:43:04 -03:00
oobabooga
d183c7d29e
Fix streaming japanese/chinese characters
...
Credits to matasonic for the idea
2023-06-02 02:09:52 -03:00
matatonic
a6d3f010a5
extensions/openai: include all available models in Model.list ( #2368 )
...
Co-authored-by: Matthew Ashton <mashton-gitlab@zhero.org>
2023-05-30 22:13:37 -03:00
matatonic
e5b756ecfe
Fixes #2331 , IndexError: string index out of range ( #2383 )
2023-05-30 22:07:40 -03:00
Yiximail
4715123f55
Add a /api/v1/stop-stream API that allows the user to interrupt the generation ( #2392 )
2023-05-30 22:03:40 -03:00
matatonic
ebcadc0042
extensions/openai: cross_origin + chunked_response (updated fix) ( #2423 )
2023-05-30 21:54:24 -03:00
matatonic
df50f077db
fixup missing tfs top_a params, defaults reorg ( #2443 )
2023-05-30 21:52:33 -03:00
oobabooga
8e0a997c60
Add new parameters to API extension
2023-05-29 22:03:08 -03:00
matatonic
2b7ba9586f
Fixes #2326 , KeyError: 'assistant' ( #2382 )
2023-05-29 14:19:57 -03:00
Elias Vincent Simon
2cf711f35e
update SpeechRecognition dependency ( #2345 )
2023-05-26 00:34:57 -03:00
Luis Lopez
0dbc3d9b2c
Fix get_documents_ids_distances return error when n_results = 0 ( #2347 )
2023-05-25 23:25:36 -03:00
Luis Lopez
ee674afa50
Add superbooga time weighted history retrieval ( #2080 )
2023-05-25 10:22:45 -03:00
Gabriel Terrien
e50ade438a
FIX silero_tts/elevenlabs_tts activation/deactivation ( #2313 )
2023-05-24 10:06:38 -03:00
Anthony K
7dc87984a2
Fix spelling mistake in new name var of chat api ( #2309 )
2023-05-23 23:03:03 -03:00
matatonic
9714072692
[extensions/openai] use instruction templates with chat_completions ( #2291 )
2023-05-23 19:58:41 -03:00
oobabooga
74aae34beb
Allow passing your name to the chat API
2023-05-23 19:39:18 -03:00
oobabooga
4d94a111d4
memoize load_character to speed up the chat API
2023-05-23 00:50:58 -03:00
oobabooga
c0fd7f3257
Add mirostat parameters for llama.cpp ( #2287 )
2023-05-22 19:37:24 -03:00
oobabooga
e116d31180
Prevent unwanted log messages from modules
2023-05-21 22:42:34 -03:00
oobabooga
8ac3636966
Add epsilon_cutoff/eta_cutoff parameters ( #2258 )
2023-05-21 15:11:57 -03:00
oobabooga
767a767989
Fix elevenlabs_tts too
2023-05-21 14:11:46 -03:00
oobabooga
1e5821bd9e
Fix silero tts autoplay (attempt #2 )
2023-05-21 13:25:11 -03:00
oobabooga
a5d5bb9390
Fix silero tts autoplay
2023-05-21 12:11:59 -03:00
matatonic
78b2478d9c
assistant: space fix, system: prompt fix ( #2219 )
2023-05-20 23:32:34 -03:00
Luis Lopez
9c53517d2c
Fix superbooga error when querying empty DB (Issue #2160 ) ( #2212 )
2023-05-20 22:27:22 -03:00
oobabooga
c5af549d4b
Add chat API ( #2233 )
2023-05-20 18:42:17 -03:00
oobabooga
ad0b71af11
Add missing file
2023-05-17 00:37:34 -03:00
oobabooga
a84f499718
Allow extensions to define custom CSS and JS
2023-05-17 00:30:54 -03:00
pixel
458a627ab9
fix: elevenlabs cloned voices do not show up in webui after entering API key ( #2107 )
2023-05-16 20:21:36 -03:00
Orbitoid
428261eede
fix: elevenlabs removed the need for the api key for refreshing voices ( #2097 )
2023-05-16 13:34:49 -03:00
atriantafy
26cf8c2545
add api port options ( #1990 )
2023-05-15 20:44:16 -03:00
oobabooga
897fa60069
Sort selected superbooga chunks by insertion order
...
For better coherence
2023-05-14 22:19:29 -03:00
Luis Lopez
b07f849e41
Add superbooga chunk separator option ( #2051 )
2023-05-14 21:44:52 -03:00
matatonic
ab08cf6465
[extensions/openai] clip extra leading space ( #2042 )
2023-05-14 12:57:52 -03:00
oobabooga
5f6cf39f36
Change the injection context string
2023-05-13 14:23:02 -03:00
oobabooga
7cc17e3f1f
Refactor superbooga
2023-05-13 14:15:40 -03:00
oobabooga
826c74c201
Expand superbooga to instruct mode and change the chat implementation
2023-05-13 12:50:19 -03:00
oobabooga
c746a5bd00
Add .rstrip(' ') to openai api
2023-05-12 14:40:48 -03:00
Damian Stewart
3f1bfba718
Clarify how to start server.py with multimodal API support ( #2025 )
2023-05-12 14:37:49 -03:00
oobabooga
146a9cb393
Allow superbooga to download URLs in parallel
2023-05-12 14:19:55 -03:00
matatonic
f98fd01dcd
is_chat=False for /edits ( #2011 )
2023-05-11 19:15:11 -03:00
oobabooga
0d36c18f5d
Always return only the new tokens in generation functions
2023-05-11 17:07:20 -03:00
matatonic
c4f0e6d740
is_chat changes fix for openai extension ( #2008 )
2023-05-11 16:32:25 -03:00
oobabooga
638c6a65a2
Refactor chat functions ( #2003 )
2023-05-11 15:37:04 -03:00
matatonic
309b72e549
[extension/openai] add edits & image endpoints & fix prompt return in non --chat modes ( #1935 )
2023-05-11 11:06:39 -03:00
oobabooga
943b5e5f80
Minor bug fix
2023-05-10 23:54:25 -03:00
oobabooga
9695bfe117
Add an option for cleaning up html in superbooga
2023-05-10 23:51:52 -03:00
oobabooga
f1d10edcb7
Update README.md
2023-05-10 12:13:14 -03:00
oobabooga
c35860ff2f
Add a link to silero samples
2023-05-10 01:39:35 -03:00
oobabooga
3913155c1f
Style improvements ( #1957 )
2023-05-09 22:49:39 -03:00
missionfloyd
fe4dfc647d
SileroTTS preview ( #1934 )
2023-05-09 20:28:59 -03:00
oobabooga
8fa5f651d6
Style changes
2023-05-09 20:20:35 -03:00
Wojtab
e9e75a9ec7
Generalize multimodality (llava/minigpt4 7b and 13b now supported) ( #1741 )
2023-05-09 20:18:02 -03:00
Jeffrey Lin
791a38bad1
[extensions/openai] Support undocumented base64 'encoding_format' param for compatibility with official OpenAI client ( #1876 )
2023-05-08 22:31:34 -03:00
kaiokendev
0e27b660e8
Fix issue where n_results/k > index size ( #1929 )
2023-05-08 21:16:00 -03:00
oobabooga
b5260b24f1
Add support for custom chat styles ( #1917 )
2023-05-08 12:35:03 -03:00
oobabooga
82eb284a3f
Fix a bug in silero tts
2023-05-07 23:59:43 -03:00
oobabooga
b3bbda22d1
Exception handling
2023-05-07 16:50:45 -03:00
oobabooga
8515f19078
Fix typing error
2023-05-07 16:25:39 -03:00
oobabooga
6b67cb6611
Generalize superbooga to chat mode
2023-05-07 15:05:26 -03:00
oobabooga
ec1cda0e1f
Rename superbig to superbooga
2023-05-07 13:29:49 -03:00
oobabooga
8216c8f732
Handle multiline inputs
2023-05-07 11:54:26 -03:00
oobabooga
a35a2fab02
Reorganize superbig ui
2023-05-07 11:30:16 -03:00
oobabooga
befa307c42
Add support for loading multiple URLs into superbig
2023-05-07 11:08:02 -03:00
oobabooga
04eca9b65b
Make chunk length/count customizable
2023-05-07 05:02:04 -03:00
oobabooga
8c06eeaf84
Add requirement
2023-05-07 04:50:12 -03:00
oobabooga
58f9a30be1
Add support for input file/url in superbig
2023-05-07 04:49:02 -03:00
oobabooga
6afba065a1
Only update the chroma database when necessary
2023-05-07 04:03:17 -03:00
kaiokendev
5a4bd3918c
Add SuperBIG extension (alpha) ( #1548 )
...
---------
Co-authored-by: kaiokendev <>
Co-authored-by: oobabooga <112222186+oobabooga@users.noreply.github.com>
2023-05-07 03:50:12 -03:00
oobabooga
85238de421
Remove unused variable
2023-05-06 11:03:12 -03:00
oobabooga
de9c4e260e
Minor fixes to elevenlabs_tts
2023-05-06 10:57:34 -03:00
Steve Randall
b03a2ac512
Elevenlabs Extension Improvement and migration to official API ( #1830 )
2023-05-06 10:56:31 -03:00
oobabooga
8aafb1f796
Refactor text_generation.py, add support for custom generation functions ( #1817 )
2023-05-05 18:53:03 -03:00
oobabooga
4bf7253ec5
Fix typing bug in api
2023-05-03 19:27:20 -03:00
Thireus ☠
4883e20fa7
Fix openai extension script.py - TypeError: '_Environ' object is not callable ( #1753 )
2023-05-03 09:51:49 -03:00
Wojtab
80c2f25131
LLaVA: small fixes ( #1664 )
...
* change multimodal projector to the correct one
* remove reference to custom stopping strings from readme
* fix stopping strings if tokenizer extension adds/removes tokens
* add API example
* LLaVA 7B just dropped, add to readme that there is no support for it currently
2023-05-02 23:12:22 -03:00
oobabooga
c31b0f15a7
Remove some spaces
2023-05-02 23:07:07 -03:00
oobabooga
320fcfde4e
Style/pep8 improvements
2023-05-02 23:05:38 -03:00
matatonic
7ac41b87df
add openai compatible api ( #1475 )
2023-05-02 22:49:53 -03:00
oobabooga
88cdf6ed3d
Prevent websocket from disconnecting
2023-05-02 19:03:19 -03:00
oobabooga
d87ca8f2af
LLaVA fixes
2023-04-26 03:47:34 -03:00
oobabooga
68ed73dd89
Make API extension print its exceptions
2023-04-25 23:23:47 -03:00
Wojtab
65beb51b0b
fix returned dtypes for LLaVA ( #1547 )
2023-04-25 21:25:34 -03:00
MajdajkD
c86e9a3372
fix websocket batching ( #1511 )
2023-04-24 03:51:32 -03:00
Wojtab
04b98a8485
Fix Continue for LLaVA ( #1507 )
2023-04-23 22:58:15 -03:00
Wojtab
12212cf6be
LLaVA support ( #1487 )
2023-04-23 20:32:22 -03:00
Andy Salerno
654933c634
New universal API with streaming/blocking endpoints ( #990 )
...
Previous title: Add api_streaming extension and update api-example-stream to use it
* Merge with latest main
* Add parameter capturing encoder_repetition_penalty
* Change some defaults, minor fixes
* Add --api, --public-api flags
* remove unneeded/broken comment from blocking API startup. The comment is already correctly emitted in try_start_cloudflared by calling the lambda we pass in.
* Update on_start message for blocking_api, it should say 'non-streaming' and not 'streaming'
* Update the API examples
* Change a comment
* Update README
* Remove the gradio API
* Remove unused import
* Minor change
* Remove unused import
---------
Co-authored-by: oobabooga <112222186+oobabooga@users.noreply.github.com>
2023-04-23 15:52:43 -03:00
oobabooga
7ff645899e
Fix bug in api extension
2023-04-22 17:33:36 -03:00
AICatgirls
b992c9236a
Prevent API extension responses from getting cut off with --chat enabled ( #1467 )
2023-04-22 16:06:43 -03:00
Φφ
143e88694d
SD_api_pictures: Modefix, +hires options, UI layout change ( #1400 )
2023-04-21 17:49:18 -03:00
oobabooga
ff0d0ac552
Api extension bug fix
2023-04-20 13:26:58 -03:00
oobabooga
96ba55501c
Rename custom_stopping_strings in the api extension
2023-04-20 00:15:32 -03:00
oobabooga
b0c762ceba
Revert a change
...
I think that this may be needed for some clients
2023-04-18 04:10:45 -03:00
oobabooga
163ea295e7
Fix but in API extension
2023-04-17 13:54:15 -03:00
oobabooga
19e3a59997
Remove unused extension
2023-04-17 11:06:08 -03:00
GuizzyQC
5011f94659
Improved compatibility between silero and sd_api_pictures ( #1196 )
2023-04-16 21:18:52 -03:00
oobabooga
b937c9d8c2
Add skip_special_tokens checkbox for Dolly model ( #1218 )
2023-04-16 14:24:49 -03:00
Lou Bernardi
4d13cc0a1f
Suppress whisper_stt pip warning ( #1215 )
2023-04-15 01:15:59 -03:00
oobabooga
7a0ef1c941
Reorganize whisper extension
2023-04-13 10:40:27 -03:00
Φφ
1d8526849b
SD_api_pictures: Fix for metadata ( #1082 )
2023-04-12 11:42:30 -03:00
oobabooga
4f7e88c043
Simplify send_pictures
2023-04-12 10:30:12 -03:00
oobabooga
80f4eabb2a
Fix send_pictures extension
2023-04-12 10:27:06 -03:00
oobabooga
49ce866c99
Fix silero_tts
2023-04-12 00:58:11 -03:00
Tymec
832ee4323d
API: add endpoint for counting tokens ( #1051 )
2023-04-11 23:08:42 -03:00
Alexander01998
61641a4551
Add missing new parameters to API extension
2023-04-11 22:41:13 -03:00
oobabooga
dc3c9d00a0
Update the API extension
2023-04-11 13:07:45 -03:00
oobabooga
64f5c90ee7
Fix the API extension
2023-04-10 20:14:38 -03:00
BlueprintCoding
8178fde2cb
Added dropdown to character bias. ( #986 )
2023-04-09 23:44:31 -03:00
Φφ
c97c270040
Send_pictures small fix ( #546 )
2023-04-08 01:55:16 -03:00
Φφ
ffd102e5c0
SD Api Pics extension, v.1.1 ( #596 )
2023-04-07 21:36:04 -03:00
oobabooga
5543a5089d
Auto-submit the whisper extension transcription
2023-04-07 15:57:51 -03:00
oobabooga
1dc464dcb0
Sort imports
2023-04-07 14:42:03 -03:00
Φφ
e563b015d8
Silero TTS offline cache ( #628 )
2023-04-07 12:15:57 -03:00
oobabooga
1c413ed593
Remove torch from silero
2023-04-07 11:51:50 -03:00
da3dsoul
3f922d4bfb
Extract the Preprocessing for Silero into a file and Improve it ( #757 )
2023-04-07 11:46:29 -03:00
oobabooga
46c4654226
More PEP8 stuff
2023-04-07 00:52:02 -03:00
oobabooga
ea6e77df72
Make the code more like PEP8 for readability ( #862 )
2023-04-07 00:15:45 -03:00
oobabooga
3f3e42e26c
Refactor several function calls and the API
2023-04-06 01:22:15 -03:00
oobabooga
e722c240af
Add Instruct mode
2023-04-05 13:54:50 -03:00
oobabooga
ca8bb38949
Simplify gallery
2023-04-05 00:34:17 -03:00
oobabooga
80dfba05f3
Better crop/resize cached images
2023-04-04 22:52:15 -03:00
oobabooga
65d8a24a6d
Show profile pictures in the Character tab
2023-04-04 22:28:49 -03:00
Niels Mündler
7aab88bcc6
Give API extension access to all generate_reply parameters ( #744 )
...
* Make every parameter of the generate_reply function parameterizable
* Add stopping strings as parameterizable
2023-04-03 13:31:12 -03:00
TheTerrasque
2157bb4319
New yaml character format ( #337 from TheTerrasque/feature/yaml-characters)
...
This doesn't break backward compatibility with JSON characters.
2023-04-02 20:34:25 -03:00
oobabooga
b0890a7925
Add shared.is_chat() function
2023-04-01 20:15:00 -03:00
oobabooga
3b90d604d7
Sort the imports
2023-03-31 02:01:48 -03:00
ye7iaserag
ec093a5af7
Fix div alignment for long strings
2023-03-31 06:54:24 +02:00
oobabooga
3737eafeaa
Remove a border and allow more characters per pagination page
2023-03-31 00:48:50 -03:00
ye7iaserag
f9940b79dc
Implement character gallery using Dataset
2023-03-31 04:56:49 +02:00
Maya Eary
d1377c37af
Fixes for api server - chat mode and integer temperature
2023-03-28 20:57:16 +03:00
Φφ
1a1e420e65
Silero_tts streaming fix
...
Temporarily suppress the streaming during the audio response as it would interfere with the audio (making it stutter and play anew)
2023-03-25 21:33:30 +03:00
oobabooga
bfe960731f
Merge branch 'main' into fix/api-reload
2023-03-24 16:54:41 -03:00
oobabooga
4a724ed22f
Reorder imports
2023-03-24 16:53:56 -03:00
oobabooga
d5fc1bead7
Merge pull request #489 from Brawlence/ext-fixes
...
Extensions performance & memory optimisations
2023-03-22 16:10:59 -03:00
oobabooga
bfb1be2820
Minor fix
2023-03-22 16:09:48 -03:00
oobabooga
0abff499e2
Use image.thumbnail
2023-03-22 16:03:05 -03:00
oobabooga
104212529f
Minor changes
2023-03-22 15:55:03 -03:00
wywywywy
61346b88ea
Add "seed" menu in the Parameters tab
2023-03-22 15:40:20 -03:00
Φφ
5389fce8e1
Extensions performance & memory optimisations
...
Reworked remove_surrounded_chars() to use regular expression ( https://regexr.com/7alb5 ) instead of repeated string concatenations for elevenlab_tts, silero_tts, sd_api_pictures. This should be both faster and more robust in handling asterisks.
Reduced the memory footprint of send_pictures and sd_api_pictures by scaling the images in the chat to 300 pixels max-side wise. (The user already has the original in case of the sent picture and there's an option to save the SD generation).
This should fix history growing annoyingly large with multiple pictures present
2023-03-22 11:51:00 +03:00
oobabooga
536d0a4d93
Add an import
2023-03-20 14:00:40 -03:00
oobabooga
a90f507abe
Exit elevenlabs_tts if streaming is enabled
2023-03-20 11:49:42 -03:00
