missionfloyd
cb029cf65f
Get SD samplers from API ( #2889 )
2023-06-27 17:31:54 -03:00
GuizzyQC
d7a7f7896b
Add SD checkpoint selection in sd_api_pictures ( #2872 )
2023-06-27 17:29:27 -03:00
oobabooga
c52290de50
ExLlama with long context ( #2875 )
2023-06-25 22:49:26 -03:00
matatonic
b45baeea41
extensions/openai: Major docs update, fix #2852 (critical bug), minor improvements ( #2849 )
2023-06-24 22:50:04 -03:00
rizerphe
77baf43f6d
Add CORS support to the API ( #2718 )
2023-06-24 10:16:06 -03:00
matatonic
1e97aaac95
extensions/openai: docs update, model loader, minor fixes ( #2557 )
2023-06-17 19:15:24 -03:00
oobabooga
7ef6a50e84
Reorganize model loading UI completely ( #2720 )
2023-06-16 19:00:37 -03:00
oobabooga
134430bbe2
Minor change
2023-06-14 11:34:42 -03:00
oobabooga
474dc7355a
Allow API requests to use parameter presets
2023-06-14 11:32:20 -03:00
oobabooga
c6552785af
Minor cleanup
2023-06-09 00:30:22 -03:00
matatonic
7be6fe126b
extensions/api: models api for blocking_api (updated) ( #2539 )
2023-06-08 11:34:36 -03:00
bobzilla
643c44e975
Add ngrok shared URL ingress support ( #1944 )
2023-06-06 07:34:20 -03:00
matatonic
4a17a5db67
[extensions/openai] various fixes ( #2533 )
2023-06-06 01:43:04 -03:00
oobabooga
d183c7d29e
Fix streaming japanese/chinese characters
...
Credits to matasonic for the idea
2023-06-02 02:09:52 -03:00
matatonic
a6d3f010a5
extensions/openai: include all available models in Model.list ( #2368 )
...
Co-authored-by: Matthew Ashton <mashton-gitlab@zhero.org>
2023-05-30 22:13:37 -03:00
matatonic
e5b756ecfe
Fixes #2331 , IndexError: string index out of range ( #2383 )
2023-05-30 22:07:40 -03:00
Yiximail
4715123f55
Add a /api/v1/stop-stream API that allows the user to interrupt the generation ( #2392 )
2023-05-30 22:03:40 -03:00
matatonic
ebcadc0042
extensions/openai: cross_origin + chunked_response (updated fix) ( #2423 )
2023-05-30 21:54:24 -03:00
matatonic
df50f077db
fixup missing tfs top_a params, defaults reorg ( #2443 )
2023-05-30 21:52:33 -03:00
oobabooga
8e0a997c60
Add new parameters to API extension
2023-05-29 22:03:08 -03:00
matatonic
2b7ba9586f
Fixes #2326 , KeyError: 'assistant' ( #2382 )
2023-05-29 14:19:57 -03:00
Elias Vincent Simon
2cf711f35e
update SpeechRecognition dependency ( #2345 )
2023-05-26 00:34:57 -03:00
Luis Lopez
0dbc3d9b2c
Fix get_documents_ids_distances return error when n_results = 0 ( #2347 )
2023-05-25 23:25:36 -03:00
Luis Lopez
ee674afa50
Add superbooga time weighted history retrieval ( #2080 )
2023-05-25 10:22:45 -03:00
Gabriel Terrien
e50ade438a
FIX silero_tts/elevenlabs_tts activation/deactivation ( #2313 )
2023-05-24 10:06:38 -03:00
Anthony K
7dc87984a2
Fix spelling mistake in new name var of chat api ( #2309 )
2023-05-23 23:03:03 -03:00
matatonic
9714072692
[extensions/openai] use instruction templates with chat_completions ( #2291 )
2023-05-23 19:58:41 -03:00
oobabooga
74aae34beb
Allow passing your name to the chat API
2023-05-23 19:39:18 -03:00
oobabooga
4d94a111d4
memoize load_character to speed up the chat API
2023-05-23 00:50:58 -03:00
oobabooga
c0fd7f3257
Add mirostat parameters for llama.cpp ( #2287 )
2023-05-22 19:37:24 -03:00
oobabooga
e116d31180
Prevent unwanted log messages from modules
2023-05-21 22:42:34 -03:00
oobabooga
8ac3636966
Add epsilon_cutoff/eta_cutoff parameters ( #2258 )
2023-05-21 15:11:57 -03:00
oobabooga
767a767989
Fix elevenlabs_tts too
2023-05-21 14:11:46 -03:00
oobabooga
1e5821bd9e
Fix silero tts autoplay (attempt #2 )
2023-05-21 13:25:11 -03:00
oobabooga
a5d5bb9390
Fix silero tts autoplay
2023-05-21 12:11:59 -03:00
matatonic
78b2478d9c
assistant: space fix, system: prompt fix ( #2219 )
2023-05-20 23:32:34 -03:00
Luis Lopez
9c53517d2c
Fix superbooga error when querying empty DB (Issue #2160 ) ( #2212 )
2023-05-20 22:27:22 -03:00
oobabooga
c5af549d4b
Add chat API ( #2233 )
2023-05-20 18:42:17 -03:00
oobabooga
ad0b71af11
Add missing file
2023-05-17 00:37:34 -03:00
oobabooga
a84f499718
Allow extensions to define custom CSS and JS
2023-05-17 00:30:54 -03:00
pixel
458a627ab9
fix: elevenlabs cloned voices do not show up in webui after entering API key ( #2107 )
2023-05-16 20:21:36 -03:00
Orbitoid
428261eede
fix: elevenlabs removed the need for the api key for refreshing voices ( #2097 )
2023-05-16 13:34:49 -03:00
atriantafy
26cf8c2545
add api port options ( #1990 )
2023-05-15 20:44:16 -03:00
oobabooga
897fa60069
Sort selected superbooga chunks by insertion order
...
For better coherence
2023-05-14 22:19:29 -03:00
Luis Lopez
b07f849e41
Add superbooga chunk separator option ( #2051 )
2023-05-14 21:44:52 -03:00
matatonic
ab08cf6465
[extensions/openai] clip extra leading space ( #2042 )
2023-05-14 12:57:52 -03:00
oobabooga
5f6cf39f36
Change the injection context string
2023-05-13 14:23:02 -03:00
oobabooga
7cc17e3f1f
Refactor superbooga
2023-05-13 14:15:40 -03:00
oobabooga
826c74c201
Expand superbooga to instruct mode and change the chat implementation
2023-05-13 12:50:19 -03:00
oobabooga
c746a5bd00
Add .rstrip(' ') to openai api
2023-05-12 14:40:48 -03:00
Damian Stewart
3f1bfba718
Clarify how to start server.py with multimodal API support ( #2025 )
2023-05-12 14:37:49 -03:00
oobabooga
146a9cb393
Allow superbooga to download URLs in parallel
2023-05-12 14:19:55 -03:00
matatonic
f98fd01dcd
is_chat=False for /edits ( #2011 )
2023-05-11 19:15:11 -03:00
oobabooga
0d36c18f5d
Always return only the new tokens in generation functions
2023-05-11 17:07:20 -03:00
matatonic
c4f0e6d740
is_chat changes fix for openai extension ( #2008 )
2023-05-11 16:32:25 -03:00
oobabooga
638c6a65a2
Refactor chat functions ( #2003 )
2023-05-11 15:37:04 -03:00
matatonic
309b72e549
[extension/openai] add edits & image endpoints & fix prompt return in non --chat modes ( #1935 )
2023-05-11 11:06:39 -03:00
oobabooga
943b5e5f80
Minor bug fix
2023-05-10 23:54:25 -03:00
oobabooga
9695bfe117
Add an option for cleaning up html in superbooga
2023-05-10 23:51:52 -03:00
oobabooga
f1d10edcb7
Update README.md
2023-05-10 12:13:14 -03:00
oobabooga
c35860ff2f
Add a link to silero samples
2023-05-10 01:39:35 -03:00
oobabooga
3913155c1f
Style improvements ( #1957 )
2023-05-09 22:49:39 -03:00
missionfloyd
fe4dfc647d
SileroTTS preview ( #1934 )
2023-05-09 20:28:59 -03:00
oobabooga
8fa5f651d6
Style changes
2023-05-09 20:20:35 -03:00
Wojtab
e9e75a9ec7
Generalize multimodality (llava/minigpt4 7b and 13b now supported) ( #1741 )
2023-05-09 20:18:02 -03:00
Jeffrey Lin
791a38bad1
[extensions/openai] Support undocumented base64 'encoding_format' param for compatibility with official OpenAI client ( #1876 )
2023-05-08 22:31:34 -03:00
kaiokendev
0e27b660e8
Fix issue where n_results/k > index size ( #1929 )
2023-05-08 21:16:00 -03:00
oobabooga
b5260b24f1
Add support for custom chat styles ( #1917 )
2023-05-08 12:35:03 -03:00
oobabooga
82eb284a3f
Fix a bug in silero tts
2023-05-07 23:59:43 -03:00
oobabooga
b3bbda22d1
Exception handling
2023-05-07 16:50:45 -03:00
oobabooga
8515f19078
Fix typing error
2023-05-07 16:25:39 -03:00
oobabooga
6b67cb6611
Generalize superbooga to chat mode
2023-05-07 15:05:26 -03:00
oobabooga
ec1cda0e1f
Rename superbig to superbooga
2023-05-07 13:29:49 -03:00
oobabooga
8216c8f732
Handle multiline inputs
2023-05-07 11:54:26 -03:00
oobabooga
a35a2fab02
Reorganize superbig ui
2023-05-07 11:30:16 -03:00
oobabooga
befa307c42
Add support for loading multiple URLs into superbig
2023-05-07 11:08:02 -03:00
oobabooga
04eca9b65b
Make chunk length/count customizable
2023-05-07 05:02:04 -03:00
oobabooga
8c06eeaf84
Add requirement
2023-05-07 04:50:12 -03:00
oobabooga
58f9a30be1
Add support for input file/url in superbig
2023-05-07 04:49:02 -03:00
oobabooga
6afba065a1
Only update the chroma database when necessary
2023-05-07 04:03:17 -03:00
kaiokendev
5a4bd3918c
Add SuperBIG extension (alpha) ( #1548 )
...
---------
Co-authored-by: kaiokendev <>
Co-authored-by: oobabooga <112222186+oobabooga@users.noreply.github.com>
2023-05-07 03:50:12 -03:00
oobabooga
85238de421
Remove unused variable
2023-05-06 11:03:12 -03:00
oobabooga
de9c4e260e
Minor fixes to elevenlabs_tts
2023-05-06 10:57:34 -03:00
Steve Randall
b03a2ac512
Elevenlabs Extension Improvement and migration to official API ( #1830 )
2023-05-06 10:56:31 -03:00
oobabooga
8aafb1f796
Refactor text_generation.py, add support for custom generation functions ( #1817 )
2023-05-05 18:53:03 -03:00
oobabooga
4bf7253ec5
Fix typing bug in api
2023-05-03 19:27:20 -03:00
Thireus ☠
4883e20fa7
Fix openai extension script.py - TypeError: '_Environ' object is not callable ( #1753 )
2023-05-03 09:51:49 -03:00
Wojtab
80c2f25131
LLaVA: small fixes ( #1664 )
...
* change multimodal projector to the correct one
* remove reference to custom stopping strings from readme
* fix stopping strings if tokenizer extension adds/removes tokens
* add API example
* LLaVA 7B just dropped, add to readme that there is no support for it currently
2023-05-02 23:12:22 -03:00
oobabooga
c31b0f15a7
Remove some spaces
2023-05-02 23:07:07 -03:00
oobabooga
320fcfde4e
Style/pep8 improvements
2023-05-02 23:05:38 -03:00
matatonic
7ac41b87df
add openai compatible api ( #1475 )
2023-05-02 22:49:53 -03:00
oobabooga
88cdf6ed3d
Prevent websocket from disconnecting
2023-05-02 19:03:19 -03:00
oobabooga
d87ca8f2af
LLaVA fixes
2023-04-26 03:47:34 -03:00
oobabooga
68ed73dd89
Make API extension print its exceptions
2023-04-25 23:23:47 -03:00
Wojtab
65beb51b0b
fix returned dtypes for LLaVA ( #1547 )
2023-04-25 21:25:34 -03:00
MajdajkD
c86e9a3372
fix websocket batching ( #1511 )
2023-04-24 03:51:32 -03:00
Wojtab
04b98a8485
Fix Continue for LLaVA ( #1507 )
2023-04-23 22:58:15 -03:00
Wojtab
12212cf6be
LLaVA support ( #1487 )
2023-04-23 20:32:22 -03:00
Andy Salerno
654933c634
New universal API with streaming/blocking endpoints ( #990 )
...
Previous title: Add api_streaming extension and update api-example-stream to use it
* Merge with latest main
* Add parameter capturing encoder_repetition_penalty
* Change some defaults, minor fixes
* Add --api, --public-api flags
* remove unneeded/broken comment from blocking API startup. The comment is already correctly emitted in try_start_cloudflared by calling the lambda we pass in.
* Update on_start message for blocking_api, it should say 'non-streaming' and not 'streaming'
* Update the API examples
* Change a comment
* Update README
* Remove the gradio API
* Remove unused import
* Minor change
* Remove unused import
---------
Co-authored-by: oobabooga <112222186+oobabooga@users.noreply.github.com>
2023-04-23 15:52:43 -03:00
oobabooga
7ff645899e
Fix bug in api extension
2023-04-22 17:33:36 -03:00
