339 Commits

Author	SHA1	Message	Date
oobabooga	4b1804a438	Implement sessions + add basic multi-user support (#2991)	2023-07-04 00:03:30 -03:00
oobabooga	3443219cbc	Add repetition penalty range parameter to transformers (#2916)	2023-06-29 13:40:13 -03:00
missionfloyd	5008daa0ff	Add exception handler to load_checkpoint() (#2904)	2023-06-27 22:00:29 -03:00
oobabooga	67a83f3ad9	Use DPM++ 2M Karras for Stable Diffusion	2023-06-27 18:47:35 -03:00
Minecrafter20	40bbd53640	Add custom prompt format for SD API pictures (#1964)	2023-06-27 17:49:18 -03:00
missionfloyd	cb029cf65f	Get SD samplers from API (#2889)	2023-06-27 17:31:54 -03:00
GuizzyQC	d7a7f7896b	Add SD checkpoint selection in sd_api_pictures (#2872)	2023-06-27 17:29:27 -03:00
oobabooga	c52290de50	ExLlama with long context (#2875)	2023-06-25 22:49:26 -03:00
matatonic	b45baeea41	extensions/openai: Major docs update, fix #2852 (critical bug), minor improvements (#2849)	2023-06-24 22:50:04 -03:00
rizerphe	77baf43f6d	Add CORS support to the API (#2718)	2023-06-24 10:16:06 -03:00
matatonic	1e97aaac95	extensions/openai: docs update, model loader, minor fixes (#2557)	2023-06-17 19:15:24 -03:00
oobabooga	7ef6a50e84	Reorganize model loading UI completely (#2720)	2023-06-16 19:00:37 -03:00
oobabooga	134430bbe2	Minor change	2023-06-14 11:34:42 -03:00
oobabooga	474dc7355a	Allow API requests to use parameter presets	2023-06-14 11:32:20 -03:00
oobabooga	c6552785af	Minor cleanup	2023-06-09 00:30:22 -03:00
matatonic	7be6fe126b	extensions/api: models api for blocking_api (updated) (#2539)	2023-06-08 11:34:36 -03:00
bobzilla	643c44e975	Add ngrok shared URL ingress support (#1944)	2023-06-06 07:34:20 -03:00
matatonic	4a17a5db67	[extensions/openai] various fixes (#2533)	2023-06-06 01:43:04 -03:00
oobabooga	d183c7d29e	Fix streaming japanese/chinese characters ... Credits to matasonic for the idea	2023-06-02 02:09:52 -03:00
matatonic	a6d3f010a5	extensions/openai: include all available models in Model.list (#2368) ... Co-authored-by: Matthew Ashton <mashton-gitlab@zhero.org>	2023-05-30 22:13:37 -03:00
matatonic	e5b756ecfe	Fixes #2331, IndexError: string index out of range (#2383)	2023-05-30 22:07:40 -03:00
Yiximail	4715123f55	Add a /api/v1/stop-stream API that allows the user to interrupt the generation (#2392)	2023-05-30 22:03:40 -03:00
matatonic	ebcadc0042	extensions/openai: cross_origin + chunked_response (updated fix) (#2423)	2023-05-30 21:54:24 -03:00
matatonic	df50f077db	fixup missing tfs top_a params, defaults reorg (#2443)	2023-05-30 21:52:33 -03:00
oobabooga	8e0a997c60	Add new parameters to API extension	2023-05-29 22:03:08 -03:00
matatonic	2b7ba9586f	Fixes #2326, KeyError: 'assistant' (#2382)	2023-05-29 14:19:57 -03:00
Elias Vincent Simon	2cf711f35e	update SpeechRecognition dependency (#2345)	2023-05-26 00:34:57 -03:00
Luis Lopez	0dbc3d9b2c	Fix get_documents_ids_distances return error when n_results = 0 (#2347)	2023-05-25 23:25:36 -03:00
Luis Lopez	ee674afa50	Add superbooga time weighted history retrieval (#2080)	2023-05-25 10:22:45 -03:00
Gabriel Terrien	e50ade438a	FIX silero_tts/elevenlabs_tts activation/deactivation (#2313)	2023-05-24 10:06:38 -03:00
Anthony K	7dc87984a2	Fix spelling mistake in new name var of chat api (#2309)	2023-05-23 23:03:03 -03:00
matatonic	9714072692	[extensions/openai] use instruction templates with chat_completions (#2291)	2023-05-23 19:58:41 -03:00
oobabooga	74aae34beb	Allow passing your name to the chat API	2023-05-23 19:39:18 -03:00
oobabooga	4d94a111d4	memoize load_character to speed up the chat API	2023-05-23 00:50:58 -03:00
oobabooga	c0fd7f3257	Add mirostat parameters for llama.cpp (#2287)	2023-05-22 19:37:24 -03:00
oobabooga	e116d31180	Prevent unwanted log messages from modules	2023-05-21 22:42:34 -03:00
oobabooga	8ac3636966	Add epsilon_cutoff/eta_cutoff parameters (#2258)	2023-05-21 15:11:57 -03:00
oobabooga	767a767989	Fix elevenlabs_tts too	2023-05-21 14:11:46 -03:00
oobabooga	1e5821bd9e	Fix silero tts autoplay (attempt #2)	2023-05-21 13:25:11 -03:00
oobabooga	a5d5bb9390	Fix silero tts autoplay	2023-05-21 12:11:59 -03:00
matatonic	78b2478d9c	assistant: space fix, system: prompt fix (#2219)	2023-05-20 23:32:34 -03:00
Luis Lopez	9c53517d2c	Fix superbooga error when querying empty DB (Issue #2160) (#2212)	2023-05-20 22:27:22 -03:00
oobabooga	c5af549d4b	Add chat API (#2233)	2023-05-20 18:42:17 -03:00
oobabooga	ad0b71af11	Add missing file	2023-05-17 00:37:34 -03:00
oobabooga	a84f499718	Allow extensions to define custom CSS and JS	2023-05-17 00:30:54 -03:00
pixel	458a627ab9	fix: elevenlabs cloned voices do not show up in webui after entering API key (#2107)	2023-05-16 20:21:36 -03:00
Orbitoid	428261eede	fix: elevenlabs removed the need for the api key for refreshing voices (#2097)	2023-05-16 13:34:49 -03:00
atriantafy	26cf8c2545	add api port options (#1990)	2023-05-15 20:44:16 -03:00
oobabooga	897fa60069	Sort selected superbooga chunks by insertion order ... For better coherence	2023-05-14 22:19:29 -03:00
Luis Lopez	b07f849e41	Add superbooga chunk separator option (#2051)	2023-05-14 21:44:52 -03:00
matatonic	ab08cf6465	[extensions/openai] clip extra leading space (#2042)	2023-05-14 12:57:52 -03:00
oobabooga	5f6cf39f36	Change the injection context string	2023-05-13 14:23:02 -03:00
oobabooga	7cc17e3f1f	Refactor superbooga	2023-05-13 14:15:40 -03:00
oobabooga	826c74c201	Expand superbooga to instruct mode and change the chat implementation	2023-05-13 12:50:19 -03:00
oobabooga	c746a5bd00	Add .rstrip(' ') to openai api	2023-05-12 14:40:48 -03:00
Damian Stewart	3f1bfba718	Clarify how to start server.py with multimodal API support (#2025)	2023-05-12 14:37:49 -03:00
oobabooga	146a9cb393	Allow superbooga to download URLs in parallel	2023-05-12 14:19:55 -03:00
matatonic	f98fd01dcd	is_chat=False for /edits (#2011)	2023-05-11 19:15:11 -03:00
oobabooga	0d36c18f5d	Always return only the new tokens in generation functions	2023-05-11 17:07:20 -03:00
matatonic	c4f0e6d740	is_chat changes fix for openai extension (#2008)	2023-05-11 16:32:25 -03:00
oobabooga	638c6a65a2	Refactor chat functions (#2003)	2023-05-11 15:37:04 -03:00
matatonic	309b72e549	[extension/openai] add edits & image endpoints & fix prompt return in non --chat modes (#1935)	2023-05-11 11:06:39 -03:00
oobabooga	943b5e5f80	Minor bug fix	2023-05-10 23:54:25 -03:00
oobabooga	9695bfe117	Add an option for cleaning up html in superbooga	2023-05-10 23:51:52 -03:00
oobabooga	f1d10edcb7	Update README.md	2023-05-10 12:13:14 -03:00
oobabooga	c35860ff2f	Add a link to silero samples	2023-05-10 01:39:35 -03:00
oobabooga	3913155c1f	Style improvements (#1957)	2023-05-09 22:49:39 -03:00
missionfloyd	fe4dfc647d	SileroTTS preview (#1934)	2023-05-09 20:28:59 -03:00
oobabooga	8fa5f651d6	Style changes	2023-05-09 20:20:35 -03:00
Wojtab	e9e75a9ec7	Generalize multimodality (llava/minigpt4 7b and 13b now supported) (#1741)	2023-05-09 20:18:02 -03:00
Jeffrey Lin	791a38bad1	[extensions/openai] Support undocumented base64 'encoding_format' param for compatibility with official OpenAI client (#1876)	2023-05-08 22:31:34 -03:00
kaiokendev	0e27b660e8	Fix issue where n_results/k > index size (#1929)	2023-05-08 21:16:00 -03:00
oobabooga	b5260b24f1	Add support for custom chat styles (#1917)	2023-05-08 12:35:03 -03:00
oobabooga	82eb284a3f	Fix a bug in silero tts	2023-05-07 23:59:43 -03:00
oobabooga	b3bbda22d1	Exception handling	2023-05-07 16:50:45 -03:00
oobabooga	8515f19078	Fix typing error	2023-05-07 16:25:39 -03:00
oobabooga	6b67cb6611	Generalize superbooga to chat mode	2023-05-07 15:05:26 -03:00
oobabooga	ec1cda0e1f	Rename superbig to superbooga	2023-05-07 13:29:49 -03:00
oobabooga	8216c8f732	Handle multiline inputs	2023-05-07 11:54:26 -03:00
oobabooga	a35a2fab02	Reorganize superbig ui	2023-05-07 11:30:16 -03:00
oobabooga	befa307c42	Add support for loading multiple URLs into superbig	2023-05-07 11:08:02 -03:00
oobabooga	04eca9b65b	Make chunk length/count customizable	2023-05-07 05:02:04 -03:00
oobabooga	8c06eeaf84	Add requirement	2023-05-07 04:50:12 -03:00
oobabooga	58f9a30be1	Add support for input file/url in superbig	2023-05-07 04:49:02 -03:00
oobabooga	6afba065a1	Only update the chroma database when necessary	2023-05-07 04:03:17 -03:00
kaiokendev	5a4bd3918c	Add SuperBIG extension (alpha) (#1548) ... --------- Co-authored-by: kaiokendev <> Co-authored-by: oobabooga <112222186+oobabooga@users.noreply.github.com>	2023-05-07 03:50:12 -03:00
oobabooga	85238de421	Remove unused variable	2023-05-06 11:03:12 -03:00
oobabooga	de9c4e260e	Minor fixes to elevenlabs_tts	2023-05-06 10:57:34 -03:00
Steve Randall	b03a2ac512	Elevenlabs Extension Improvement and migration to official API (#1830)	2023-05-06 10:56:31 -03:00
oobabooga	8aafb1f796	Refactor text_generation.py, add support for custom generation functions (#1817)	2023-05-05 18:53:03 -03:00
oobabooga	4bf7253ec5	Fix typing bug in api	2023-05-03 19:27:20 -03:00
Thireus ☠	4883e20fa7	Fix openai extension script.py - TypeError: '_Environ' object is not callable (#1753)	2023-05-03 09:51:49 -03:00
Wojtab	80c2f25131	LLaVA: small fixes (#1664) ... * change multimodal projector to the correct one * remove reference to custom stopping strings from readme * fix stopping strings if tokenizer extension adds/removes tokens * add API example * LLaVA 7B just dropped, add to readme that there is no support for it currently	2023-05-02 23:12:22 -03:00
oobabooga	c31b0f15a7	Remove some spaces	2023-05-02 23:07:07 -03:00
oobabooga	320fcfde4e	Style/pep8 improvements	2023-05-02 23:05:38 -03:00
matatonic	7ac41b87df	add openai compatible api (#1475)	2023-05-02 22:49:53 -03:00
oobabooga	88cdf6ed3d	Prevent websocket from disconnecting	2023-05-02 19:03:19 -03:00
oobabooga	d87ca8f2af	LLaVA fixes	2023-04-26 03:47:34 -03:00
oobabooga	68ed73dd89	Make API extension print its exceptions	2023-04-25 23:23:47 -03:00
Wojtab	65beb51b0b	fix returned dtypes for LLaVA (#1547)	2023-04-25 21:25:34 -03:00
MajdajkD	c86e9a3372	fix websocket batching (#1511)	2023-04-24 03:51:32 -03:00
Wojtab	04b98a8485	Fix Continue for LLaVA (#1507)	2023-04-23 22:58:15 -03:00
Wojtab	12212cf6be	LLaVA support (#1487)	2023-04-23 20:32:22 -03:00
Andy Salerno	654933c634	New universal API with streaming/blocking endpoints (#990) ... Previous title: Add api_streaming extension and update api-example-stream to use it * Merge with latest main * Add parameter capturing encoder_repetition_penalty * Change some defaults, minor fixes * Add --api, --public-api flags * remove unneeded/broken comment from blocking API startup. The comment is already correctly emitted in try_start_cloudflared by calling the lambda we pass in. * Update on_start message for blocking_api, it should say 'non-streaming' and not 'streaming' * Update the API examples * Change a comment * Update README * Remove the gradio API * Remove unused import * Minor change * Remove unused import --------- Co-authored-by: oobabooga <112222186+oobabooga@users.noreply.github.com>	2023-04-23 15:52:43 -03:00
oobabooga	7ff645899e	Fix bug in api extension	2023-04-22 17:33:36 -03:00
AICatgirls	b992c9236a	Prevent API extension responses from getting cut off with --chat enabled (#1467)	2023-04-22 16:06:43 -03:00
Φφ	143e88694d	SD_api_pictures: Modefix, +hires options, UI layout change (#1400)	2023-04-21 17:49:18 -03:00
oobabooga	ff0d0ac552	Api extension bug fix	2023-04-20 13:26:58 -03:00
oobabooga	96ba55501c	Rename custom_stopping_strings in the api extension	2023-04-20 00:15:32 -03:00
oobabooga	b0c762ceba	Revert a change ... I think that this may be needed for some clients	2023-04-18 04:10:45 -03:00
oobabooga	163ea295e7	Fix but in API extension	2023-04-17 13:54:15 -03:00
oobabooga	19e3a59997	Remove unused extension	2023-04-17 11:06:08 -03:00
GuizzyQC	5011f94659	Improved compatibility between silero and sd_api_pictures (#1196)	2023-04-16 21:18:52 -03:00
oobabooga	b937c9d8c2	Add skip_special_tokens checkbox for Dolly model (#1218)	2023-04-16 14:24:49 -03:00
Lou Bernardi	4d13cc0a1f	Suppress whisper_stt pip warning (#1215)	2023-04-15 01:15:59 -03:00
oobabooga	7a0ef1c941	Reorganize whisper extension	2023-04-13 10:40:27 -03:00
Φφ	1d8526849b	SD_api_pictures: Fix for metadata (#1082)	2023-04-12 11:42:30 -03:00
oobabooga	4f7e88c043	Simplify send_pictures	2023-04-12 10:30:12 -03:00
oobabooga	80f4eabb2a	Fix send_pictures extension	2023-04-12 10:27:06 -03:00
oobabooga	49ce866c99	Fix silero_tts	2023-04-12 00:58:11 -03:00
Tymec	832ee4323d	API: add endpoint for counting tokens (#1051)	2023-04-11 23:08:42 -03:00
Alexander01998	61641a4551	Add missing new parameters to API extension	2023-04-11 22:41:13 -03:00
oobabooga	dc3c9d00a0	Update the API extension	2023-04-11 13:07:45 -03:00
oobabooga	64f5c90ee7	Fix the API extension	2023-04-10 20:14:38 -03:00
BlueprintCoding	8178fde2cb	Added dropdown to character bias. (#986)	2023-04-09 23:44:31 -03:00
Φφ	c97c270040	Send_pictures small fix (#546)	2023-04-08 01:55:16 -03:00
Φφ	ffd102e5c0	SD Api Pics extension, v.1.1 (#596)	2023-04-07 21:36:04 -03:00
oobabooga	5543a5089d	Auto-submit the whisper extension transcription	2023-04-07 15:57:51 -03:00
oobabooga	1dc464dcb0	Sort imports	2023-04-07 14:42:03 -03:00
Φφ	e563b015d8	Silero TTS offline cache (#628)	2023-04-07 12:15:57 -03:00
oobabooga	1c413ed593	Remove torch from silero	2023-04-07 11:51:50 -03:00
da3dsoul	3f922d4bfb	Extract the Preprocessing for Silero into a file and Improve it (#757)	2023-04-07 11:46:29 -03:00
oobabooga	46c4654226	More PEP8 stuff	2023-04-07 00:52:02 -03:00
oobabooga	ea6e77df72	Make the code more like PEP8 for readability (#862)	2023-04-07 00:15:45 -03:00
oobabooga	3f3e42e26c	Refactor several function calls and the API	2023-04-06 01:22:15 -03:00
oobabooga	e722c240af	Add Instruct mode	2023-04-05 13:54:50 -03:00
oobabooga	ca8bb38949	Simplify gallery	2023-04-05 00:34:17 -03:00
oobabooga	80dfba05f3	Better crop/resize cached images	2023-04-04 22:52:15 -03:00
oobabooga	65d8a24a6d	Show profile pictures in the Character tab	2023-04-04 22:28:49 -03:00
Niels Mündler	7aab88bcc6	Give API extension access to all generate_reply parameters (#744) ... * Make every parameter of the generate_reply function parameterizable * Add stopping strings as parameterizable	2023-04-03 13:31:12 -03:00
TheTerrasque	2157bb4319	New yaml character format (#337 from TheTerrasque/feature/yaml-characters) ... This doesn't break backward compatibility with JSON characters.	2023-04-02 20:34:25 -03:00
oobabooga	b0890a7925	Add shared.is_chat() function	2023-04-01 20:15:00 -03:00
oobabooga	3b90d604d7	Sort the imports	2023-03-31 02:01:48 -03:00
ye7iaserag	ec093a5af7	Fix div alignment for long strings	2023-03-31 06:54:24 +02:00
oobabooga	3737eafeaa	Remove a border and allow more characters per pagination page	2023-03-31 00:48:50 -03:00
ye7iaserag	f9940b79dc	Implement character gallery using Dataset	2023-03-31 04:56:49 +02:00
Maya Eary	d1377c37af	Fixes for api server - chat mode and integer temperature	2023-03-28 20:57:16 +03:00
Φφ	1a1e420e65	Silero_tts streaming fix ... Temporarily suppress the streaming during the audio response as it would interfere with the audio (making it stutter and play anew)	2023-03-25 21:33:30 +03:00
oobabooga	bfe960731f	Merge branch 'main' into fix/api-reload	2023-03-24 16:54:41 -03:00
oobabooga	4a724ed22f	Reorder imports	2023-03-24 16:53:56 -03:00