454 Commits

Author	SHA1	Message	Date
oobabooga	2358706453	Add /v1/internal/model/load endpoint (tentative)	2023-11-07 20:58:06 -08:00
oobabooga	43c53a7820	Refactor the /v1/models endpoint	2023-11-07 19:59:27 -08:00
oobabooga	1b69694fe9	Add types to the encode/decode/token-count endpoints	2023-11-07 19:32:14 -08:00
oobabooga	f6ca9cfcdc	Add /v1/internal/model-info endpoint	2023-11-07 18:59:02 -08:00
oobabooga	6e2e0317af	Separate context and system message in instruction formats (#4499)	2023-11-07 20:02:58 -03:00
oobabooga	3fc505dc0f	Document unused parameters	2023-11-07 08:56:09 -08:00
oobabooga	3d59346871	Implement echo/suffix parameters	2023-11-07 08:43:45 -08:00
oobabooga	48c9c31440	Document the "preset" option in the API	2023-11-07 08:23:17 -08:00
oobabooga	79b3f5a546	Add /v1/internal/stop-generation to OpenAI API (#4498)	2023-11-07 00:10:42 -03:00
oobabooga	97c21e5667	Don't strip leading spaces in OpenAI API	2023-11-06 19:09:41 -08:00
oobabooga	4a45dc4041	Reorder the parameters in the FastAPI documentation	2023-11-06 09:55:36 -08:00
oobabooga	0ed6a17ed4	Update warning	2023-11-06 07:17:49 -08:00
oobabooga	0db81355bc	Reorder a parameter	2023-11-06 07:11:49 -08:00
oobabooga	b87c6213ae	Remove obsolete endpoint	2023-11-06 05:45:45 -08:00
oobabooga	28fd535f9c	Make chat API more robust	2023-11-06 05:22:01 -08:00
oobabooga	ec17a5d2b7	Make OpenAI API the default API (#4430)	2023-11-06 02:38:29 -03:00
俞航	84d957ba62	[Fix] fix openai embedding_model loading as str (#4147)	2023-11-05 20:42:45 -03:00
kabachuha	e18a0460d4	fix openai extension not working because of absent new defaults (#4477)	2023-11-04 16:12:51 -03:00
oobabooga	aa5d671579	Add temperature_last parameter (#4472)	2023-11-04 13:09:07 -03:00
oobabooga	7f9c1cbb30	Change min_p default to 0.0	2023-11-03 08:25:22 -07:00
kalomaze	367e5e6e43	Implement Min P as a sampler option in HF loaders (#4449)	2023-11-02 16:32:51 -03:00
Abhilash Majumder	778a010df8	Intel Gpu support initialization (#4340)	2023-10-26 23:39:51 -03:00
GuizzyQC	317e2c857e	sd_api_pictures: fix Gradio warning message regarding custom value (#4391)	2023-10-26 23:03:21 -03:00
tdrussell	72f6fc6923	Rename additive_repetition_penalty to presence_penalty, add frequency_penalty (#4376)	2023-10-25 12:10:28 -03:00
tdrussell	4440f87722	Add additive_repetition_penalty sampler setting. (#3627)	2023-10-23 02:28:07 -03:00
Jiashu Xu	c544f5cc51	Support LLaVA v1.5 7B (#4348)	2023-10-22 12:49:04 -03:00
FartyPants (FP HAM)	6a61158adf	Training PRO a month worth of updates (#4345)	2023-10-22 12:38:09 -03:00
oobabooga	1a34927314	Make API URLs more visible	2023-10-21 21:11:07 -07:00
Haotian Liu	32984ea2f0	Support LLaVA v1.5 (#4305)	2023-10-20 02:28:14 -03:00
missionfloyd	c0ffb77fd8	More silero languages (#3950)	2023-10-16 17:12:32 -03:00
hronoas	db7ecdd274	openai: fix empty models list on query present in url (#4139)	2023-10-16 17:02:47 -03:00
Jesus Alvarez	ed66ca3cdf	Add HTTPS support to APIs (openai and default) (#4270) ... --------- Co-authored-by: oobabooga <112222186+oobabooga@users.noreply.github.com>	2023-10-13 01:31:13 -03:00
Haotian Liu	2b75d725e6	Initial support for LLaVA-LLaMA-2. (#3377)	2023-10-10 18:40:52 -03:00
James Braza	8614c9d085	README for superboogav2 (#4212) ... --------- Co-authored-by: oobabooga <112222186+oobabooga@users.noreply.github.com>	2023-10-07 19:50:39 -03:00
oobabooga	2a7cb346dd	Update the whisper_stt requirements	2023-10-06 21:01:26 -07:00
oobabooga	d33facc9fe	Bump to pytorch 11.8 (#4209)	2023-10-07 00:23:49 -03:00
Chenxiao Wang	3fb1e0236a	fix: update superboogav2 requirements.txt (#4100)	2023-09-27 23:45:59 -03:00
missionfloyd	86e7c05429	Delete extensions/Training_PRO/readme.md (#4112)	2023-09-27 23:45:13 -03:00
Sam	a0d99dcf90	fix: add missing superboogav2 dep (#4099)	2023-09-26 23:37:22 -03:00
HideLord	0845724a89	Supercharging superbooga (#3272)	2023-09-26 21:30:19 -03:00
oobabooga	08cf150c0c	Add a grammar editor to the UI (#4061)	2023-09-24 18:05:24 -03:00
oobabooga	b227e65d86	Add grammar to llama.cpp loader (closes #4019)	2023-09-24 07:10:45 -07:00
Chenxiao Wang	9de2dfa887	extensions/openai: Fix error when preparing cache for embedding models (#3995)	2023-09-24 00:58:28 -03:00
oobabooga	5dd212cf52	TTS extensions fixes after #4022	2023-09-22 14:58:51 -07:00
FartyPants	26f10854f3	Training PRO extension update (#4036)	2023-09-22 18:51:31 -03:00
oobabooga	d43d150b1e	Fix a bug in the chat API (closes #4034)	2023-09-22 09:40:07 -07:00
oobabooga	d6814d7c15	Fix a bug in the API (closes #4027)	2023-09-21 17:54:53 -07:00
Chenxiao Wang	347aed4254	extensions/openai: load extension settings via settings.yaml (#3953)	2023-09-17 22:39:29 -03:00
FartyPants	230b562d53	Training_PRO extension - added target selector (#3969)	2023-09-17 17:00:00 -03:00
oobabooga	763ea3bcb2	Improved multimodal error message	2023-09-17 09:22:16 -07:00
FartyPants	e34c6e6938	Training PRO extension (#3961)	2023-09-17 11:09:31 -03:00
Shulzhenko Anatolii	0668f4e67f	Add speechrecognition dependency for OpenAI extension (#3959)	2023-09-16 13:49:48 -03:00
wizd	cc7f345c29	add whisper api to openai plugin (#3958)	2023-09-16 12:04:04 -03:00
Lu Guanghua	cd534ba46e	Fix Google Translate escaping (#3827) ... --------- Co-authored-by: oobabooga <112222186+oobabooga@users.noreply.github.com>	2023-09-16 10:18:06 -03:00
oobabooga	f5fb1ee666	Change a comment	2023-09-15 20:16:30 -07:00
oobabooga	2c1b548cea	Minor fix	2023-09-15 20:14:32 -07:00
oobabooga	8f97e87cac	Lint the openai extension	2023-09-15 20:11:16 -07:00
saltacc	f01b9aa71f	Add customizable ban tokens (#3899)	2023-09-15 18:27:27 -03:00
jllllll	8250d0149d	Fix pydantic version conflict in elevenlabs extension (#3927)	2023-09-14 13:42:13 -03:00
Chang Chi, Meng	b61d9aef19	openai API: add support for chunked transfer encoding in POST requests (#3870)	2023-09-12 15:54:42 -03:00
missionfloyd	43ec9d1619	silero_tts: Add language option (#3878)	2023-09-12 15:49:46 -03:00
oobabooga	df123a20fc	Prevent extra keys from being saved to settings.yaml	2023-09-11 20:13:10 -07:00
oobabooga	47d1ca467b	Pin pandas version in superbooga	2023-09-11 18:34:34 -07:00
oobabooga	9331ab4798	Read GGUF metadata (#3873)	2023-09-11 18:49:30 -03:00
oobabooga	b2f7ca0d18	Cloudfare fix 2	2023-08-29 19:54:43 -07:00
oobabooga	6c16e4cecf	Cloudfare fix ... Credits: https://github.com/oobabooga/text-generation-webui/issues/1524#issuecomment-1698255209	2023-08-29 16:35:44 -07:00
oobabooga	cec8db52e5	Add max_tokens_second param (#3533)	2023-08-29 17:44:31 -03:00
oobabooga	1a642c12b5	Fix silero_tts HTML unescaping	2023-08-26 00:45:07 -07:00
oobabooga	a2c67262c7	Unescape model output for silero/elevenlabs	2023-08-24 17:27:12 -07:00
tdrussell	2da38e89e6	Fix whitespace formatting in perplexity_colors extension. (#3643)	2023-08-22 16:49:37 -03:00
oobabooga	6394fef1db	Rewrite tab detection js	2023-08-20 21:02:53 -07:00
SeanScripts	2c1fd0d72b	Add probability dropdown to perplexity_colors extension (#3148)	2023-08-20 20:28:14 -03:00
oobabooga	eaf5f0f089	Merge remote-tracking branch 'refs/remotes/origin/main'	2023-08-17 11:38:29 -07:00
oobabooga	669c640eb4	Fix extensions block appearing where it shouldn't	2023-08-17 11:37:14 -07:00
ausboss	a954b3e7de	fixes error when not specifying tunnel id (#3606)	2023-08-17 15:20:36 -03:00
oobabooga	2a29208224	Add a "Show controls" button to chat UI (#3590)	2023-08-16 02:39:58 -03:00
oobabooga	3ae2cee446	Fix empty space when the gallery is hidden	2023-08-13 06:09:27 -07:00
oobabooga	919a3cf9d0	Fix the gallery	2023-08-13 05:43:09 -07:00
oobabooga	a1a9ec895d	Unify the 3 interface modes (#3554)	2023-08-13 01:12:15 -03:00
Hans Raaf	f4caaf337a	Fix superbooga when using regenerate (#3362)	2023-08-08 23:26:28 -03:00
Friedemann Lipphardt	901b028d55	Add option for named cloudflare tunnels (#3364)	2023-08-08 22:20:27 -03:00
jllllll	2cf64474f2	Use chat_instruct_command in API (#3482)	2023-08-06 23:46:25 -03:00
oobabooga	c237ce607e	Move characters/instruction-following to instruction-templates	2023-08-06 17:50:32 -07:00
oobabooga	0af10ab49b	Add Classifier Free Guidance (CFG) for Transformers/ExLlama (#3325)	2023-08-06 17:22:48 -03:00
SodaPrettyCold	23055b21ee	[Bug fix] Remove html tags form the Prompt sent to Stable Diffusion (#3151)	2023-08-04 20:20:28 -03:00
oobabooga	ed57a79c6e	Add back silero preview by @missionfloyd (#3446)	2023-08-04 02:29:14 -03:00
matatonic	8f98268252	extensions/openai: include content-length for json replies (#3416)	2023-08-03 16:10:49 -03:00
rafa-9	d578baeb2c	Use character settings from API properties if present (#3428)	2023-08-03 15:56:40 -03:00
oobabooga	e074538b58	Revert "Make long_replies ban the eos token as well" ... This reverts commit 6c521ce967.	2023-08-02 21:45:10 -07:00
oobabooga	e931844fe2	Add auto_max_new_tokens parameter (#3419)	2023-08-02 14:52:20 -03:00
oobabooga	6c521ce967	Make long_replies ban the eos token as well	2023-08-01 18:47:49 -07:00
matatonic	9ae0eab989	extensions/openai: +Array input (batched) , +Fixes (#3309)	2023-08-01 22:26:00 -03:00
oobabooga	d06c34dea5	Add an extension that makes chat replies longer (#3363)	2023-07-31 13:34:41 -03:00
oobabooga	ca4188aabc	Update the example extension	2023-07-29 18:57:22 -07:00
GuizzyQC	4b37a2b397	sd_api_pictures: Widen sliders for image size minimum and maximum (#3326)	2023-07-26 13:49:46 -03:00
oobabooga	f24f87cfb0	Change a comment	2023-07-26 09:38:13 -07:00
oobabooga	b553c33dd0	Add a link to the gradio docs	2023-07-26 07:49:22 -07:00
oobabooga	b11f63cb18	update extensions docs	2023-07-26 07:00:33 -07:00
oobabooga	ef8637e32d	Add extension example, replace input_hijack with chat_input_modifier (#3307)	2023-07-25 18:49:56 -03:00
matatonic	90a4ab631c	extensions/openai: Fixes for: embeddings, tokens, better errors. +Docs update, +Images, +logit_bias/logprobs, +more. (#3122)	2023-07-24 11:28:12 -03:00
iongpt	74fc5dd873	Add user-agent to download-model.py requests (#3243)	2023-07-24 11:19:13 -03:00
SeanScripts	9800745db9	Color tokens by probability and/or perplexity (#3078)	2023-07-13 17:30:22 -03:00
oobabooga	2463d7c098	Spaces	2023-07-12 11:35:43 -07:00
oobabooga	e202190c4f	lint	2023-07-12 11:33:25 -07:00
oobabooga	180420d2c9	Fix send_pictures extension	2023-07-11 20:56:01 -07:00
atriantafy	d9fabdde40	Add context_instruct to API. Load default model instruction template … (#2688)	2023-07-12 00:01:03 -03:00
Keith Kjer	37bffb2e1a	Add reference to new pipeline in multimodal readme (#2947)	2023-07-11 19:04:15 -03:00
Juliano Henriquez	1fc0b5041e	substitu superboog Beatiful Soup Parser (#2996) ... * add lxml to requirments add lxml to requirments * Change Beaitful Soup Parser "lxml" parser which might be more tolerant of certain kinds of parsing errors than "html.parser" and quicker at the same time.	2023-07-11 19:02:49 -03:00
Salvador E. Tropea	ab044a5a44	Elevenlabs tts fixes (#2959) ... * [Fixed] Keep setting option for the voice - It was always changed to the first available voice - Also added an error if the selected voice isn't valid * [Fixed] elevenlabs_tts API key handling - The one from the settings wasn't applied - We always got "Enter your API key", even when the settings specified an api_key * [Added] elevenlabs_tts model selection - Now we can also use the "eleven_multilingual_v1" model. Used for anything but english.	2023-07-11 19:00:37 -03:00
matatonic	3e7feb699c	extensions/openai: Major openai extension updates & fixes (#3049) ... * many openai updates * total reorg & cleanup. * fixups * missing import os for images * +moderations, custom_stopping_strings, more fixes * fix bugs in completion streaming * moderation fix (flagged) * updated moderation categories --------- Co-authored-by: Matthew Ashton <mashton-gitlab@zhero.org>	2023-07-11 18:50:08 -03:00
Salvador E. Tropea	463aac2d65	[Added] google_translate activate param (#2961) ... - So you can quickly enable/disable it, otherwise you must select English to disable it, and then your language to enable it again.	2023-07-09 01:08:20 -03:00
Chris Rude	70b088843d	fix for issue #2475: Streaming api deadlock (#3048)	2023-07-08 23:21:20 -03:00
Brandon McClure	acf24ebb49	Whisper_stt params for model, language, and auto_submit (#3031)	2023-07-07 20:54:53 -03:00
oobabooga	70a4d5dbcf	Update chat API (fixes #3006)	2023-07-04 17:36:47 -07:00
oobabooga	463ddfffd0	Fix start_with	2023-07-03 23:32:02 -07:00
oobabooga	4b1804a438	Implement sessions + add basic multi-user support (#2991)	2023-07-04 00:03:30 -03:00
oobabooga	3443219cbc	Add repetition penalty range parameter to transformers (#2916)	2023-06-29 13:40:13 -03:00
missionfloyd	5008daa0ff	Add exception handler to load_checkpoint() (#2904)	2023-06-27 22:00:29 -03:00
oobabooga	67a83f3ad9	Use DPM++ 2M Karras for Stable Diffusion	2023-06-27 18:47:35 -03:00
Minecrafter20	40bbd53640	Add custom prompt format for SD API pictures (#1964)	2023-06-27 17:49:18 -03:00
missionfloyd	cb029cf65f	Get SD samplers from API (#2889)	2023-06-27 17:31:54 -03:00
GuizzyQC	d7a7f7896b	Add SD checkpoint selection in sd_api_pictures (#2872)	2023-06-27 17:29:27 -03:00
oobabooga	c52290de50	ExLlama with long context (#2875)	2023-06-25 22:49:26 -03:00
matatonic	b45baeea41	extensions/openai: Major docs update, fix #2852 (critical bug), minor improvements (#2849)	2023-06-24 22:50:04 -03:00
rizerphe	77baf43f6d	Add CORS support to the API (#2718)	2023-06-24 10:16:06 -03:00
matatonic	1e97aaac95	extensions/openai: docs update, model loader, minor fixes (#2557)	2023-06-17 19:15:24 -03:00
oobabooga	7ef6a50e84	Reorganize model loading UI completely (#2720)	2023-06-16 19:00:37 -03:00
oobabooga	134430bbe2	Minor change	2023-06-14 11:34:42 -03:00
oobabooga	474dc7355a	Allow API requests to use parameter presets	2023-06-14 11:32:20 -03:00
oobabooga	c6552785af	Minor cleanup	2023-06-09 00:30:22 -03:00
matatonic	7be6fe126b	extensions/api: models api for blocking_api (updated) (#2539)	2023-06-08 11:34:36 -03:00
bobzilla	643c44e975	Add ngrok shared URL ingress support (#1944)	2023-06-06 07:34:20 -03:00
matatonic	4a17a5db67	[extensions/openai] various fixes (#2533)	2023-06-06 01:43:04 -03:00
oobabooga	d183c7d29e	Fix streaming japanese/chinese characters ... Credits to matasonic for the idea	2023-06-02 02:09:52 -03:00
matatonic	a6d3f010a5	extensions/openai: include all available models in Model.list (#2368) ... Co-authored-by: Matthew Ashton <mashton-gitlab@zhero.org>	2023-05-30 22:13:37 -03:00
matatonic	e5b756ecfe	Fixes #2331, IndexError: string index out of range (#2383)	2023-05-30 22:07:40 -03:00
Yiximail	4715123f55	Add a /api/v1/stop-stream API that allows the user to interrupt the generation (#2392)	2023-05-30 22:03:40 -03:00
matatonic	ebcadc0042	extensions/openai: cross_origin + chunked_response (updated fix) (#2423)	2023-05-30 21:54:24 -03:00
matatonic	df50f077db	fixup missing tfs top_a params, defaults reorg (#2443)	2023-05-30 21:52:33 -03:00
oobabooga	8e0a997c60	Add new parameters to API extension	2023-05-29 22:03:08 -03:00
matatonic	2b7ba9586f	Fixes #2326, KeyError: 'assistant' (#2382)	2023-05-29 14:19:57 -03:00
Elias Vincent Simon	2cf711f35e	update SpeechRecognition dependency (#2345)	2023-05-26 00:34:57 -03:00
Luis Lopez	0dbc3d9b2c	Fix get_documents_ids_distances return error when n_results = 0 (#2347)	2023-05-25 23:25:36 -03:00
Luis Lopez	ee674afa50	Add superbooga time weighted history retrieval (#2080)	2023-05-25 10:22:45 -03:00
Gabriel Terrien	e50ade438a	FIX silero_tts/elevenlabs_tts activation/deactivation (#2313)	2023-05-24 10:06:38 -03:00
Anthony K	7dc87984a2	Fix spelling mistake in new name var of chat api (#2309)	2023-05-23 23:03:03 -03:00
matatonic	9714072692	[extensions/openai] use instruction templates with chat_completions (#2291)	2023-05-23 19:58:41 -03:00
oobabooga	74aae34beb	Allow passing your name to the chat API	2023-05-23 19:39:18 -03:00
oobabooga	4d94a111d4	memoize load_character to speed up the chat API	2023-05-23 00:50:58 -03:00
oobabooga	c0fd7f3257	Add mirostat parameters for llama.cpp (#2287)	2023-05-22 19:37:24 -03:00