110 Commits

Author	SHA1	Message	Date
oobabooga	a4c51b5a05	API: add "user_name" and "bot_name" aliases for name1 and name2	2024-01-09 19:02:45 -08:00
oobabooga	29c2693ea0	dynatemp_low, dynatemp_high, dynatemp_exponent parameters (#5209)	2024-01-08 23:28:35 -03:00
oobabooga	0d07b3a6a1	Add dynamic_temperature_low parameter (#5198)	2024-01-07 17:03:47 -03:00
kalomaze	48327cc5c4	Dynamic Temperature HF loader support (#5174) ... --------- Co-authored-by: oobabooga <112222186+oobabooga@users.noreply.github.com>	2024-01-07 10:36:26 -03:00
Philipp Claßen	3eca20c015	Typo fixed in variable names (#5184)	2024-01-06 03:05:03 -03:00
kabachuha	dbe438564e	Support for sending images into OpenAI chat API (#4827)	2023-12-22 22:45:53 -03:00
oobabooga	23818dc098	Better logger ... Credits: vladmandic/automatic	2023-12-19 20:38:33 -08:00
Felipe Ferreira	11f082e417	[OpenAI Extension] Add more types to Embeddings Endpoint (#4895)	2023-12-15 00:26:16 -03:00
Kim Jaewon	e53f99faa0	[OpenAI Extension] Add 'max_logits' parameter in logits endpoint (#4916)	2023-12-15 00:22:43 -03:00
oobabooga	39d2fe1ed9	Jinja templates for Instruct and Chat (#4874)	2023-12-12 17:23:14 -03:00
oobabooga	2a335b8aa7	Cleanup: set shared.model_name only once	2023-12-08 06:35:23 -08:00
oobabooga	2c5a1e67f9	Parameters: change max_new_tokens & repetition_penalty_range defaults (#4842)	2023-12-07 20:04:52 -03:00
oobabooga	b6d16a35b1	Minor API fix	2023-11-21 17:56:28 -08:00
oobabooga	f0d66cf817	Add missing file	2023-11-19 10:12:13 -08:00
Jordan Tucker	cb836dd49c	fix: use shared chat-instruct_command with api (#4653)	2023-11-19 01:19:10 -03:00
oobabooga	771e62e476	Add /v1/internal/lora endpoints (#4652)	2023-11-19 00:35:22 -03:00
oobabooga	ef6feedeb2	Add --nowebui flag for pure API mode (#4651)	2023-11-18 23:38:39 -03:00
oobabooga	0fa1af296c	Add /v1/internal/logits endpoint (#4650)	2023-11-18 23:19:31 -03:00
oobabooga	8f4f4daf8b	Add --admin-key flag for API (#4649)	2023-11-18 22:33:27 -03:00
wizd	af76fbedb8	Openai embedding fix to support jina-embeddings-v2 (#4642)	2023-11-18 20:24:29 -03:00
oobabooga	e0a7cc5e0f	Simplify CORS code	2023-11-16 20:11:55 -08:00
oobabooga	c0233bb9d3	Minor message change	2023-11-16 18:36:57 -08:00
oobabooga	510a01ef46	Lint	2023-11-16 18:03:06 -08:00
oobabooga	a475aa7816	Improve API documentation	2023-11-15 18:39:08 -08:00
oobabooga	a85ce5f055	Add more info messages for truncation / instruction template	2023-11-15 16:20:31 -08:00
oobabooga	e6f44d6d19	Print context length / instruction template to terminal when loading models	2023-11-15 16:00:51 -08:00
oobabooga	be125e2708	Add /v1/internal/model/unload endpoint	2023-11-15 15:48:33 -08:00
oobabooga	52758f15da	Remove sentence-transformers requirement (for #1575)	2023-11-10 07:35:29 -08:00
oobabooga	c5be3f7acb	Make /v1/embeddings functional, add request/response types	2023-11-10 07:34:27 -08:00
oobabooga	0777b0d3c7	Add system_message parameter, document model (unused) parameter	2023-11-10 06:47:18 -08:00
oobabooga	4aabff3728	Remove old API, launch OpenAI API with --api	2023-11-10 06:39:08 -08:00
GuizzyQC	6a7cd01ebf	Fix bug with /internal/model/load (#4549) ... Update shared.model_name after loading model through API call	2023-11-10 00:16:38 -03:00
oobabooga	d86f1fd2c3	OpenAI API: stop streaming on client disconnect (closes #4521)	2023-11-09 06:37:32 -08:00
oobabooga	effb3aef42	Prevent deadlocks in OpenAI API with simultaneous requests	2023-11-08 20:55:39 -08:00
oobabooga	678fd73aef	Document /v1/internal/model/load and fix a bug	2023-11-08 17:41:12 -08:00
MrMojoR	1754a3761b	Include trust remote code usage in openai api's embedder (#4513)	2023-11-08 11:25:43 -03:00
hronoas	6c7aad11f3	openai extension: wrong frequency_penalty type (#4512)	2023-11-08 11:23:51 -03:00
oobabooga	881e8a6e70	Small bug fix in /v1/internal/model/load	2023-11-08 02:34:13 -03:00
oobabooga	050ff36bd6	Revert "Add a comment to /v1/models" ... This reverts commit 38b07493a0.	2023-11-07 21:09:47 -08:00
oobabooga	38b07493a0	Add a comment to /v1/models	2023-11-07 21:07:12 -08:00
oobabooga	2358706453	Add /v1/internal/model/load endpoint (tentative)	2023-11-07 20:58:06 -08:00
oobabooga	43c53a7820	Refactor the /v1/models endpoint	2023-11-07 19:59:27 -08:00
oobabooga	1b69694fe9	Add types to the encode/decode/token-count endpoints	2023-11-07 19:32:14 -08:00
oobabooga	f6ca9cfcdc	Add /v1/internal/model-info endpoint	2023-11-07 18:59:02 -08:00
oobabooga	6e2e0317af	Separate context and system message in instruction formats (#4499)	2023-11-07 20:02:58 -03:00
oobabooga	3fc505dc0f	Document unused parameters	2023-11-07 08:56:09 -08:00
oobabooga	3d59346871	Implement echo/suffix parameters	2023-11-07 08:43:45 -08:00
oobabooga	48c9c31440	Document the "preset" option in the API	2023-11-07 08:23:17 -08:00
oobabooga	79b3f5a546	Add /v1/internal/stop-generation to OpenAI API (#4498)	2023-11-07 00:10:42 -03:00
oobabooga	97c21e5667	Don't strip leading spaces in OpenAI API	2023-11-06 19:09:41 -08:00