3236 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
oobabooga	74fee4f312	Update Colab-TextGen-GPU.ipynb	2023-11-10 09:18:25 -08:00
oobabooga	52758f15da	Remove sentence-transformers requirement (for #1575)	2023-11-10 07:35:29 -08:00
oobabooga	c5be3f7acb	Make /v1/embeddings functional, add request/response types	2023-11-10 07:34:27 -08:00
oobabooga	7ed2143cd6	Update 12 - OpenAI API.md	2023-11-10 11:56:04 -03:00
oobabooga	0777b0d3c7	Add system_message parameter, document model (unused) parameter	2023-11-10 06:47:18 -08:00
oobabooga	4aabff3728	Remove old API, launch OpenAI API with --api	2023-11-10 06:39:08 -08:00
GuizzyQC	6a7cd01ebf	Fix bug with /internal/model/load (#4549) ... Update shared.model_name after loading model through API call	2023-11-10 00:16:38 -03:00
oobabooga	2af7e382b1	Revert "Bump llama-cpp-python to 0.2.14" ... This reverts commit 5c3eb22ce6. The new version has issues: https://github.com/oobabooga/text-generation-webui/issues/4540 https://github.com/abetlen/llama-cpp-python/issues/893	2023-11-09 10:02:13 -08:00
oobabooga	07d66e45b4	Merge pull request #4541 from oobabooga/dev ... Merge dev branch	2023-11-09 14:53:34 -03:00
Ashley Kleynhans	372d712921	Fix deprecated API (#4539)	2023-11-09 14:51:50 -03:00
oobabooga	d86f1fd2c3	OpenAI API: stop streaming on client disconnect (closes #4521)	2023-11-09 06:37:32 -08:00
oobabooga	f7534b2f4b	Merge pull request #4532 from oobabooga/dev ... Merge dev branch	2023-11-09 09:33:55 -03:00
oobabooga	effb3aef42	Prevent deadlocks in OpenAI API with simultaneous requests	2023-11-08 20:55:39 -08:00
oobabooga	4da00b6032	Merge pull request #4522 from oobabooga/dev ... Merge dev branch	2023-11-08 22:57:08 -03:00
oobabooga	21ed9a260e	Document the new "Custom system message" field	2023-11-08 17:54:10 -08:00
oobabooga	678fd73aef	Document /v1/internal/model/load and fix a bug	2023-11-08 17:41:12 -08:00
MrMojoR	1754a3761b	Include trust remote code usage in openai api's embedder (#4513)	2023-11-08 11:25:43 -03:00
hronoas	6c7aad11f3	openai extension: wrong frequency_penalty type (#4512)	2023-11-08 11:23:51 -03:00
oobabooga	881e8a6e70	Small bug fix in /v1/internal/model/load	2023-11-08 02:34:13 -03:00
oobabooga	050ff36bd6	Revert "Add a comment to /v1/models" ... This reverts commit 38b07493a0.	2023-11-07 21:09:47 -08:00
oobabooga	38b07493a0	Add a comment to /v1/models	2023-11-07 21:07:12 -08:00
oobabooga	2358706453	Add /v1/internal/model/load endpoint (tentative)	2023-11-07 20:58:06 -08:00
oobabooga	43c53a7820	Refactor the /v1/models endpoint	2023-11-07 19:59:27 -08:00
oobabooga	1b69694fe9	Add types to the encode/decode/token-count endpoints	2023-11-07 19:32:14 -08:00
oobabooga	f6ca9cfcdc	Add /v1/internal/model-info endpoint	2023-11-07 18:59:02 -08:00
oobabooga	6e2e0317af	Separate context and system message in instruction formats (#4499)	2023-11-07 20:02:58 -03:00
oobabooga	322c170566	Document logits_all	2023-11-07 14:45:11 -08:00
oobabooga	5c0559da69	Training: fix .txt files now showing in dropdowns	2023-11-07 14:41:11 -08:00
oobabooga	af3d25a503	Disable logits_all in llamacpp_HF (makes processing 3x faster)	2023-11-07 14:35:48 -08:00
oobabooga	5c3eb22ce6	Bump llama-cpp-python to 0.2.14	2023-11-07 14:20:43 -08:00
oobabooga	3fc505dc0f	Document unused parameters	2023-11-07 08:56:09 -08:00
oobabooga	3d59346871	Implement echo/suffix parameters	2023-11-07 08:43:45 -08:00
oobabooga	cee099f131	Merge remote-tracking branch 'refs/remotes/origin/dev' into dev	2023-11-07 08:25:22 -08:00
oobabooga	48c9c31440	Document the "preset" option in the API	2023-11-07 08:23:17 -08:00
oobabooga	d59f1ad89a	Update README.md	2023-11-07 13:05:06 -03:00
oobabooga	0c440877de	Update 12 - OpenAI API.md	2023-11-07 12:59:40 -03:00
oobabooga	55dc9845cb	Update 12 - OpenAI API.md	2023-11-07 12:51:41 -03:00
oobabooga	b0b999dd68	Merge remote-tracking branch 'refs/remotes/origin/dev' into dev	2023-11-07 07:46:08 -08:00
oobabooga	2bda1a9c9b	Mention --api-key	2023-11-07 07:45:55 -08:00
oobabooga	cc04abda49	Update 12 - OpenAI API.md	2023-11-07 12:40:52 -03:00
oobabooga	ddca6948b2	Update 12 - OpenAI API.md	2023-11-07 12:39:59 -03:00
oobabooga	40e73aafce	Update 12 - OpenAI API.md	2023-11-07 12:38:39 -03:00
oobabooga	6ec997f195	Update 12 - OpenAI API.md	2023-11-07 12:36:52 -03:00
oobabooga	15d4ea180d	Merge remote-tracking branch 'refs/remotes/origin/dev' into dev	2023-11-07 07:35:36 -08:00
oobabooga	b2afdda4e8	Add more API examples	2023-11-07 07:35:04 -08:00
Morgan Cheng	349604458b	Update 12 - OpenAI API.md (#4501) ... Fix the typo in argument. It should be `--api-port` instead of `--port`. Co-authored-by: oobabooga <112222186+oobabooga@users.noreply.github.com>	2023-11-07 11:22:17 -03:00
dependabot[bot]	fd893baba1	Bump optimum from 1.13.1 to 1.14.0 (#4492)	2023-11-07 00:13:41 -03:00
dependabot[bot]	18739c8b3a	Update peft requirement from ==0.5.* to ==0.6.* (#4494)	2023-11-07 00:12:59 -03:00
oobabooga	79b3f5a546	Add /v1/internal/stop-generation to OpenAI API (#4498)	2023-11-07 00:10:42 -03:00
oobabooga	97c21e5667	Don't strip leading spaces in OpenAI API	2023-11-06 19:09:41 -08:00