Commit Graph

3485 Commits

Author SHA1 Message Date
oobabooga
9197d3fec8
Update Extensions.md 2023-04-23 16:11:17 -03:00
Andy Salerno
654933c634
New universal API with streaming/blocking endpoints (#990)
Previous title: Add api_streaming extension and update api-example-stream to use it

* Merge with latest main

* Add parameter capturing encoder_repetition_penalty

* Change some defaults, minor fixes

* Add --api, --public-api flags

* remove unneeded/broken comment from blocking API startup. The comment is already correctly emitted in try_start_cloudflared by calling the lambda we pass in.

* Update on_start message for blocking_api, it should say 'non-streaming' and not 'streaming'

* Update the API examples

* Change a comment

* Update README

* Remove the gradio API

* Remove unused import

* Minor change

* Remove unused import

---------

Co-authored-by: oobabooga <112222186+oobabooga@users.noreply.github.com>
2023-04-23 15:52:43 -03:00
oobabooga
dfbb18610f
Update INSTRUCTIONS.TXT 2023-04-23 12:58:14 -03:00
Alex "mcmonkey" Goodwin
459e725af9
Lora trainer docs (#1493) 2023-04-23 12:54:41 -03:00
oobabooga
7ff645899e Fix bug in api extension 2023-04-22 17:33:36 -03:00
AICatgirls
b992c9236a
Prevent API extension responses from getting cut off with --chat enabled (#1467) 2023-04-22 16:06:43 -03:00
oobabooga
c0b5c09860 Minor change 2023-04-22 15:15:31 -03:00
oobabooga
47666c4d00
Update GPTQ-models-(4-bit-mode).md 2023-04-22 15:12:14 -03:00
oobabooga
fcb594b90e Don't require llama.cpp models to be placed in subfolders 2023-04-22 14:56:48 -03:00
oobabooga
06b6ff6c2e
Update GPTQ-models-(4-bit-mode).md 2023-04-22 12:49:00 -03:00
oobabooga
2c6d43e60f
Update GPTQ-models-(4-bit-mode).md 2023-04-22 12:48:20 -03:00
oobabooga
7438f4f6ba Change GPTQ triton default settings 2023-04-22 12:27:30 -03:00
InconsolableCellist
e03b873460
Updating Using-LoRAs.md doc to clarify resuming training (#1474) 2023-04-22 03:35:36 -03:00
oobabooga
fe02281477
Update README.md 2023-04-22 03:05:00 -03:00
oobabooga
ef40b4e862
Update README.md 2023-04-22 03:03:39 -03:00
oobabooga
408e172ad9
Rename docker/README.md to docs/Docker.md 2023-04-22 03:03:05 -03:00
oobabooga
4d9ae44efd
Update Spell-book.md 2023-04-22 02:53:52 -03:00
oobabooga
9508f207ba
Update Using-LoRAs.md 2023-04-22 02:53:01 -03:00
oobabooga
6d4f131d0a
Update Low-VRAM-guide.md 2023-04-22 02:50:35 -03:00
oobabooga
f5c36cca40
Update LLaMA-model.md 2023-04-22 02:49:54 -03:00
oobabooga
038fa3eb39
Update README.md 2023-04-22 02:46:07 -03:00
oobabooga
b5e5b9aeae
Delete Home.md 2023-04-22 02:40:20 -03:00
oobabooga
fe6e9ea986
Update README.md 2023-04-22 02:40:08 -03:00
oobabooga
80ef7c7bcb
Add files via upload 2023-04-22 02:34:13 -03:00
oobabooga
25b433990a
Create README.md 2023-04-22 02:33:32 -03:00
oobabooga
505c2c73e8
Update README.md 2023-04-22 00:11:27 -03:00
Φφ
143e88694d
SD_api_pictures: Modefix, +hires options, UI layout change (#1400) 2023-04-21 17:49:18 -03:00
oobabooga
2dca8bb25e Sort imports 2023-04-21 17:20:59 -03:00
oobabooga
c238ba9532 Add a 'Count tokens' button 2023-04-21 17:18:34 -03:00
Lou Bernardi
a6ef2429fa
Add "do not download" and "download from HF" to download-model.py (#1439) 2023-04-21 12:54:50 -03:00
USBhost
e1aa9d5173
Support upstream GPTQ once again. (#1451) 2023-04-21 12:43:56 -03:00
oobabooga
eddd016449 Minor deletion 2023-04-21 12:41:27 -03:00
oobabooga
d46b9b7c50 Fix evaluate comment saving 2023-04-21 12:34:08 -03:00
oobabooga
5e023ae64d Change dropdown menu highlight color 2023-04-21 02:47:18 -03:00
oobabooga
2d766d2e19 Improve notebook mode button sizes 2023-04-21 02:37:58 -03:00
oobabooga
c4f4f41389
Add an "Evaluate" tab to calculate the perplexities of models (#1322) 2023-04-21 00:20:33 -03:00
oobabooga
ff0d0ac552 Api extension bug fix 2023-04-20 13:26:58 -03:00
oobabooga
96ba55501c Rename custom_stopping_strings in the api extension 2023-04-20 00:15:32 -03:00
oobabooga
7bb9036ac9 Add universal LLaMA tokenizer support 2023-04-19 21:23:51 -03:00
oobabooga
32d47e4bad Update api-example-stream.py 2023-04-19 19:49:52 -03:00
Alex "mcmonkey" Goodwin
ee30625cd1
4-Bit LoRA training + several new training options and fixes 2023-04-19 19:39:03 -03:00
oobabooga
702fe92d42 Increase truncation_length_max value 2023-04-19 17:35:38 -03:00
oobabooga
9d9ae62938 Fix stopping strings in the gradio API 2023-04-19 13:52:21 -03:00
Rudd-O
69d50e2e86
Fix download script (#1373) 2023-04-19 13:02:32 -03:00
oobabooga
49aa05054a Minor CSS fixes 2023-04-19 01:48:07 -03:00
oobabooga
b4af319fa2 Add a workaround for GALACTICA on some systems 2023-04-19 01:43:10 -03:00
oobabooga
0ba4095504 Adjust chat mode height 2023-04-19 01:35:20 -03:00
oobabooga
ab5624136a Adjust some heights 2023-04-19 01:23:09 -03:00
oobabooga
61126f4674 Change the button styles 2023-04-19 00:56:24 -03:00
oobabooga
85d3d3ccf3 Add a margin 2023-04-19 00:47:02 -03:00