oobabooga
9197d3fec8
Update Extensions.md
2023-04-23 16:11:17 -03:00
Andy Salerno
654933c634
New universal API with streaming/blocking endpoints ( #990 )
...
Previous title: Add api_streaming extension and update api-example-stream to use it
* Merge with latest main
* Add parameter capturing encoder_repetition_penalty
* Change some defaults, minor fixes
* Add --api, --public-api flags
* remove unneeded/broken comment from blocking API startup. The comment is already correctly emitted in try_start_cloudflared by calling the lambda we pass in.
* Update on_start message for blocking_api, it should say 'non-streaming' and not 'streaming'
* Update the API examples
* Change a comment
* Update README
* Remove the gradio API
* Remove unused import
* Minor change
* Remove unused import
---------
Co-authored-by: oobabooga <112222186+oobabooga@users.noreply.github.com>
2023-04-23 15:52:43 -03:00
Alex "mcmonkey" Goodwin
459e725af9
Lora trainer docs ( #1493 )
2023-04-23 12:54:41 -03:00
oobabooga
7ff645899e
Fix bug in api extension
2023-04-22 17:33:36 -03:00
AICatgirls
b992c9236a
Prevent API extension responses from getting cut off with --chat enabled ( #1467 )
2023-04-22 16:06:43 -03:00
oobabooga
c0b5c09860
Minor change
2023-04-22 15:15:31 -03:00
oobabooga
47666c4d00
Update GPTQ-models-(4-bit-mode).md
2023-04-22 15:12:14 -03:00
oobabooga
fcb594b90e
Don't require llama.cpp models to be placed in subfolders
2023-04-22 14:56:48 -03:00
oobabooga
06b6ff6c2e
Update GPTQ-models-(4-bit-mode).md
2023-04-22 12:49:00 -03:00
oobabooga
2c6d43e60f
Update GPTQ-models-(4-bit-mode).md
2023-04-22 12:48:20 -03:00
oobabooga
7438f4f6ba
Change GPTQ triton default settings
2023-04-22 12:27:30 -03:00
InconsolableCellist
e03b873460
Updating Using-LoRAs.md doc to clarify resuming training ( #1474 )
2023-04-22 03:35:36 -03:00
oobabooga
fe02281477
Update README.md
2023-04-22 03:05:00 -03:00
oobabooga
ef40b4e862
Update README.md
2023-04-22 03:03:39 -03:00
oobabooga
408e172ad9
Rename docker/README.md to docs/Docker.md
2023-04-22 03:03:05 -03:00
oobabooga
4d9ae44efd
Update Spell-book.md
2023-04-22 02:53:52 -03:00
oobabooga
9508f207ba
Update Using-LoRAs.md
2023-04-22 02:53:01 -03:00
oobabooga
6d4f131d0a
Update Low-VRAM-guide.md
2023-04-22 02:50:35 -03:00
oobabooga
f5c36cca40
Update LLaMA-model.md
2023-04-22 02:49:54 -03:00
oobabooga
038fa3eb39
Update README.md
2023-04-22 02:46:07 -03:00
oobabooga
b5e5b9aeae
Delete Home.md
2023-04-22 02:40:20 -03:00
oobabooga
fe6e9ea986
Update README.md
2023-04-22 02:40:08 -03:00
oobabooga
80ef7c7bcb
Add files via upload
2023-04-22 02:34:13 -03:00
oobabooga
25b433990a
Create README.md
2023-04-22 02:33:32 -03:00
oobabooga
505c2c73e8
Update README.md
2023-04-22 00:11:27 -03:00
Φφ
143e88694d
SD_api_pictures: Modefix, +hires options, UI layout change ( #1400 )
2023-04-21 17:49:18 -03:00
oobabooga
2dca8bb25e
Sort imports
2023-04-21 17:20:59 -03:00
oobabooga
c238ba9532
Add a 'Count tokens' button
2023-04-21 17:18:34 -03:00
Lou Bernardi
a6ef2429fa
Add "do not download" and "download from HF" to download-model.py ( #1439 )
2023-04-21 12:54:50 -03:00
USBhost
e1aa9d5173
Support upstream GPTQ once again. ( #1451 )
2023-04-21 12:43:56 -03:00
oobabooga
eddd016449
Minor deletion
2023-04-21 12:41:27 -03:00
oobabooga
d46b9b7c50
Fix evaluate comment saving
2023-04-21 12:34:08 -03:00
oobabooga
5e023ae64d
Change dropdown menu highlight color
2023-04-21 02:47:18 -03:00
oobabooga
2d766d2e19
Improve notebook mode button sizes
2023-04-21 02:37:58 -03:00
oobabooga
c4f4f41389
Add an "Evaluate" tab to calculate the perplexities of models ( #1322 )
2023-04-21 00:20:33 -03:00
oobabooga
ff0d0ac552
Api extension bug fix
2023-04-20 13:26:58 -03:00
oobabooga
96ba55501c
Rename custom_stopping_strings in the api extension
2023-04-20 00:15:32 -03:00
oobabooga
7bb9036ac9
Add universal LLaMA tokenizer support
2023-04-19 21:23:51 -03:00
oobabooga
32d47e4bad
Update api-example-stream.py
2023-04-19 19:49:52 -03:00
Alex "mcmonkey" Goodwin
ee30625cd1
4-Bit LoRA training + several new training options and fixes
2023-04-19 19:39:03 -03:00
oobabooga
702fe92d42
Increase truncation_length_max value
2023-04-19 17:35:38 -03:00
oobabooga
9d9ae62938
Fix stopping strings in the gradio API
2023-04-19 13:52:21 -03:00
Rudd-O
69d50e2e86
Fix download script ( #1373 )
2023-04-19 13:02:32 -03:00
oobabooga
49aa05054a
Minor CSS fixes
2023-04-19 01:48:07 -03:00
oobabooga
b4af319fa2
Add a workaround for GALACTICA on some systems
2023-04-19 01:43:10 -03:00
oobabooga
0ba4095504
Adjust chat mode height
2023-04-19 01:35:20 -03:00
oobabooga
ab5624136a
Adjust some heights
2023-04-19 01:23:09 -03:00
oobabooga
61126f4674
Change the button styles
2023-04-19 00:56:24 -03:00
oobabooga
85d3d3ccf3
Add a margin
2023-04-19 00:47:02 -03:00
oobabooga
649e4017a5
Style improvements
2023-04-19 00:36:28 -03:00