Mirrors/text-generation-webui
1
0
Fork 0
mirror of https://github.com/oobabooga/text-generation-webui.git synced 2024-11-22 08:07:56 +01:00
Code Issues Packages Projects Releases Wiki Activity
2,861 Commits 2 Branches 52 Tags 67 MiB
3a9d90c3a1
Commit Graph

2861 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
oobabooga
3a9d90c3a1 Download models with 4 threads by default 2023-10-10 13:52:10 -07:00
dependabot[bot]
520cbb2ab1
Bump safetensors from 0.3.2 to 0.4.0 (#4249) 2023-10-10 17:41:09 -03:00
Forkoz
35695e18c7
Remove import. (#4247) 
For real this time.
 2023-10-09 18:06:11 -03:00
Forkoz
2e471071af
Update llama_attn_hijack.py (#4231) 2023-10-08 15:16:48 -03:00
oobabooga
2e8b5f7c80
Update ROCm command 2023-10-08 10:12:13 -03:00
oobabooga
00187d641a
Note about pytorch 2.1 breaking change 2023-10-08 10:10:38 -03:00
oobabooga
1c6e57dd68
Note about pytorch 2.1 breaking change 2023-10-08 10:09:22 -03:00
oobabooga
cf4d89ee65 Lint the javascript code 2023-10-07 19:07:57 -07:00
James Braza
8614c9d085
README for superboogav2 (#4212) 
---------

Co-authored-by: oobabooga <112222186+oobabooga@users.noreply.github.com>
 2023-10-07 19:50:39 -03:00
Brian Dashore
98fa73a974
Text Generation: stop if EOS token is reached (#4213) 2023-10-07 19:46:42 -03:00
Brian Dashore
7743b5e9de
Llamacpp_HF: Fix CFG cache init (#4219) 
Documentation says that model.context_params should be sent when
a new context is created. The current code uses model.params which
doesn't exist.

Signed-off-by: kingbri <bdashore3@proton.me>
 2023-10-07 19:38:29 -03:00
oobabooga
2a7cb346dd Update the whisper_stt requirements 2023-10-06 21:01:26 -07:00
jllllll
0eda9a0549
Use GPTQ wheels compatible with Pytorch 2.1 (#4210) 2023-10-07 00:35:41 -03:00
oobabooga
d33facc9fe
Bump to pytorch 11.8 (#4209) 2023-10-07 00:23:49 -03:00
AG-w
06fff3b2e9
Fix python wheels for avx requirements (#4189) 2023-10-06 15:42:44 -03:00
Casper
0aa853f575
Bump AutoAWQ to v0.1.4 (#4203) 2023-10-06 15:30:01 -03:00
oobabooga
7d3201923b Bump AutoAWQ 2023-10-05 15:14:15 -07:00
turboderp
8a98646a21
Bump ExLlamaV2 to 0.0.5 (#4186) 2023-10-05 19:12:22 -03:00
oobabooga
7ffb424c7b Add AutoAWQ to README 2023-10-05 09:22:37 -07:00
cal066
cc632c3f33
AutoAWQ: initial support (#3999) 2023-10-05 13:19:18 -03:00
oobabooga
3f56151f03 Bump to transformers 4.34 2023-10-05 08:55:14 -07:00
tdrussell
cb26163a20
Fix off-by-one error in exllama_hf caching logic (#4145) 2023-10-05 12:20:56 -03:00
Gennadij
b04c08378d
Add CMD_FLAGS.txt to .gitignore (#4181) 2023-10-05 10:02:38 -03:00
oobabooga
ae4ba3007f
Add grammar to transformers and _HF loaders (#4091) 2023-10-05 10:01:36 -03:00
oobabooga
0197fdddf1
Merge pull request #4142 from jllllll/llamacpp-0.2.11 
Bump llama-cpp-python to 0.2.11
 2023-10-02 01:31:14 -03:00
oobabooga
b6fe6acf88 Add threads_batch parameter 2023-10-01 21:28:00 -07:00
jllllll
41a2de96e5
Bump llama-cpp-python to 0.2.11 2023-10-01 18:08:10 -05:00
oobabooga
f2d82f731a Add recommended NTKv1 alpha values 2023-09-29 13:48:38 -07:00
oobabooga
abe99cddeb Extend evaluation slider bounds 2023-09-29 13:06:26 -07:00
oobabooga
96da2e1c0d Read more metadata (config.json & quantize_config.json) 2023-09-29 06:14:16 -07:00
oobabooga
56b5a4af74 exllamav2 typical_p 2023-09-28 20:10:12 -07:00
oobabooga
f8e9733412 Minor syntax change 2023-09-28 19:32:35 -07:00
oobabooga
f931184b53 Increase truncation limits to 32768 2023-09-28 19:28:22 -07:00
oobabooga
1dd13e4643 Read Transformers config.json metadata 2023-09-28 19:19:47 -07:00
oobabooga
9ccaf5eebb I forgot to add the file 2023-09-28 18:25:58 -07:00
oobabooga
92a39c619b Add Mistral support 2023-09-28 15:41:03 -07:00
oobabooga
f46ba12b42 Add flash-attn wheels for Linux 2023-09-28 14:45:52 -07:00
oobabooga
771e936769 Fix extensions install (2nd attempt) 2023-09-28 14:33:49 -07:00
快乐的我531
4e56ad55e1
Let model downloader download *.tiktoken as well (#4121) 2023-09-28 18:03:18 -03:00
oobabooga
822ba7fcbb Better error handling during install/update 2023-09-28 13:57:59 -07:00
oobabooga
85f45cafa1 Fix extensions install 2023-09-28 13:54:36 -07:00
Nathan Thomas
e145d9a0da
Update one_click.py to initialize site_packages_path variable (#4118) 2023-09-28 08:31:29 -03:00
Chenxiao Wang
3fb1e0236a
fix: update superboogav2 requirements.txt (#4100) 2023-09-27 23:45:59 -03:00
jllllll
2bd23c29cb
Bump llama-cpp-python to 0.2.7 (#4110) 2023-09-27 23:45:36 -03:00
missionfloyd
86e7c05429
Delete extensions/Training_PRO/readme.md (#4112) 2023-09-27 23:45:13 -03:00
Sam
a0d99dcf90
fix: add missing superboogav2 dep (#4099) 2023-09-26 23:37:22 -03:00
StoyanStAtanasov
7e6ff8d1f0
Enable NUMA feature for llama_cpp_python (#4040) 2023-09-26 22:05:00 -03:00
oobabooga
87ea2d96fd Add a note about RWKV loader 2023-09-26 17:43:39 -07:00
jllllll
13a54729b1
Bump exllamav2 to 0.0.4 and use pre-built wheels (#4095) 2023-09-26 21:36:14 -03:00
jllllll
3879ab5007
Expand MacOS llama.cpp support in requirements (#4094) 
Provides MacOS 12 and 13 wheels.
 2023-09-26 21:34:48 -03:00