text-generation-webui/requirements.txt

accelerate==0.20.3
colorama
datasets
einops
fastapi==0.95.2
flexgen==0.1.7
gradio_client==0.2.5
gradio==3.33.1
markdown
numpy
pandas
Pillow>=9.5.0
pyyaml
requests
safetensors==0.3.1
sentencepiece
tqdm
scipy
transformers==4.30.2
git+https://github.com/huggingface/peft@03eb378eb914fbee709ff7c86ba5b1d033b89524
bitsandbytes==0.39.1; platform_system != "Windows"
https://github.com/jllllll/bitsandbytes-windows-webui/releases/download/wheels/bitsandbytes-0.39.1-py3-none-win_amd64.whl; platform_system == "Windows"
llama-cpp-python==0.1.69; platform_system != "Windows"
https://github.com/abetlen/llama-cpp-python/releases/download/v0.1.69/llama_cpp_python-0.1.69-cp310-cp310-win_amd64.whl; platform_system == "Windows"
https://github.com/PanQiWei/AutoGPTQ/releases/download/v0.2.2/auto_gptq-0.2.2+cu117-cp310-cp310-win_amd64.whl; platform_system == "Windows"
https://github.com/PanQiWei/AutoGPTQ/releases/download/v0.2.2/auto_gptq-0.2.2+cu117-cp310-cp310-linux_x86_64.whl; platform_system == "Linux" and platform_machine == "x86_64"
https://github.com/jllllll/exllama/releases/download/0.0.6/exllama-0.0.6+cu117-cp310-cp310-win_amd64.whl; platform_system == "Windows"
https://github.com/jllllll/exllama/releases/download/0.0.6/exllama-0.0.6+cu117-cp310-cp310-linux_x86_64.whl; platform_system == "Linux" and platform_machine == "x86_64"
Bump transformers/accelerate/peft/autogptq 2023-06-09 05:25:13 +02:00			`accelerate==0.20.3`
Add 4-bit LoRA support (#1200) 2023-04-17 04:26:52 +02:00			`colorama`
New yaml character format (#337 from TheTerrasque/feature/yaml-characters) This doesn't break backward compatibility with JSON characters. 2023-04-03 01:34:25 +02:00			`datasets`
Falcon support (trust-remote-code and autogptq checkboxes) (#2367) --------- Co-authored-by: oobabooga <112222186+oobabooga@users.noreply.github.com> 2023-05-29 15:20:18 +02:00			`einops`
Pin fastapi version (for #3042) 2023-07-08 01:40:57 +02:00			`fastapi==0.95.2`
Bump flexgen version 2023-03-02 16:03:57 +01:00			`flexgen==0.1.7`
Bump gradio to 3.31.0 This fixes Google Colab lagging. 2023-05-17 03:21:05 +02:00			`gradio_client==0.2.5`
Bump gradio 2023-06-05 22:29:21 +02:00			`gradio==3.33.1`
Sort the requirements 2023-03-15 16:40:03 +01:00			`markdown`
Add softprompt support (for real this time) Is this too much voodoo for our purposes? 2023-02-13 19:25:16 +01:00			`numpy`
Add an "Evaluate" tab to calculate the perplexities of models (#1322) 2023-04-21 05:20:33 +02:00			`pandas`
Add Pillow as a requirement 2023-04-08 23:48:46 +02:00			`Pillow>=9.5.0`
Add an "Evaluate" tab to calculate the perplexities of models (#1322) 2023-04-21 05:20:33 +02:00			`pyyaml`
Add requests to requirements.txt 2023-03-11 18:47:30 +01:00			`requests`
Bump safetensors from 0.3.0 to 0.3.1 (#1720) 2023-05-02 05:42:39 +02:00			`safetensors==0.3.1`
Add sentencepiece 2023-03-05 14:02:24 +01:00			`sentencepiece`
Add tqdm to requirements.txt 2023-03-12 12:48:16 +01:00			`tqdm`
Add 'scipy' to requirements.txt #2335 (#2343) Unlisted dependency of bitsandbytes 2023-05-26 04:26:25 +02:00			`scipy`
Bump transformers from 4.30.0 to 4.30.2 (#2695) 2023-06-15 00:56:28 +02:00			`transformers==4.30.2`
Bump peft commit 2023-06-18 21:42:11 +02:00			`git+https://github.com/huggingface/peft@03eb378eb914fbee709ff7c86ba5b1d033b89524`
Update bitsandbytes to 0.39.1 (#2799) 2023-06-21 20:04:45 +02:00			`bitsandbytes==0.39.1; platform_system != "Windows"`
			`https://github.com/jllllll/bitsandbytes-windows-webui/releases/download/wheels/bitsandbytes-0.39.1-py3-none-win_amd64.whl; platform_system == "Windows"`
Bump llama-cpp-python version (#3072) Bump llama-cpp-python version to 0.1.69 2023-07-09 22:22:24 +02:00			`llama-cpp-python==0.1.69; platform_system != "Windows"`
			`https://github.com/abetlen/llama-cpp-python/releases/download/v0.1.69/llama_cpp_python-0.1.69-cp310-cp310-win_amd64.whl; platform_system == "Windows"`
Bump transformers/accelerate/peft/autogptq 2023-06-09 05:25:13 +02:00			`https://github.com/PanQiWei/AutoGPTQ/releases/download/v0.2.2/auto_gptq-0.2.2+cu117-cp310-cp310-win_amd64.whl; platform_system == "Windows"`
Use pre-compiled python module for ExLlama (#2770) 2023-06-25 01:24:17 +02:00			`https://github.com/PanQiWei/AutoGPTQ/releases/download/v0.2.2/auto_gptq-0.2.2+cu117-cp310-cp310-linux_x86_64.whl; platform_system == "Linux" and platform_machine == "x86_64"`
Bump exllama module version (#3087) https://github.com/turboderp/exllama/compare/d769533b6fe938d5533ffd3673e4751e5afa5a09...e61d4d31d44bd4dd3380fc773509c870ba74cb9f 2023-07-11 00:35:59 +02:00			`https://github.com/jllllll/exllama/releases/download/0.0.6/exllama-0.0.6+cu117-cp310-cp310-win_amd64.whl; platform_system == "Windows"`
			`https://github.com/jllllll/exllama/releases/download/0.0.6/exllama-0.0.6+cu117-cp310-cp310-linux_x86_64.whl; platform_system == "Linux" and platform_machine == "x86_64"`