text-generation-webui/requirements.txt

colorama
datasets
einops
flexgen==0.1.7
gradio_client==0.2.5
gradio==3.33.1
markdown
numpy
pandas
Pillow>=9.5.0
pyyaml
requests
safetensors==0.3.1
sentencepiece
tqdm
scipy
git+https://github.com/huggingface/peft@3714aa2fff158fdfa637b2b65952580801d890b2
git+https://github.com/huggingface/transformers@e45e756d22206ca8fa9fb057c8c3d8fa79bf81c6
git+https://github.com/huggingface/accelerate@0226f750257b3bf2cadc4f189f9eef0c764a0467
bitsandbytes==0.39.0; platform_system != "Windows"
https://github.com/jllllll/bitsandbytes-windows-webui/raw/main/bitsandbytes-0.39.0-py3-none-any.whl; platform_system == "Windows"
llama-cpp-python==0.1.57; platform_system != "Windows"
https://github.com/abetlen/llama-cpp-python/releases/download/v0.1.56/llama_cpp_python-0.1.56-cp310-cp310-win_amd64.whl; platform_system == "Windows"
https://github.com/PanQiWei/AutoGPTQ/releases/download/v0.2.0/auto_gptq-0.2.0+cu117-cp310-cp310-win_amd64.whl; platform_system == "Windows"
https://github.com/PanQiWei/AutoGPTQ/releases/download/v0.2.0/auto_gptq-0.2.0+cu117-cp310-cp310-linux_x86_64.whl; platform_system == "Linux"
Add 4-bit LoRA support (#1200) 2023-04-16 23:26:52 -03:00			`colorama`
New yaml character format (#337 from TheTerrasque/feature/yaml-characters) This doesn't break backward compatibility with JSON characters. 2023-04-03 01:34:25 +02:00			`datasets`
Falcon support (trust-remote-code and autogptq checkboxes) (#2367) --------- Co-authored-by: oobabooga <112222186+oobabooga@users.noreply.github.com> 2023-05-29 08:20:18 -05:00			`einops`
Bump flexgen version 2023-03-02 12:03:57 -03:00			`flexgen==0.1.7`
Bump gradio to 3.31.0 This fixes Google Colab lagging. 2023-05-16 22:21:05 -03:00			`gradio_client==0.2.5`
Bump gradio 2023-06-05 17:29:21 -03:00			`gradio==3.33.1`
Sort the requirements 2023-03-15 12:40:03 -03:00			`markdown`
Add softprompt support (for real this time) Is this too much voodoo for our purposes? 2023-02-13 15:25:16 -03:00			`numpy`
Add an "Evaluate" tab to calculate the perplexities of models (#1322) 2023-04-21 00:20:33 -03:00			`pandas`
Add Pillow as a requirement 2023-04-08 18:48:46 -03:00			`Pillow>=9.5.0`
Add an "Evaluate" tab to calculate the perplexities of models (#1322) 2023-04-21 00:20:33 -03:00			`pyyaml`
Add requests to requirements.txt 2023-03-11 14:47:30 -03:00			`requests`
Bump safetensors from 0.3.0 to 0.3.1 (#1720) 2023-05-02 00:42:39 -03:00			`safetensors==0.3.1`
Add sentencepiece 2023-03-05 10:02:24 -03:00			`sentencepiece`
Add tqdm to requirements.txt 2023-03-12 08:48:16 -03:00			`tqdm`
Add 'scipy' to requirements.txt #2335 (#2343) Unlisted dependency of bitsandbytes 2023-05-25 21:26:25 -05:00			`scipy`
Add --load-in-4bit parameter (#2320) 2023-05-25 01:14:13 -03:00			`git+https://github.com/huggingface/peft@3714aa2fff158fdfa637b2b65952580801d890b2`
			`git+https://github.com/huggingface/transformers@e45e756d22206ca8fa9fb057c8c3d8fa79bf81c6`
			`git+https://github.com/huggingface/accelerate@0226f750257b3bf2cadc4f189f9eef0c764a0467`
			`bitsandbytes==0.39.0; platform_system != "Windows"`
Add windows bitsandbytes wheel by jllllll 2023-05-25 10:48:22 -03:00			`https://github.com/jllllll/bitsandbytes-windows-webui/raw/main/bitsandbytes-0.39.0-py3-none-any.whl; platform_system == "Windows"`
Bump llama-cpp-python from 0.1.56 to 0.1.57 (#2537) 2023-06-05 23:45:58 -03:00			`llama-cpp-python==0.1.57; platform_system != "Windows"`
Bump llama-cpp-python version 2023-05-31 23:29:02 -03:00			`https://github.com/abetlen/llama-cpp-python/releases/download/v0.1.56/llama_cpp_python-0.1.56-cp310-cp310-win_amd64.whl; platform_system == "Windows"`
Use cuda 11.7 instead of 11.8 2023-06-02 01:04:44 -03:00			`https://github.com/PanQiWei/AutoGPTQ/releases/download/v0.2.0/auto_gptq-0.2.0+cu117-cp310-cp310-win_amd64.whl; platform_system == "Windows"`
Fix MacOS incompatibility in requirements.txt (#2485) 2023-06-01 23:46:16 -05:00			`https://github.com/PanQiWei/AutoGPTQ/releases/download/v0.2.0/auto_gptq-0.2.0+cu117-cp310-cp310-linux_x86_64.whl; platform_system == "Linux"`