100 Commits

Author	SHA1	Message	Date
oobabooga	8b66d83aa9	Set use_fast=True by default, create --no_use_fast flag ... This increases tokens/second for HF loaders.	2023-11-16 19:55:28 -08:00
oobabooga	923c8e25fb	Bump llama-cpp-python to 0.2.18 (#4611)	2023-11-16 22:55:14 -03:00
oobabooga	6e2e0317af	Separate context and system message in instruction formats (#4499)	2023-11-07 20:02:58 -03:00
oobabooga	af3d25a503	Disable logits_all in llamacpp_HF (makes processing 3x faster)	2023-11-07 14:35:48 -08:00
feng lui	4766a57352	transformers: add use_flash_attention_2 option (#4373)	2023-11-04 13:59:33 -03:00
oobabooga	aa5d671579	Add temperature_last parameter (#4472)	2023-11-04 13:09:07 -03:00
kalomaze	367e5e6e43	Implement Min P as a sampler option in HF loaders (#4449)	2023-11-02 16:32:51 -03:00
oobabooga	c0655475ae	Add cache_8bit option	2023-11-02 11:23:04 -07:00
Abhilash Majumder	778a010df8	Intel Gpu support initialization (#4340)	2023-10-26 23:39:51 -03:00
tdrussell	72f6fc6923	Rename additive_repetition_penalty to presence_penalty, add frequency_penalty (#4376)	2023-10-25 12:10:28 -03:00
tdrussell	4440f87722	Add additive_repetition_penalty sampler setting. (#3627)	2023-10-23 02:28:07 -03:00
oobabooga	df90d03e0b	Replace --mul_mat_q with --no_mul_mat_q	2023-10-22 12:23:03 -07:00
oobabooga	fae8062d39	Bump to latest gradio (3.47) (#4258)	2023-10-10 22:20:49 -03:00
oobabooga	b6fe6acf88	Add threads_batch parameter	2023-10-01 21:28:00 -07:00
jllllll	41a2de96e5	Bump llama-cpp-python to 0.2.11	2023-10-01 18:08:10 -05:00
StoyanStAtanasov	7e6ff8d1f0	Enable NUMA feature for llama_cpp_python (#4040)	2023-09-26 22:05:00 -03:00
oobabooga	1ca54faaf0	Improve --multi-user mode	2023-09-26 06:42:33 -07:00
oobabooga	d0d221df49	Add --use_fast option (closes #3741)	2023-09-25 12:19:43 -07:00
oobabooga	b973b91d73	Automatically filter by loader (closes #4072)	2023-09-25 10:28:35 -07:00
oobabooga	08cf150c0c	Add a grammar editor to the UI (#4061)	2023-09-24 18:05:24 -03:00
oobabooga	b227e65d86	Add grammar to llama.cpp loader (closes #4019)	2023-09-24 07:10:45 -07:00
saltacc	f01b9aa71f	Add customizable ban tokens (#3899)	2023-09-15 18:27:27 -03:00
oobabooga	1ce3c93600	Allow "Your name" field to be saved	2023-09-14 03:44:35 -07:00
oobabooga	9f199c7a4c	Use Noto Sans font ... Copied from 6c8bd06308/public/webfonts/NotoSans	2023-09-13 13:48:05 -07:00
oobabooga	ed86878f02	Remove GGML support	2023-09-11 07:44:00 -07:00
oobabooga	cec8db52e5	Add max_tokens_second param (#3533)	2023-08-29 17:44:31 -03:00
oobabooga	52ab2a6b9e	Add rope_freq_base parameter for CodeLlama	2023-08-25 06:55:15 -07:00
oobabooga	d6934bc7bc	Implement CFG for ExLlama_HF (#3666)	2023-08-24 16:27:36 -03:00
oobabooga	7cba000421	Bump llama-cpp-python, +tensor_split by @shouyiwang, +mul_mat_q (#3610)	2023-08-18 12:03:34 -03:00
oobabooga	73d9befb65	Make "Show controls" customizable through settings.yaml	2023-08-16 07:04:18 -07:00
oobabooga	2a29208224	Add a "Show controls" button to chat UI (#3590)	2023-08-16 02:39:58 -03:00
oobabooga	ccfc02a28d	Add the --disable_exllama option for AutoGPTQ (#3545 from clefever/disable-exllama)	2023-08-14 15:15:55 -03:00
oobabooga	619cb4e78b	Add "save defaults to settings.yaml" button (#3574)	2023-08-14 11:46:07 -03:00
oobabooga	4a05aa92cb	Add "send to" buttons for instruction templates ... - Remove instruction templates from prompt dropdowns (default/notebook) - Add 3 buttons to Parameters > Instruction template as a replacement - Increase the number of lines of 'negative prompt' field to 3, and add a scrollbar - When uploading a character, switch to the Character tab - When uploading chat history, switch to the Chat tab	2023-08-13 18:35:45 -07:00
oobabooga	a1a9ec895d	Unify the 3 interface modes (#3554)	2023-08-13 01:12:15 -03:00
Chris Lefever	0230fa4e9c	Add the --disable_exllama option for AutoGPTQ	2023-08-12 02:26:58 -04:00
oobabooga	65aa11890f	Refactor everything (#3481)	2023-08-06 21:49:27 -03:00
oobabooga	0af10ab49b	Add Classifier Free Guidance (CFG) for Transformers/ExLlama (#3325)	2023-08-06 17:22:48 -03:00
missionfloyd	2336b75d92	Remove unnecessary chat.js (#3445)	2023-08-04 01:58:37 -03:00
oobabooga	0e8f9354b5	Add direct download for session/chat history JSONs	2023-08-02 19:43:39 -07:00
oobabooga	e931844fe2	Add auto_max_new_tokens parameter (#3419)	2023-08-02 14:52:20 -03:00
oobabooga	b17893a58f	Revert "Add tensor split support for llama.cpp (#3171)" ... This reverts commit 031fe7225e.	2023-07-26 07:06:01 -07:00
oobabooga	c2e0d46616	Add credits	2023-07-25 15:49:04 -07:00
Shouyi	031fe7225e	Add tensor split support for llama.cpp (#3171)	2023-07-25 18:59:26 -03:00
oobabooga	a07d070b6c	Add llama-2-70b GGML support (#3285)	2023-07-24 16:37:03 -03:00
Gabriel Pena	eedb3bf023	Add low vram mode on llama cpp (#3076)	2023-07-12 11:05:13 -03:00
Ricardo Pinto	3e9da5a27c	Changed FormComponent to IOComponent (#3017) ... Co-authored-by: Ricardo Pinto <1-ricardo.pinto@users.noreply.gitlab.cognitage.com>	2023-07-11 18:52:16 -03:00
oobabooga	c21b73ff37	Minor change to ui.py	2023-07-07 09:09:14 -07:00
oobabooga	333075e726	Fix #3003	2023-07-04 11:38:35 -03:00
Panchovix	10c8c197bf	Add Support for Static NTK RoPE scaling for exllama/exllama_hf (#2955)	2023-07-04 01:13:16 -03:00