1464 Commits

Author	SHA1	Message	Date
oobabooga	64853f8509	Reapply a necessary change that I removed from #6599 (thanks @mamei16!)	2024-12-31 14:43:22 -08:00
mamei16	e953af85cd	Fix newlines in the markdown renderer (#6599) ... --------- Co-authored-by: oobabooga <oobabooga4@gmail.com>	2024-12-31 01:04:02 -03:00
oobabooga	39a5c9a49c	UI organization (#6618)	2024-12-29 11:16:17 -03:00
oobabooga	0490ee620a	UI: increase the threshold for a <li> to be considered long (some more)	2024-12-19 16:51:34 -08:00
oobabooga	89888bef56	UI: increase the threshold for a <li> to be considered long	2024-12-19 14:38:36 -08:00
oobabooga	2acec386fc	UI: improve the streaming cursor	2024-12-19 14:08:56 -08:00
oobabooga	e2fb86e5df	UI: further improve the style of lists and headings	2024-12-19 13:59:24 -08:00
oobabooga	c48e4622e8	UI: update a link	2024-12-18 06:28:14 -08:00
oobabooga	b27f6f8915	Lint	2024-12-17 20:13:32 -08:00
oobabooga	b051e2c161	UI: improve a margin for readability	2024-12-17 19:58:21 -08:00
oobabooga	60c93e0c66	UI: Set cache_type to fp16 by default	2024-12-17 19:44:20 -08:00
oobabooga	ddccc0d657	UI: minor change to log messages	2024-12-17 19:39:00 -08:00
oobabooga	3030c79e8c	UI: show progress while loading a model	2024-12-17 19:37:43 -08:00
Diner Burger	addad3c63e	Allow more granular KV cache settings (#6561)	2024-12-17 17:43:48 -03:00
oobabooga	c43ee5db11	UI: very minor color change	2024-12-17 07:59:55 -08:00
oobabooga	d769618591	Improved UI (#6575)	2024-12-17 00:47:41 -03:00
oobabooga	350758f81c	UI: Fix the history upload event	2024-11-19 20:34:53 -08:00
oobabooga	d01293861b	Merge remote-tracking branch 'refs/remotes/origin/dev' into dev	2024-11-18 10:15:36 -08:00
oobabooga	3d19746a5d	UI: improve HTML rendering for lists with sub-lists	2024-11-18 10:14:09 -08:00
mefich	1c937dad72	Filter whitespaces in downloader fields in model tab (#6518)	2024-11-18 12:01:40 -03:00
PIRI	e1061ba7e3	Make token bans work again on HF loaders (#6488)	2024-10-24 15:24:02 -03:00
oobabooga	2468cfd8bb	Merge remote-tracking branch 'refs/remotes/origin/dev' into dev	2024-10-14 13:25:27 -07:00
oobabooga	bb62e796eb	Fix locally compiled llama-cpp-python failing to import	2024-10-14 13:24:13 -07:00
oobabooga	c9a9f63d1b	Fix llama.cpp loader not being random (thanks @reydeljuego12345)	2024-10-14 13:07:07 -07:00
PIRI	03a2e70054	Fix temperature_last when temperature not in sampler priority (#6439)	2024-10-09 11:25:14 -03:00
oobabooga	49dfa0adaf	Fix the "save preset" event	2024-10-01 11:20:48 -07:00
oobabooga	93c250b9b6	Add a UI element for enable_tp	2024-10-01 11:16:15 -07:00
oobabooga	cca9d6e22d	Lint	2024-10-01 10:21:06 -07:00
oobabooga	4d9ce586d3	Update llama_cpp_python_hijack.py, fix llamacpp_hf	2024-09-30 14:49:21 -07:00
oobabooga	bbdeed3cf4	Make sampler priority high if unspecified	2024-09-29 20:45:27 -07:00
Manuel Schmid	0f90a1b50f	Do not set value for histories in chat when --multi-user is used (#6317)	2024-09-29 01:08:55 -03:00
oobabooga	c61b29b9ce	Simplify the warning when flash-attn fails to import	2024-09-28 20:33:17 -07:00
oobabooga	b92d7fd43e	Add warnings for when AutoGPTQ, TensorRT-LLM, or HQQ are missing	2024-09-28 20:30:24 -07:00
oobabooga	7276dca933	Fix a typo	2024-09-27 20:28:17 -07:00
RandoInternetPreson	46996f6519	ExllamaV2 tensor parallelism to increase multi gpu inference speeds (#6356)	2024-09-28 00:26:03 -03:00
Philipp Emanuel Weidmann	301375834e	Exclude Top Choices (XTC): A sampler that boosts creativity, breaks writing clichés, and inhibits non-verbatim repetition (#6335)	2024-09-27 22:50:12 -03:00
oobabooga	5c918c5b2d	Make it possible to sort DRY	2024-09-27 15:40:48 -07:00
oobabooga	7424f789bf	Fix the sampling monkey patch (and add more options to sampler_priority) (#6411)	2024-09-27 19:03:25 -03:00
oobabooga	bba5b36d33	Don't import PEFT unless necessary	2024-09-03 19:40:53 -07:00
oobabooga	c5b40eb555	llama.cpp: prevent prompt evaluation progress bar with just 1 step	2024-09-03 17:37:06 -07:00
GralchemOz	4c74c7a116	Fix UnicodeDecodeError for BPE-based Models (especially GLM-4) (#6357)	2024-09-02 23:00:59 -03:00
oobabooga	fd9cb26619	UI: update the DRY parameters descriptions/order	2024-08-19 19:40:17 -07:00
oobabooga	e926c03b3d	Add a --tokenizer-dir command-line flag for llamacpp_HF	2024-08-06 19:41:18 -07:00
oobabooga	30b4d8c8b2	Fix Llama 3.1 template including lengthy "tools" headers	2024-07-29 11:52:17 -07:00
oobabooga	9dcff21da9	Remove unnecessary shared.previous_model_name variable	2024-07-28 18:35:11 -07:00
oobabooga	514fb2e451	Fix UI error caused by --idle-timeout	2024-07-28 18:30:06 -07:00
oobabooga	5223c009fe	Minor change after previous commit	2024-07-27 23:13:34 -07:00
oobabooga	7050bb880e	UI: make n_ctx/max_seq_len/truncation_length numbers rather than sliders	2024-07-27 23:11:53 -07:00
Harry	078e8c8969	Make compress_pos_emb float (#6276)	2024-07-28 03:03:19 -03:00
oobabooga	ffc713f72b	UI: fix multiline LaTeX equations	2024-07-27 15:36:10 -07:00