oobabooga
9a202f7fb2
Prevent <ul> lists from flickering during streaming
2023-08-28 20:45:07 -07:00
oobabooga
439dd0faab
Fix stopping strings in the chat API
2023-08-28 19:40:11 -07:00
oobabooga
c75f98a6d6
Autoscroll Notebook/Default textareas during streaming
2023-08-28 18:22:03 -07:00
oobabooga
558e918fd6
Add a typing dots (...) animation to chat tab
2023-08-28 13:50:36 -07:00
oobabooga
57e9ded00c
Make it possible to scroll during streaming ( #3721 )
2023-08-28 16:03:20 -03:00
Cebtenzzre
2f5d769a8d
accept floating-point alpha value on the command line ( #3712 )
2023-08-27 18:54:43 -03:00
oobabooga
b2296dcda0
Ctrl+S to show/hide chat controls
2023-08-27 13:14:33 -07:00
Ravindra Marella
e4c3e1bdd2
Fix ctransformers model unload ( #3711 )
...
Add missing comma in model types list
Fixes marella/ctransformers#111
2023-08-27 10:53:48 -03:00
oobabooga
0c9e818bb8
Update truncation length based on max_seq_len/n_ctx
2023-08-26 23:10:45 -07:00
oobabooga
3361728da1
Change some comments
2023-08-26 22:24:44 -07:00
oobabooga
8aeae3b3f4
Fix llamacpp_HF loading
2023-08-26 22:15:06 -07:00
oobabooga
7f5370a272
Minor fixes/cosmetics
2023-08-26 22:11:07 -07:00
jllllll
4d61a7d9da
Account for deprecated GGML parameters
2023-08-26 14:07:46 -05:00
jllllll
4a999e3bcd
Use separate llama-cpp-python packages for GGML support
2023-08-26 10:40:08 -05:00
oobabooga
83640d6f43
Replace ggml occurences with gguf
2023-08-26 01:06:59 -07:00
jllllll
db42b365c9
Fix ctransformers threads auto-detection ( #3688 )
2023-08-25 14:37:02 -03:00
cal066
960980247f
ctransformers: gguf support ( #3685 )
2023-08-25 11:33:04 -03:00
oobabooga
21058c37f7
Add missing file
2023-08-25 07:10:26 -07:00
oobabooga
f4f04c8c32
Fix a typo
2023-08-25 07:08:38 -07:00
oobabooga
5c7d8bfdfd
Detect CodeLlama settings
2023-08-25 07:06:57 -07:00
oobabooga
52ab2a6b9e
Add rope_freq_base parameter for CodeLlama
2023-08-25 06:55:15 -07:00
oobabooga
feecd8190f
Unescape inline code blocks
2023-08-24 21:01:09 -07:00
oobabooga
3320accfdc
Add CFG to llamacpp_HF (second attempt) ( #3678 )
2023-08-24 20:32:21 -03:00
oobabooga
d6934bc7bc
Implement CFG for ExLlama_HF ( #3666 )
2023-08-24 16:27:36 -03:00
oobabooga
87442c6d18
Fix Notebook Logits tab
2023-08-22 21:00:12 -07:00
oobabooga
c0b119c3a3
Improve logit viewer format
2023-08-22 20:35:12 -07:00
oobabooga
8545052c9d
Add the option to use samplers in the logit viewer
2023-08-22 20:18:16 -07:00
oobabooga
25e5eaa6a6
Remove outdated training warning
2023-08-22 13:16:44 -07:00
oobabooga
335c49cc7e
Bump peft and transformers
2023-08-22 13:14:59 -07:00
cal066
e042bf8624
ctransformers: add mlock and no-mmap options ( #3649 )
2023-08-22 16:51:34 -03:00
oobabooga
6cca8b8028
Only update notebook token counter on input
...
For performance during streaming
2023-08-21 05:39:55 -07:00
oobabooga
2cb07065ec
Fix an escaping bug
2023-08-20 21:50:42 -07:00
oobabooga
a74dd9003f
Fix HTML escaping for perplexity_colors extension
2023-08-20 21:40:22 -07:00
oobabooga
57036abc76
Add "send to default/notebook" buttons to chat tab
2023-08-20 19:54:59 -07:00
oobabooga
429cacd715
Add a token counter similar to automatic1111
...
It can now be found in the Default and Notebook tabs
2023-08-20 19:37:33 -07:00
oobabooga
120fb86c6a
Add a simple logit viewer ( #3636 )
2023-08-20 20:49:21 -03:00
oobabooga
ef17da70af
Fix ExLlama truncation
2023-08-20 08:53:26 -07:00
oobabooga
ee964bcce9
Update a comment about RoPE scaling
2023-08-20 07:01:43 -07:00
missionfloyd
1cae784761
Unescape last message ( #3623 )
2023-08-19 09:29:08 -03:00
Cebtenzzre
942ad6067d
llama.cpp: make Stop button work with streaming disabled ( #3620 )
2023-08-19 00:17:27 -03:00
oobabooga
f6724a1a01
Return the visible history with "Copy last reply"
2023-08-18 13:04:45 -07:00
oobabooga
b96fd22a81
Refactor the training tab ( #3619 )
2023-08-18 16:58:38 -03:00
oobabooga
c4733000d7
Return the visible history with "Remove last"
2023-08-18 09:25:51 -07:00
oobabooga
7cba000421
Bump llama-cpp-python, +tensor_split by @shouyiwang, +mul_mat_q ( #3610 )
2023-08-18 12:03:34 -03:00
oobabooga
bdb6eb5734
Restyle the chat input box + several CSS improvements
...
- Remove extra spacing below the last chat message
- Change the background color of code blocks in dark mode
- Remove border radius from selected header bar elements
- Make the chat scrollbar more discrete
2023-08-17 11:10:38 -07:00
oobabooga
cebe07f29c
Unescape HTML inside code blocks
2023-08-16 21:08:26 -07:00
oobabooga
a4e903e932
Escape HTML in chat messages
2023-08-16 09:25:52 -07:00
oobabooga
73d9befb65
Make "Show controls" customizable through settings.yaml
2023-08-16 07:04:18 -07:00
oobabooga
2a29208224
Add a "Show controls" button to chat UI ( #3590 )
2023-08-16 02:39:58 -03:00
cal066
991bb57e43
ctransformers: Fix up model_type name consistency ( #3567 )
2023-08-14 15:17:24 -03:00