Add information about presets to the UI

This commit is contained in:
oobabooga 2023-07-03 22:39:01 -07:00
parent 373555c4fb
commit 55457549cd
3 changed files with 24 additions and 0 deletions

View File

@ -150,4 +150,8 @@ button {
.checkboxgroup-table div {
display: grid !important;
}
.markdown ul ol {
font-size: 100% !important;
}

View File

@ -23,6 +23,7 @@ ExLlama only uses the following parameters:
* top_p
* top_k
* repetition_penalty
* repetition_penalty_range
* typical_p
### RWKV

View File

@ -356,6 +356,25 @@ def create_settings_menus(default_preset):
For a technical description of the parameters, the [transformers documentation](https://huggingface.co/docs/transformers/main_classes/text_generation#transformers.GenerationConfig) is a good reference.
The best presets, according to the [Preset Arena](https://github.com/oobabooga/oobabooga.github.io/blob/main/arena/results.md) experiment, are:
* Instruction following:
1) Divine Intellect
2) Big O
3) simple-1
4) Space Alien
5) StarChat
6) Titanic
7) tfs-with-top-a
8) Asterism
9) Contrastive Search
* Chat:
1) Midnight Enigma
2) Yara
3) Shortwave
4) Kobold-Godlike
### Temperature
Primary factor to control randomness of outputs. 0 = deterministic (only the most likely token is used). Higher value = more randomness.
### top_p