diff --git a/css/main.css b/css/main.css index 3c2f7a3c..a00147c8 100644 --- a/css/main.css +++ b/css/main.css @@ -150,4 +150,8 @@ button { .checkboxgroup-table div { display: grid !important; +} + +.markdown ul ol { + font-size: 100% !important; } \ No newline at end of file diff --git a/docs/Generation-parameters.md b/docs/Generation-parameters.md index 32e063c7..44774216 100644 --- a/docs/Generation-parameters.md +++ b/docs/Generation-parameters.md @@ -23,6 +23,7 @@ ExLlama only uses the following parameters: * top_p * top_k * repetition_penalty +* repetition_penalty_range * typical_p ### RWKV diff --git a/server.py b/server.py index 8de895bd..5c916c33 100644 --- a/server.py +++ b/server.py @@ -356,6 +356,25 @@ def create_settings_menus(default_preset): For a technical description of the parameters, the [transformers documentation](https://huggingface.co/docs/transformers/main_classes/text_generation#transformers.GenerationConfig) is a good reference. + The best presets, according to the [Preset Arena](https://github.com/oobabooga/oobabooga.github.io/blob/main/arena/results.md) experiment, are: + + * Instruction following: + 1) Divine Intellect + 2) Big O + 3) simple-1 + 4) Space Alien + 5) StarChat + 6) Titanic + 7) tfs-with-top-a + 8) Asterism + 9) Contrastive Search + + * Chat: + 1) Midnight Enigma + 2) Yara + 3) Shortwave + 4) Kobold-Godlike + ### Temperature Primary factor to control randomness of outputs. 0 = deterministic (only the most likely token is used). Higher value = more randomness. ### top_p