Mirrors/text-generation-webui
1
0
Fork 0
mirror of https://github.com/oobabooga/text-generation-webui.git synced 2024-10-31 06:30:15 +01:00
Code Issues Packages Projects Releases Wiki Activity
c0fd7f3257
text-generation-webui/docs/Generation-parameters.md
oobabooga c0fd7f3257
Add mirostat parameters for llama.cpp (#2287)
2023-05-22 19:37:24 -03:00

468 B
Raw Blame History

Generation parameters

For a description of the generation parameters provided by the transformers library, see this link: https://huggingface.co/docs/transformers/main_classes/text_generation#transformers.GenerationConfig

llama.cpp

llama.cpp only uses the following parameters:

  • temperature
  • top_p
  • top_k
  • repetition_penalty
  • mirostat_mode
  • mirostat_tau
  • mirostat_eta

RWKV

RWKV only uses the following parameters:

  • temperature
  • top_p
  • top_k