llama.cpp

mirror of https://github.com/ggerganov/llama.cpp.git synced 2025-01-10 04:20:24 +01:00

History

samplers : Min-P sampler implementation [alternative to Top P/Top K] (#3841 )

* Introduce the new Min-P sampler by @kalomaze
   The Min-P sampling method was designed as an alternative to Top-P, and aims to ensure a balance of quality and variety. The parameter *p* represents the minimum probability for a token to be considered, relative to the probability of the most likely token.

* Min-P enabled and set to 0.05 default

---------

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
Co-authored-by: cebtenzzre <cebtenzzre@gmail.com>

2023-10-31 20:44:49 +01:00

CMakeLists.txt

common : fix mirostat state when using multiple sequences (#3543 )

2023-10-11 22:35:46 +03:00

common.cpp

samplers : Min-P sampler implementation [alternative to Top P/Top K] (#3841 )

2023-10-31 20:44:49 +01:00

common.h

sampling : refactor init to use llama_sampling_params (#3696 )

2023-10-20 21:07:23 +03:00

console.cpp

check C++ code with -Wmissing-declarations (#3184 )