llama.cpp/common
kalomaze 238657db23
samplers : Min-P sampler implementation [alternative to Top P/Top K] (#3841)
* Introduce the new Min-P sampler by @kalomaze
   The Min-P sampling method was designed as an alternative to Top-P, and aims to ensure a balance of quality and variety. The parameter *p* represents the minimum probability for a token to be considered, relative to the probability of the most likely token.

* Min-P enabled and set to 0.05 default

---------

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
Co-authored-by: cebtenzzre <cebtenzzre@gmail.com>
2023-10-31 20:44:49 +01:00
..
CMakeLists.txt common : fix mirostat state when using multiple sequences (#3543) 2023-10-11 22:35:46 +03:00
common.cpp samplers : Min-P sampler implementation [alternative to Top P/Top K] (#3841) 2023-10-31 20:44:49 +01:00
common.h sampling : refactor init to use llama_sampling_params (#3696) 2023-10-20 21:07:23 +03:00
console.cpp check C++ code with -Wmissing-declarations (#3184) 2023-09-15 15:38:27 -04:00
console.h gguf : new file format with flexible meta data (beta) (#2398) 2023-08-21 23:07:43 +03:00
grammar-parser.cpp ggml : fix rope + llama minor optimizations (#3560) 2023-10-20 13:02:12 +03:00
grammar-parser.h gguf : new file format with flexible meta data (beta) (#2398) 2023-08-21 23:07:43 +03:00
log.h log : disable pid in log filenames 2023-10-25 10:09:16 +03:00
sampling.cpp samplers : Min-P sampler implementation [alternative to Top P/Top K] (#3841) 2023-10-31 20:44:49 +01:00
sampling.h samplers : Min-P sampler implementation [alternative to Top P/Top K] (#3841) 2023-10-31 20:44:49 +01:00
stb_image.h examples: support LLaVA v1.5 (multimodal model) (#3436) 2023-10-12 18:23:18 +03:00
train.cpp llama : remove token functions with context args in favor of model (#3720) 2023-10-23 22:40:03 +03:00
train.h train : finetune LORA (#2632) 2023-09-28 21:40:11 +03:00