llama.cpp/examples/server/public_legacy
Georgi Gerganov 644fd71b44
sampling : refactor + optimize penalties sampler (#10803)
* sampling : refactor + optimize penalties sampler

ggml-ci

* common : apply ignore_eos as logit bias

ggml-ci

* batched : remove penalties sampler

* params : allow penalty_last_n == -1 to be equal to context size

ggml-ci

* common : by default, move the penalties at the end of the sampling chain

ggml-ci

* common : ignore all EOG tokens

Co-authored-by: Diego Devesa <slarengh@gmail.com>

* common : move back the penalties at the front of the sampling chain

ggml-ci

* readme : restore hint about --ignore-eos flag [no ci]

* llama : minor

ggml-ci

* webui : update

---------

Co-authored-by: Diego Devesa <slarengh@gmail.com>
2024-12-16 12:31:14 +02:00
..
colorthemes.css server : revamp chat UI with vuejs and daisyui (#10175) 2024-11-07 17:31:10 -04:00
completion.js server : revamp chat UI with vuejs and daisyui (#10175) 2024-11-07 17:31:10 -04:00
favicon.ico server : revamp chat UI with vuejs and daisyui (#10175) 2024-11-07 17:31:10 -04:00
index-new.html sampling : refactor + optimize penalties sampler (#10803) 2024-12-16 12:31:14 +02:00
index.html sampling : refactor + optimize penalties sampler (#10803) 2024-12-16 12:31:14 +02:00
index.js server : revamp chat UI with vuejs and daisyui (#10175) 2024-11-07 17:31:10 -04:00
json-schema-to-grammar.mjs server : revamp chat UI with vuejs and daisyui (#10175) 2024-11-07 17:31:10 -04:00
loading.html server : revamp chat UI with vuejs and daisyui (#10175) 2024-11-07 17:31:10 -04:00
prompt-formats.js server : revamp chat UI with vuejs and daisyui (#10175) 2024-11-07 17:31:10 -04:00
style.css server : revamp chat UI with vuejs and daisyui (#10175) 2024-11-07 17:31:10 -04:00
system-prompts.js server : revamp chat UI with vuejs and daisyui (#10175) 2024-11-07 17:31:10 -04:00
theme-beeninorder.css server : revamp chat UI with vuejs and daisyui (#10175) 2024-11-07 17:31:10 -04:00
theme-ketivah.css server : revamp chat UI with vuejs and daisyui (#10175) 2024-11-07 17:31:10 -04:00
theme-mangotango.css server : revamp chat UI with vuejs and daisyui (#10175) 2024-11-07 17:31:10 -04:00
theme-playground.css server : revamp chat UI with vuejs and daisyui (#10175) 2024-11-07 17:31:10 -04:00
theme-polarnight.css server : revamp chat UI with vuejs and daisyui (#10175) 2024-11-07 17:31:10 -04:00
theme-snowstorm.css server : revamp chat UI with vuejs and daisyui (#10175) 2024-11-07 17:31:10 -04:00