Georgi Gerganov f9a6364912
llama : require first token to be BOS (#1303)
* llama : require first token to be BOS

* scripts : add ppl-run-all.sh

* perplexity : add BOS for each chunk

* readme : update perplexity values after BOS fix

* perplexity : add clarifying comments
2023-05-08 17:41:54 +03:00
..
2023-05-02 23:09:08 +03:00
2023-03-29 20:21:09 +03:00
2023-03-25 21:51:41 +02:00
2023-05-04 18:41:12 +03:00