llama.cpp

mirror of https://github.com/ggerganov/llama.cpp.git synced 2025-01-10 04:20:24 +01:00

History

main : escape prompt for cfg_negative_prompt and consecutive inputs in main with interactive (#3623 )

* infill tokens correction

* serverinfill tokens correction

* removing any leading whitespace from infill suffix and removing leeading space token from suffix when params.escape

* removing any leading whitespace from infill suffix and removing leeading space token from suffix when params.escape

* only rm when params.escape, rm space if possible which is added back or rm added space token

* only rm when params.escape, rm space if possible which is added back or rm added space token

* Revert "only rm when params.escape, rm space if possible which is added back or rm added space token"

This reverts commit 63ba0b621f21077c0e3bc6ba6a327534123cb738.

* fix interactive prompt escaping and fix server infill leading space handling

* rm unnecessary bool check

* process escapes for neg prompt and interactive consec prompts

* removed unneccessary static string escape

2023-10-22 21:09:51 +03:00

CMakeLists.txt

common : fix mirostat state when using multiple sequences (#3543 )

2023-10-11 22:35:46 +03:00

common.cpp

main : escape prompt for cfg_negative_prompt and consecutive inputs in main with interactive (#3623 )

2023-10-22 21:09:51 +03:00

common.h

sampling : refactor init to use llama_sampling_params (#3696 )

2023-10-20 21:07:23 +03:00

console.cpp

…