llama.cpp/chat.sh

mirror of https://github.com/ggerganov/llama.cpp.git synced 2024-12-26 06:10:29 +01:00
#!/bin/bash
#
# Temporary script - will be removed in the future
#

./main -m ./models/7B/ggml-model-q4_0.bin -b 128 -n 256 --repeat_penalty 1.0 --color -i -r "User:" -f prompts/chat-with-bob.txt
Add chat.sh script 2023-03-21 17:09:37 +01:00			`#!/bin/bash`
			`#`
			`# Temporary script - will be removed in the future`
			`#`

Immediately start processing the prompt before user input has been provided (#476) 2023-03-24 22:17:58 +01:00			`./main -m ./models/7B/ggml-model-q4_0.bin -b 128 -n 256 --repeat_penalty 1.0 --color -i -r "User:" -f prompts/chat-with-bob.txt`