llama.cpp/examples/alpaca.sh

#!/bin/bash

#
# Temporary script - will be removed in the future
#

cd `dirname $0`
cd ..

./main -m ./models/ggml-alpaca-7b-q4.bin \
       --color \
       -f ./prompts/alpaca.txt \
       --ctx_size 2048 \
       -n -1 \
       -ins -b 256 \
       --top_k 10000 \
       --temp 0.2 \
       --repeat_penalty 1.1 \
       -t 7
Add temporary helper script for Alpaca chat 2023-03-19 20:57:28 +01:00			`#!/bin/bash`
Move chat scripts into "./examples" 2023-03-25 19:36:52 +01:00
Add temporary helper script for Alpaca chat 2023-03-19 20:57:28 +01:00			`#`
			`# Temporary script - will be removed in the future`
			`#`

Move chat scripts into "./examples" 2023-03-25 19:36:52 +01:00			cd `dirname $0`
			`cd ..`

examples : Improve Alpaca Default Repeat Penalty: Better Match Alpaca.cpp Experience (#1107) * Moving parameters to separate lines for readability. * Increasing repeate_penalty to 1.1 to make alpaca more usable by default. * Adding trailing newline. 2023-04-22 08:54:33 +02:00			`./main -m ./models/ggml-alpaca-7b-q4.bin \`
			`--color \`
			`-f ./prompts/alpaca.txt \`
			`--ctx_size 2048 \`
			`-n -1 \`
			`-ins -b 256 \`
			`--top_k 10000 \`
			`--temp 0.2 \`
			`--repeat_penalty 1.1 \`
			`-t 7`