llama.cpp/examples/llama2-13b.sh

#!/bin/bash

#
# Temporary script - will be removed in the future
#

cd `dirname $0`
cd ..

./llama -m models/available/Llama2/13B/llama-2-13b.ggmlv3.q4_0.bin \
       --color \
       --ctx_size 2048 \
       -n -1 \
       -ins -b 256 \
       --top_k 10000 \
       --temp 0.2 \
       --repeat_penalty 1.1 \
       -t 8
gitignore : changes for Poetry users + chat examples (#2284) A fix in Makefile for FreeBSD users. In the platfrom x86_64 is amd64. This fix resolve compilation using CFLAGS and CXXFLAGS with -march=native and -mtune=native Add two examples for interactive mode using Llama2 models (thx TheBloke for models) Co-authored-by: Georgi Gerganov <ggerganov@gmail.com> 2023-07-21 06:53:27 -04:00			`#!/bin/bash`

			`#`
			`# Temporary script - will be removed in the future`
			`#`

			cd `dirname $0`
			`cd ..`

main: update refs -> llama fix examples/main ref 2024-06-06 15:44:05 +01:00			`./llama -m models/available/Llama2/13B/llama-2-13b.ggmlv3.q4_0.bin \`
gitignore : changes for Poetry users + chat examples (#2284) A fix in Makefile for FreeBSD users. In the platfrom x86_64 is amd64. This fix resolve compilation using CFLAGS and CXXFLAGS with -march=native and -mtune=native Add two examples for interactive mode using Llama2 models (thx TheBloke for models) Co-authored-by: Georgi Gerganov <ggerganov@gmail.com> 2023-07-21 06:53:27 -04:00			`--color \`
			`--ctx_size 2048 \`
			`-n -1 \`
			`-ins -b 256 \`
			`--top_k 10000 \`
			`--temp 0.2 \`
			`--repeat_penalty 1.1 \`
			`-t 8`