Daniel Bevenius 23b5e12eb5

simple : update error message for KV cache check (#4324) ...

This commit updates the error message that is printed when the
KV cache is not big enough to hold all the prompt and generated
tokens. Specifically it removes the reference to n_parallel and
replaces it with n_len.

Signed-off-by: Daniel Bevenius <daniel.bevenius@gmail.com>

2023-12-04 18:04:21 +02:00

..

baby-llama

build : enable more non-default compiler warnings (#3200)

2023-09-28 17:41:44 -04:00

batched

cuda : add batched cuBLAS GEMM for faster attention (#3749)

2023-10-24 16:48:37 +03:00

batched-bench

ggml : add ggml_soft_max_ext (#4256)

2023-12-01 10:51:24 +02:00

batched.swift

swift : fix prompt tokenization logic (#4321)

2023-12-04 15:43:45 +02:00

beam-search

llama : remove token functions with context args in favor of model (#3720)

2023-10-23 22:40:03 +03:00

benchmark

sync : ggml (backend v2) (#3912)

2023-11-13 14:16:23 +02:00

convert-llama2c-to-ggml

gguf : support big endian platform (#3552)

2023-10-20 14:19:40 +03:00

embedding

build : link against build info instead of compiling against it (#3879)

2023-11-02 08:50:16 +02:00

export-lora

sync : ggml (backend v2) (#3912)

2023-11-13 14:16:23 +02:00

finetune

finetune - update readme to mention llama support only (#4148)

2023-11-20 19:30:00 +01:00

gguf

check C++ code with -Wmissing-declarations (#3184)

2023-09-15 15:38:27 -04:00

infill

main : Add ChatML functionality to main example (#4046)

2023-11-20 14:56:59 +01:00

jeopardy

parallel : add option to load external prompt file (#3416)

2023-10-06 16:16:38 +03:00

llama-bench

build : link against build info instead of compiling against it (#3879)

2023-11-02 08:50:16 +02:00

llama.swiftui

swift : fix concatenation method to avoid invalid UTF8 stringfication (#4325)

2023-12-04 18:03:49 +02:00

llava

llava : ShareGPT4V compatibility (vision encoder only loading) (#4172)

2023-11-30 23:11:14 +01:00

lookahead

examples : add readme files

2023-11-29 11:00:17 +02:00

main

main : pass LOG_TEE callback to llama.cpp log (#4033)

2023-11-30 23:56:19 +02:00

main-cmake-pkg

cmake : add missed dependencies (#3763)

2023-10-24 20:48:45 +03:00

metal

sync : ggml (backend v2) (#3912)

2023-11-13 14:16:23 +02:00

parallel

llama : KV cache view API + better KV cache management (#4170)

2023-11-23 19:07:56 +02:00

perplexity

Respect tokenizer.ggml.add_bos_token value when tokenizing (#4040)

2023-11-16 19:14:37 -07:00

quantize

build : link against build info instead of compiling against it (#3879)

2023-11-02 08:50:16 +02:00

quantize-stats

build : link against build info instead of compiling against it (#3879)

2023-11-02 08:50:16 +02:00

save-load-state

build : link against build info instead of compiling against it (#3879)

2023-11-02 08:50:16 +02:00

server

server : fix OpenAI API stop field to be optional (#4299)

2023-12-03 11:10:43 +02:00

simple

simple : update error message for KV cache check (#4324)

2023-12-04 18:04:21 +02:00

speculative

examples : add readme files

2023-11-29 11:00:17 +02:00

tokenize

tokenize example: Respect normal add BOS token behavior (#4126)

2023-11-18 14:48:17 -07:00

train-text-from-scratch

sync : ggml (backend v2) (#3912)

2023-11-13 14:16:23 +02:00

alpaca.sh

alpaca.sh : update model file name (#2074)

2023-07-06 19:17:50 +03:00

chat-13B.bat

Create chat-13B.bat (#592)

2023-03-29 20:21:09 +03:00

chat-13B.sh

examples : read chat prompts from a template file (#1196)

2023-05-03 20:58:11 +03:00

chat-persistent.sh

llama : fix session saving/loading (#3400)

2023-10-03 21:04:01 +03:00

chat-vicuna.sh

examples : add chat-vicuna.sh (#1854)

2023-06-15 21:05:53 +03:00

chat.sh

main : log file (#2748)

2023-08-30 09:29:32 +03:00

CMakeLists.txt

lookahead : add example for lookahead decoding (#4207)

2023-11-26 20:33:07 +02:00

gpt4all.sh

examples : add -n to alpaca and gpt4all scripts (#706)

2023-04-13 16:03:39 +03:00

json-schema-to-grammar.py

chmod : make scripts executable (#2675)

2023-08-23 17:29:09 +03:00

llama2-13b.sh

gitignore : changes for Poetry users + chat examples (#2284)

2023-07-21 13:53:27 +03:00

llama2.sh

gitignore : changes for Poetry users + chat examples (#2284)

2023-07-21 13:53:27 +03:00

llama.vim

vim : streaming and more (#2495)

2023-08-08 14:44:48 +03:00

llm.vim

llm.vim : stop generation at multiple linebreaks, bind to <F2> (#2879)

2023-08-30 09:50:55 +03:00

make-ggml.py

make-ggml.py : compatibility with more models and GGUF (#3290)

2023-09-27 19:25:12 +03:00

Miku.sh

MIKU MAYHEM: Upgrading the Default Model for Maximum Fun 🎉 (#2287)

2023-07-21 11:13:18 +03:00

reason-act.sh

chmod : make scripts executable (#2675)

2023-08-23 17:29:09 +03:00

server-llama2-13B.sh

chmod : make scripts executable (#2675)

2023-08-23 17:29:09 +03:00