From 9df3b17acf033bda18d77bffaa777d2233a344e3 Mon Sep 17 00:00:00 2001 From: Georgi Gerganov Date: Mon, 8 Jan 2024 10:03:31 +0200 Subject: [PATCH] Updated GGML Tips & Tricks (markdown) --- GGML-Tips-&-Tricks.md | 2 ++ 1 file changed, 2 insertions(+) diff --git a/GGML-Tips-&-Tricks.md b/GGML-Tips-&-Tricks.md index 26401f8..270ff1f 100644 --- a/GGML-Tips-&-Tricks.md +++ b/GGML-Tips-&-Tricks.md @@ -101,6 +101,8 @@ index 3413288..7578bfa 100644 { ``` +Note: [`n_past` is now replaced with `batch.pos[]`](https://github.com/ggerganov/llama.cpp/issues/4819#issuecomment-1880471864) + - LLaMAv2 7B, `n_past == 45`, `n_batch == 1` ![image](https://github.com/ggerganov/llama.cpp/assets/1991296/93ac4a44-e7e6-4a9e-a332-b38c642847cc)