From 772d4080b216b5961060cad657fee3bcf5d5ea41 Mon Sep 17 00:00:00 2001 From: Meng-Yuan Huang Date: Fri, 16 Jun 2023 11:00:24 +0800 Subject: [PATCH] Update llama.cpp-models.md for macOS (#2711) --- docs/llama.cpp-models.md | 7 +++++++ 1 file changed, 7 insertions(+) diff --git a/docs/llama.cpp-models.md b/docs/llama.cpp-models.md index 0319a7c2..bcf3c046 100644 --- a/docs/llama.cpp-models.md +++ b/docs/llama.cpp-models.md @@ -35,6 +35,13 @@ set FORCE_CMAKE=1 pip install llama-cpp-python --no-cache-dir ``` +#### macOS + +``` +pip uninstall -y llama-cpp-python +CMAKE_ARGS="-DLLAMA_METAL=on" FORCE_CMAKE=1 pip install llama-cpp-python --no-cache-dir +``` + Here you can find the different compilation options for OpenBLAS / cuBLAS / CLBlast: https://pypi.org/project/llama-cpp-python/ ## Performance