mirror of
https://github.com/ggerganov/llama.cpp.git
synced 2025-01-31 14:13:09 +01:00
39 lines
1.3 KiB
Markdown
39 lines
1.3 KiB
Markdown
|
# llama.cpp/example/simple-cmake-pkg
|
||
|
|
|
||
|
|
This program builds [simple](../simple) using a relocatable CMake package. It serves as an example of using the `find_package()` CMake command to conveniently include [llama.cpp](https://github.com/ggerganov/llama.cpp) in projects which live outside of the source tree.
|
||
|
|
|
||
|
|
## Building
|
||
|
|
|
||
|
|
Because this example is "outside of the source tree", it is important to first build/install llama.cpp using CMake. An example is provided here, but please see the [llama.cpp build instructions](../..) for more detailed build instructions.
|
||
|
|
|
||
|
|
### Considerations
|
||
|
|
|
||
|
|
When hardware acceleration libraries are used (e.g. CUDA, Metal, Vulkan, etc.), the appropriate dependencies will be searched for automatically. So, for example, when finding a package
|
||
|
|
|
||
|
|
### Build llama.cpp and install to llama.cpp/inst
|
||
|
|
|
||
|
|
```sh
|
||
|
|
git clone https://github.com/ggerganov/llama.cpp
|
||
|
|
cd llama.cpp
|
||
|
|
mkdir build
|
||
|
|
mkdir inst
|
||
|
|
cmake -S . -B build
|
||
|
|
cmake --build build
|
||
|
|
cmake --install build --prefix inst
|
||
|
|
```
|
||
|
|
|
||
|
|
### Build simple-cmake-pkg
|
||
|
|
|
||
|
|
```sh
|
||
|
|
cd examples\simple-cmake-pkg
|
||
|
|
mkdir build
|
||
|
|
cmake -S . -B build -DCMAKE_PREFIX_PATH=../../inst/lib/cmake
|
||
|
|
cmake --build build
|
||
|
|
```
|
||
|
|
|
||
|
|
### Run simple-cmake-pkg
|
||
|
|
|
||
|
|
```sh
|
||
|
|
./build/llama-simple-cmake-pkg -m ./models/llama-7b-v2/ggml-model-f16.gguf "Hello my name is"
|
||
|
|
```
|