mirror of
https://github.com/ggerganov/llama.cpp.git
synced 2024-12-26 14:20:31 +01:00
1c641e6aac
* `main`/`server`: rename to `llama` / `llama-server` for consistency w/ homebrew
* server: update refs -> llama-server
gitignore llama-server
* server: simplify nix package
* main: update refs -> llama
fix examples/main ref
* main/server: fix targets
* update more names
* Update build.yml
* rm accidentally checked in bins
* update straggling refs
* Update .gitignore
* Update server-llm.sh
* main: target name -> llama-cli
* Prefix all example bins w/ llama-
* fix main refs
* rename {main->llama}-cmake-pkg binary
* prefix more cmake targets w/ llama-
* add/fix gbnf-validator subfolder to cmake
* sort cmake example subdirs
* rm bin files
* fix llama-lookup-* Makefile rules
* gitignore /llama-*
* rename Dockerfiles
* rename llama|main -> llama-cli; consistent RPM bin prefixes
* fix some missing -cli suffixes
* rename dockerfile w/ llama-cli
* rename(make): llama-baby-llama
* update dockerfile refs
* more llama-cli(.exe)
* fix test-eval-callback
* rename: llama-cli-cmake-pkg(.exe)
* address gbnf-validator unused fread warning (switched to C++ / ifstream)
* add two missing llama- prefixes
* Updating docs for eval-callback binary to use new `llama-` prefix.
* Updating a few lingering doc references for rename of main to llama-cli
* Updating `run-with-preset.py` to use new binary names.
Updating docs around `perplexity` binary rename.
* Updating documentation references for lookup-merge and export-lora
* Updating two small `main` references missed earlier in the finetune docs.
* Update apps.nix
* update grammar/README.md w/ new llama-* names
* update llama-rpc-server bin name + doc
* Revert "update llama-rpc-server bin name + doc"
This reverts commit e474ef1df4.
* add hot topic notice to README.md
* Update README.md
* Update README.md
* rename gguf-split & quantize bins refs in **/tests.sh
---------
Co-authored-by: HanClinto <hanclinto@gmail.com>
84 lines
2.6 KiB
RPMSpec
84 lines
2.6 KiB
RPMSpec
# SRPM for building from source and packaging an RPM for RPM-based distros.
|
|
# https://docs.fedoraproject.org/en-US/quick-docs/creating-rpm-packages
|
|
# Built and maintained by John Boero - boeroboy@gmail.com
|
|
# In honor of Seth Vidal https://www.redhat.com/it/blog/thank-you-seth-vidal
|
|
|
|
# Notes for llama.cpp:
|
|
# 1. Tags are currently based on hash - which will not sort asciibetically.
|
|
# We need to declare standard versioning if people want to sort latest releases.
|
|
# 2. Builds for CUDA/OpenCL support are separate, with different depenedencies.
|
|
# 3. NVidia's developer repo must be enabled with nvcc, cublas, clblas, etc installed.
|
|
# Example: https://developer.download.nvidia.com/compute/cuda/repos/fedora37/x86_64/cuda-fedora37.repo
|
|
# 4. OpenCL/CLBLAST support simply requires the ICD loader and basic opencl libraries.
|
|
# It is up to the user to install the correct vendor-specific support.
|
|
|
|
Name: llama.cpp-cuda
|
|
Version: %( date "+%%Y%%m%%d" )
|
|
Release: 1%{?dist}
|
|
Summary: CPU Inference of LLaMA model in pure C/C++ (no CUDA/OpenCL)
|
|
License: MIT
|
|
Source0: https://github.com/ggerganov/llama.cpp/archive/refs/heads/master.tar.gz
|
|
BuildRequires: coreutils make gcc-c++ git cuda-toolkit
|
|
Requires: cuda-toolkit
|
|
URL: https://github.com/ggerganov/llama.cpp
|
|
|
|
%define debug_package %{nil}
|
|
%define source_date_epoch_from_changelog 0
|
|
|
|
%description
|
|
CPU inference for Meta's Lllama2 models using default options.
|
|
|
|
%prep
|
|
%setup -n llama.cpp-master
|
|
|
|
%build
|
|
make -j LLAMA_CUDA=1
|
|
|
|
%install
|
|
mkdir -p %{buildroot}%{_bindir}/
|
|
cp -p llama-cli %{buildroot}%{_bindir}/llama-cuda-cli
|
|
cp -p llama-server %{buildroot}%{_bindir}/llama-cuda-server
|
|
cp -p llama-simple %{buildroot}%{_bindir}/llama-cuda-simple
|
|
|
|
mkdir -p %{buildroot}/usr/lib/systemd/system
|
|
%{__cat} <<EOF > %{buildroot}/usr/lib/systemd/system/llamacuda.service
|
|
[Unit]
|
|
Description=Llama.cpp server, CPU only (no GPU support in this build).
|
|
After=syslog.target network.target local-fs.target remote-fs.target nss-lookup.target
|
|
|
|
[Service]
|
|
Type=simple
|
|
EnvironmentFile=/etc/sysconfig/llama
|
|
ExecStart=/usr/bin/llama-cuda-server $LLAMA_ARGS
|
|
ExecReload=/bin/kill -s HUP $MAINPID
|
|
Restart=never
|
|
|
|
[Install]
|
|
WantedBy=default.target
|
|
EOF
|
|
|
|
mkdir -p %{buildroot}/etc/sysconfig
|
|
%{__cat} <<EOF > %{buildroot}/etc/sysconfig/llama
|
|
LLAMA_ARGS="-m /opt/llama2/ggml-model-f32.bin"
|
|
EOF
|
|
|
|
%clean
|
|
rm -rf %{buildroot}
|
|
rm -rf %{_builddir}/*
|
|
|
|
%files
|
|
%{_bindir}/llama-cuda-cli
|
|
%{_bindir}/llama-cuda-server
|
|
%{_bindir}/llama-cuda-simple
|
|
/usr/lib/systemd/system/llamacuda.service
|
|
%config /etc/sysconfig/llama
|
|
|
|
%pre
|
|
|
|
%post
|
|
|
|
%preun
|
|
%postun
|
|
|
|
%changelog
|