57 Commits

Author	SHA1	Message	Date
Georgi Gerganov	eb34620aec	Add tokenizer test + revert to C++11 (#355) ... * Add test-tokenizer-0 to do a few tokenizations - feel free to expand * Added option to convert-pth-to-ggml.py script to dump just the vocabulary * Added ./models/ggml-vocab.bin containing just LLaMA vocab data (used for tests) * Added utility to load vocabulary file from previous point (temporary implementation) * Avoid using std::string_view and drop back to C++11 (hope I didn't break something) * Rename gpt_vocab -> llama_vocab * All CMake binaries go into ./bin/ now	2023-03-21 17:29:41 +02:00
Bernat Vadell	0f1b21cb90	Docker - Fix publish docker image in GitHub Registry (#235) ... * fix publish permission * try to fix docker pipeline using as password github_token & username repository_owner	2023-03-20 18:05:20 +01:00
anzz1	b2de7f18df	CI Improvements (#230) ... * CI Improvements Manual build feature, autoreleases for Windows * better CI naming convention use branch name in releases and tags	2023-03-18 09:27:12 +02:00
mmyjona	6b0df5ccf3	add ptread link to fix cmake build under linux (#114) ... * add ptread link to fix cmake build under linux * add cmake to linux and macos platform * separate make and cmake workflow --------- Co-authored-by: Sebastián A <sebastian.aedo29@gmail.com>	2023-03-17 13:38:24 -03:00
Bernat Vadell	2af23d3043	🚀 Dockerize llamacpp (#132) ... * feat: dockerize llamacpp * feat: split build & runtime stages * split dockerfile into main & tools * add quantize into tool docker image * Update .devops/tools.sh Co-authored-by: Georgi Gerganov <ggerganov@gmail.com> * add docker action pipeline * change CI to publish at github docker registry * fix name runs-on macOS-latest is macos-latest (lowercase) * include docker versioned images * fix github action docker * fix docker.yml * feat: include all-in-one command tool & update readme.md --------- Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>	2023-03-17 10:47:06 +01:00
Sebastián A	2f700a2738	Add windows to the CI (#98)	2023-03-13 22:29:10 +02:00
Georgi Gerganov	2d555e5b42	Add CI (#60)	2023-03-12 22:08:24 +02:00