Pavol Rusnak
1e5a6d088d
Add note about Python 3.11 to readme
2023-03-18 22:25:35 +01:00
Pavol Rusnak
554b541521
Add memory/disk requirements to readme
2023-03-18 22:25:35 +01:00
Georgi Gerganov
e81b9c81c1
Update Contributing section
2023-03-17 20:30:04 +02:00
Stephan Walter
367946c668
Don't tell users to use a bad number of threads ( #243 )
...
The readme tells people to use the command line option "-t 8", causing 8
threads to be started. On systems with fewer than 8 cores, this causes a
significant slowdown. Remove the option from the example command lines
and use /proc/cpuinfo on Linux to determine a sensible default.
2023-03-17 19:47:35 +02:00
Bernat Vadell
2af23d3043
🚀 Dockerize llamacpp ( #132 )
...
* feat: dockerize llamacpp
* feat: split build & runtime stages
* split dockerfile into main & tools
* add quantize into tool docker image
* Update .devops/tools.sh
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
* add docker action pipeline
* change CI to publish at github docker registry
* fix name runs-on macOS-latest is macos-latest (lowercase)
* include docker versioned images
* fix github action docker
* fix docker.yml
* feat: include all-in-one command tool & update readme.md
---------
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
2023-03-17 10:47:06 +01:00
Georgi Gerganov
721311070e
Update README.md
2023-03-16 15:00:09 +02:00
Georgi Gerganov
ac15de7895
Expand "Contributing" section
2023-03-16 08:55:13 +02:00
Georgi Gerganov
273abc47ff
Update hot topics - RMSnorm
2023-03-16 07:12:12 +02:00
moritzbrantner
27944c4206
fixed typo ( #178 )
2023-03-15 22:35:25 +02:00
Musab Gultekin
977295c700
Fix potential licensing issue ( #126 )
...
* Update README.md
* Update README.md
remove facebook
2023-03-15 21:39:06 +02:00
Radoslav Gerganov
60f819a2b1
Add section to README on how to run the project on Android ( #130 )
2023-03-14 15:30:08 +02:00
Georgi Gerganov
97ab2b2578
Add Misc section + update hot topics + minor fixes
2023-03-14 09:43:52 +02:00
Georgi Gerganov
7ec903d3c1
Update contribution section, hot topics, limitations, etc.
2023-03-13 19:21:51 +02:00
Pavol Rusnak
d1f224712d
Add quantize script for batch quantization ( #92 )
...
* Add quantize script for batch quantization
* Indentation
* README for new quantize.sh
* Fix script name
* Fix file list on Mac OS
---------
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
2023-03-13 18:15:20 +02:00
Georgi Gerganov
1808ee0500
Add initial contribution guidelines
2023-03-13 09:42:26 +02:00
Georgi Gerganov
1a0a74300f
Update README.md
2023-03-12 23:39:01 +02:00
Matvey Soloviev
96ea727f47
Add interactive mode ( #61 )
...
* Initial work on interactive mode.
* Improve interactive mode. Make rev. prompt optional.
* Update README to explain interactive mode.
* Fix OS X build
2023-03-12 23:13:28 +02:00
Marc Köhlbrugge
9661954835
Fix typo in README ( #45 )
2023-03-12 22:30:08 +02:00
Georgi Gerganov
7027a97837
Update README.md
2023-03-12 22:09:26 +02:00
Georgi Gerganov
7c9e54e55e
Revert "weights_only" arg - this causing more trouble than help
2023-03-12 20:59:01 +02:00
Oleksandr Nikitin
b9bd1d0141
python/pytorch compat notes ( #44 )
2023-03-12 14:16:33 +02:00
Georgi Gerganov
702fddf5c5
Clarify meaning of hacking
2023-03-12 09:03:25 +02:00
Georgi Gerganov
7d86e25bf6
README: add "Supported platforms" + update hot topics
2023-03-12 08:41:54 +02:00
Georgi Gerganov
da1a4ff01f
Update README.md
2023-03-12 01:26:32 +02:00
Juraj Bednar
6b2cb6302f
Fix a typo in model name ( #16 )
2023-03-11 19:32:20 +02:00
Georgi Gerganov
4235e3d5b3
Update README.md
2023-03-11 18:10:18 +02:00
Georgi Gerganov
f1eaff4721
Add AVX2 support for x86 architectures thanks to @Const-me !
2023-03-11 18:04:25 +02:00
Georgi Gerganov
0c6803321c
Update README.md
2023-03-11 12:31:21 +02:00
Georgi Gerganov
7211862c94
Update Makefile var + add comment
2023-03-11 12:27:02 +02:00
Georgi Gerganov
a5c5ae2f54
Update README.md
2023-03-11 11:34:25 +02:00
Georgi Gerganov
ea977e85ec
Update README.md
2023-03-11 11:34:11 +02:00
Georgi Gerganov
007a8f6f45
Support all LLaMA models + change Q4_0 quantization storage
2023-03-11 11:28:30 +02:00
Simon Willison
5f2f970d51
Include Python dependencies in README ( #6 )
2023-03-11 07:47:26 +02:00
Georgi Gerganov
73c6ed5e87
Update README.md
2023-03-11 01:30:47 +02:00
Georgi Gerganov
01eeed8fb1
Update README.md
2023-03-11 01:22:58 +02:00
Georgi Gerganov
6da2df34ee
Update README.md
2023-03-11 01:18:10 +02:00
Georgi Gerganov
920a7fe2d9
Update README.md
2023-03-11 00:55:22 +02:00
Georgi Gerganov
3a57ee59de
Update README.md
2023-03-11 00:51:46 +02:00
Georgi Gerganov
b85028522d
Update README.md
2023-03-11 00:09:19 +02:00
Georgi Gerganov
8a01f565ff
Update README.md
2023-03-10 23:53:11 +02:00
Georgi Gerganov
18ebda34d6
Update README.md
2023-03-10 21:52:27 +02:00
Georgi Gerganov
319cdb3e1f
Final touches
2023-03-10 21:50:46 +02:00
Georgi Gerganov
775328064e
Create README.md
2023-03-10 21:47:46 +02:00
