llama.cpp

mirror of https://github.com/ggerganov/llama.cpp.git synced 2025-01-10 04:20:24 +01:00

History

benchmark : add tool for timing q4_0 matrix multiplication (#653 )

* Initial version of q4_0 matrix multiplication benchmark

* Bugfix: Added dependency to ggml.o to benchmark

* Reviewer requests: added parameter for threads, switched to ggml_time_us()

* Reviewer input: removed rtsc, use epsilon for check

* Review comment: Removed set_locale

* Feature: Param for numer of iterations, Bugfix for use of parameter threads

* Reviewer suggestion: Moved to examples

* Reviewer feedback: Updated clean: and benchmark: sections

---------

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>

2023-04-13 15:46:23 +03:00

benchmark

benchmark : add tool for timing q4_0 matrix multiplication (#653 )

2023-04-13 15:46:23 +03:00

embedding

Fix whitespace, add .editorconfig, add GitHub workflow (#883 )

2023-04-11 19:45:44 +00:00

main

Fix whitespace, add .editorconfig, add GitHub workflow (#883 )

2023-04-11 19:45:44 +00:00

perplexity

Fix whitespace, add .editorconfig, add GitHub workflow (#883 )