Mirrors/llama.cpp
1
0
Fork 0
mirror of https://github.com/ggerganov/llama.cpp.git synced 2025-01-06 02:48:57 +01:00
Code Issues Packages Projects Releases Wiki Activity
1,372 Commits 365 Branches 2,887 Tags 303 MiB
2fcdf869cd
Commit Graph

6 Commits

Author SHA1 Message Date
Georgi Gerganov
2fcdf869cd
batched-bench : add mmq CLI arg 2023-10-11 19:42:33 +03:00
Georgi Gerganov
daeb834da9
batched-bench : pass custom set of PP, TG and PL 2023-10-11 19:36:31 +03:00
Georgi Gerganov
c062ffd18c
batched-bench : init warm-up batch 2023-10-11 19:24:59 +03:00
Georgi Gerganov
026bb1b1cd
batched-bench : add readme + n_kv_max is now configurable 2023-10-11 19:10:35 +03:00
Georgi Gerganov
7438728d51
batched : minor fix table 2023-10-08 16:35:54 +03:00
Georgi Gerganov
bf06d654de
batched : add bench tool 2023-10-08 15:57:16 +03:00