Commit Graph

3 Commits

Author SHA1 Message Date
Georgi Gerganov
2fcdf869cd
batched-bench : add mmq CLI arg 2023-10-11 19:42:33 +03:00
Georgi Gerganov
daeb834da9
batched-bench : pass custom set of PP, TG and PL 2023-10-11 19:36:31 +03:00
Georgi Gerganov
026bb1b1cd
batched-bench : add readme + n_kv_max is now configurable 2023-10-11 19:10:35 +03:00