llama.cpp/examples/parallel/README.md

4 lines
94 B
Markdown
Raw Permalink Normal View History

2023-09-21 20:10:14 +02:00
# llama.cpp/example/parallel
Simplified simluation for serving incoming requests in parallel