Duplicated from KBaba7/llama.cpp
2a8cee5
1
2
3
4
# llama.cpp/example/parallel Simplified simulation of serving incoming requests in parallel
