llama.cpp/examples/batched.swift/README.md · kaisser/LLM-Maroc at main

LLM-Maroc / llama.cpp /examples /batched.swift /README.md

kaisser's picture

Upload folder using huggingface_hub

305a42c verified 6 months ago

|

history blame contribute delete

112 Bytes

This is a swift clone of examples/batched.

$ make $ ./llama-batched-swift MODEL_PATH [PROMPT] [PARALLEL]