Update README.md
Browse files
README.md
CHANGED
|
@@ -51,13 +51,13 @@ quantized_by: Second State Inc.
|
|
| 51 |
- Run as LlamaEdge service
|
| 52 |
|
| 53 |
```bash
|
| 54 |
-
wasmedge --dir .:. --nn-preload default:GGML:AUTO:deepseek-coder-6.7b-instruct
|
| 55 |
```
|
| 56 |
|
| 57 |
- Run as LlamaEdge command app
|
| 58 |
|
| 59 |
```bash
|
| 60 |
-
wasmedge --dir .:. --nn-preload default:GGML:AUTO:deepseek-coder-6.7b-instruct
|
| 61 |
```
|
| 62 |
|
| 63 |
## Quantized GGUF Models
|
|
|
|
| 51 |
- Run as LlamaEdge service
|
| 52 |
|
| 53 |
```bash
|
| 54 |
+
wasmedge --dir .:. --nn-preload default:GGML:AUTO:deepseek-coder-6.7b-instruct-Q5_K_M.gguf llama-api-server.wasm -p deepseek-coder
|
| 55 |
```
|
| 56 |
|
| 57 |
- Run as LlamaEdge command app
|
| 58 |
|
| 59 |
```bash
|
| 60 |
+
wasmedge --dir .:. --nn-preload default:GGML:AUTO:deepseek-coder-6.7b-instruct-Q5_K_M.gguf llama-chat.wasm -p deepseek-coder
|
| 61 |
```
|
| 62 |
|
| 63 |
## Quantized GGUF Models
|