Pham
commited on
chore: Add CLI commands
Browse files
README.md
CHANGED
|
@@ -8,12 +8,14 @@ Meta developed and released the Meta Llama 3 family of large language models (LL
|
|
| 8 |
|
| 9 |
## Variants
|
| 10 |
|
| 11 |
-
|
| 12 |
-
|
| 13 |
-
|
|
| 14 |
-
|
|
| 15 |
-
|
|
| 16 |
-
|
|
|
|
|
|
|
|
| 17 |
|
| 18 |
## Use it with Jan (UI)
|
| 19 |
|
|
|
|
| 8 |
|
| 9 |
## Variants
|
| 10 |
|
| 11 |
+
## Variants
|
| 12 |
+
|
| 13 |
+
| No | Variant | Cortex CLI command |
|
| 14 |
+
| --- | --- | --- |
|
| 15 |
+
| 1 | [8B-onnx](https://huggingface.co/cortexhub/llama3/tree/8B-onnx) | `cortex run llama3:8B-onnx` |
|
| 16 |
+
| 2 | [8B-tensorrtllm-linux-ada](https://huggingface.co/cortexhub/llama3/tree/8B-tensorrtllm-linux-ada) | `cortex run llama3:8B-tensorrtllm-linux-ada` |
|
| 17 |
+
| 3 | [8B-tensorrtllm-windows-ada](https://huggingface.co/cortexhub/llama3/tree/8B-tensorrtllm-windows-ada) | `cortex run llama3:8B-tensorrtllm-windows-ada` |
|
| 18 |
+
| 4 | [8B-gguf](https://huggingface.co/cortexhub/llama3/tree/8B-gguf) | `cortex run llama3:8B-gguf` |
|
| 19 |
|
| 20 |
## Use it with Jan (UI)
|
| 21 |
|