Update README.md
Browse files
README.md
CHANGED
|
@@ -113,9 +113,9 @@ model-index:
|
|
| 113 |
name: Open LLM Leaderboard
|
| 114 |
---
|
| 115 |
|
| 116 |
-
#
|
| 117 |
|
| 118 |
-
The Model [
|
| 119 |
|
| 120 |
## Use with mlx
|
| 121 |
|
|
@@ -126,7 +126,7 @@ pip install mlx-lm
|
|
| 126 |
```python
|
| 127 |
from mlx_lm import load, generate
|
| 128 |
|
| 129 |
-
model, tokenizer = load("
|
| 130 |
|
| 131 |
prompt="hello"
|
| 132 |
|
|
|
|
| 113 |
name: Open LLM Leaderboard
|
| 114 |
---
|
| 115 |
|
| 116 |
+
# mlx-community/Marx-3B-V2-6bit
|
| 117 |
|
| 118 |
+
The Model [mlx-community/Marx-3B-V2-6bit](https://huggingface.co/mlx-community/Marx-3B-V2-6bit) was converted to MLX format from [acrastt/Marx-3B-V2](https://huggingface.co/acrastt/Marx-3B-V2) using mlx-lm version **0.22.3**.
|
| 119 |
|
| 120 |
## Use with mlx
|
| 121 |
|
|
|
|
| 126 |
```python
|
| 127 |
from mlx_lm import load, generate
|
| 128 |
|
| 129 |
+
model, tokenizer = load("mlx-community/Marx-3B-V2-6bit")
|
| 130 |
|
| 131 |
prompt="hello"
|
| 132 |
|