Update README.md
Browse files
README.md
CHANGED
|
@@ -9,9 +9,9 @@ tags:
|
|
| 9 |
- mlx
|
| 10 |
---
|
| 11 |
|
| 12 |
-
#
|
| 13 |
|
| 14 |
-
The Model [
|
| 15 |
|
| 16 |
## Use with mlx
|
| 17 |
|
|
@@ -22,7 +22,7 @@ pip install mlx-lm
|
|
| 22 |
```python
|
| 23 |
from mlx_lm import load, generate
|
| 24 |
|
| 25 |
-
model, tokenizer = load("
|
| 26 |
|
| 27 |
prompt="hello"
|
| 28 |
|
|
|
|
| 9 |
- mlx
|
| 10 |
---
|
| 11 |
|
| 12 |
+
# mlx-community/KernelLLM-6bit
|
| 13 |
|
| 14 |
+
The Model [mlx-community/KernelLLM-6bit](https://huggingface.co/mlx-community/KernelLLM-6bit) was converted to MLX format from [facebook/KernelLLM](https://huggingface.co/facebook/KernelLLM) using mlx-lm version **0.22.3**.
|
| 15 |
|
| 16 |
## Use with mlx
|
| 17 |
|
|
|
|
| 22 |
```python
|
| 23 |
from mlx_lm import load, generate
|
| 24 |
|
| 25 |
+
model, tokenizer = load("mlx-community/KernelLLM-6bit")
|
| 26 |
|
| 27 |
prompt="hello"
|
| 28 |
|