mlx-community
/

Impish_LLAMA_3B-6bit

Model card Files Files and versions

Felladrin commited on Feb 26, 2025

Commit

f1a650c

·

verified ·

1 Parent(s): a13f457

Update README.md

Files changed (1) hide show

README.md +3 -3

README.md CHANGED Viewed

@@ -7,9 +7,9 @@ tags:
 base_model: SicariusSicariiStuff/Impish_LLAMA_3B
 ---
-# Felladrin/Impish_LLAMA_3B-Q6-mlx
-The Model [Felladrin/Impish_LLAMA_3B-Q6-mlx](https://huggingface.co/Felladrin/Impish_LLAMA_3B-Q6-mlx) was converted to MLX format from [SicariusSicariiStuff/Impish_LLAMA_3B](https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_3B) using mlx-lm version **0.20.5**.
 ## Use with mlx
@@ -20,7 +20,7 @@ pip install mlx-lm
 ```python
 from mlx_lm import load, generate
-model, tokenizer = load("Felladrin/Impish_LLAMA_3B-Q6-mlx")
 prompt="hello"

 base_model: SicariusSicariiStuff/Impish_LLAMA_3B
 ---
+# mlx-community/Impish_LLAMA_3B-6bit
+The Model [mlx-community/Impish_LLAMA_3B-6bit](https://huggingface.co/mlx-community/Impish_LLAMA_3B-6bit) was converted to MLX format from [SicariusSicariiStuff/Impish_LLAMA_3B](https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_3B) using mlx-lm version **0.20.5**.
 ## Use with mlx
 ```python
 from mlx_lm import load, generate
+model, tokenizer = load("mlx-community/Impish_LLAMA_3B-6bit")
 prompt="hello"