File size: 999 Bytes
c1d4637 fcc5357 c1d4637 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 |
---
license: other
license_name: qwen
license_link: https://huggingface.co/Qwen/Qwen2.5-Math-7B-Instruct/blob/main/LICENSE
pipeline_tag: text-generation
base_model: Qwen/Qwen2.5-Math-7B-Instruct
base_model_relation: quantized
tags:
- math
- chat
- 6bit
- apple
language:
- en
- zh
library_name: mlx
---
# Qwen2.5 Math 7B Instruct 6-bit MLX
MLX version of **Qwen2.5 Math 7B Instruct**
This model was converted to MLX format from [`https://huggingface.co/Qwen/Qwen2.5-Math-7B-Instruct`](https://huggingface.co/Qwen/Qwen2.5-Math-7B-Instruct) using mlx-lm version **0.22.5**.
## Model Details
For more details, please refer to [blog post](https://qwenlm.github.io/blog/qwen2.5-math/) and [GitHub repo](https://github.com/QwenLM/Qwen2.5-Math).
## Use with mlx
```bash
pip install -U mlx-lm
```
```bash
python -m mlx_lm.generate --model TheCluster/Qwen2.5-Math-7B-Instruct-mlx-6bit --max-tokens 1024 --temperature 0.5 --prompt "Find the value of $x$ that satisfies the equation $4x+5 = 6x+7$."
``` |