| | ---
|
| | base_model:
|
| | - Qwen/Qwen2.5-7B
|
| | language:
|
| | - zho
|
| | - eng
|
| | - fra
|
| | - spa
|
| | - por
|
| | - deu
|
| | - ita
|
| | - rus
|
| | - jpn
|
| | - kor
|
| | - vie
|
| | - tha
|
| | - ara
|
| | library_name: transformers
|
| | license: apache-2.0
|
| | license_link: https://huggingface.co/Qwen/Qwen2.5-Coder-7B/blob/main/LICENSE
|
| | pipeline_tag: text-generation
|
| | tags:
|
| | - code
|
| | - qwen
|
| | - qwen-coder
|
| | - codeqwen
|
| | - mlx
|
| | ---
|
| |
|
| | # mlx-community/Qwen2.5-Coder-7B-4bit
|
| |
|
| | The Model [mlx-community/Qwen2.5-Coder-7B-4bit](https://huggingface.co/mlx-community/Qwen2.5-Coder-7B-4bit) was converted to MLX format from [Qwen/Qwen2.5-Coder-7B](https://huggingface.co/Qwen/Qwen2.5-Coder-7B) using mlx-lm version **0.18.1**.
|
| |
|
| | ## Use with mlx
|
| |
|
| | ```bash
|
| | pip install mlx-lm
|
| | ```
|
| |
|
| | ```python
|
| | from mlx_lm import load, generate
|
| |
|
| | model, tokenizer = load("mlx-community/Qwen2.5-Coder-7B-4bit")
|
| | response = generate(model, tokenizer, prompt="hello", verbose=True)
|
| | ```
|
| |
|
