Irfanuruchi's picture
Upload folder using huggingface_hub
2da7d68 verified
|
Raw
History Blame Contribute Delete
4.19 kB
---
language:
- en
license: apache-2.0
base_model:
- Irfanuruchi/Qwen3-4B-Computer-Science
pipeline_tag: text-generation
library_name: mlx
tags:
- qwen3
- computer-science
- software-engineering
- programming
- mlx
- mlx-lm
- apple-silicon
- 4-bit
- quantized
- code
- python
- conversational
---
# Qwen3-4B-Computer-Science-MLX-4bit
## Overview
Qwen3-4B-Computer-Science-MLX-4bit is a 4-bit MLX conversion of
**Qwen3-4B-Computer-Science** for inference on Apple Silicon.
The model was converted from the original BF16 Safetensors release using
`mlx-lm`. It is intended for local inference on supported Mac systems using
the MLX framework.
---
## Model Information
| Property | Value |
|---|---|
| Source model | Irfanuruchi/Qwen3-4B-Computer-Science |
| Base architecture | Qwen3-4B |
| Framework | MLX |
| Quantization | 4-bit |
| Quantization group size | 64 |
| Effective bits per weight | 4.501 |
| Weight format | Safetensors |
| Primary platform | Apple Silicon |
| Language | English |
| License | Apache-2.0 |
---
## Training Data
The source model was instruction-tuned using permissively licensed datasets.
| Dataset | Configuration | License |
|---|---|---|
| HuggingFaceTB/smoltalk | smol-magpie-ultra | Apache-2.0 |
| agentica-org/DeepCoder-Preview-Dataset | primeintellect | MIT |
### Dataset Size
| Split | Samples |
|---|---:|
| Training | 60,989 |
| Evaluation | 512 |
---
## Intended Use
This model is intended for:
- Software engineering
- Programming assistance
- Code generation
- Debugging
- Code review
- Algorithm implementation
- Computer science education
- General technical reasoning
---
## Installation
Install MLX-LM:
```bash
python -m pip install mlx-lm
```
---
## Usage
### Command Line
```bash
mlx_lm.generate \
--model Irfanuruchi/Qwen3-4B-Computer-Science-MLX-4bit \
--prompt "Write a Python function that returns the first n Fibonacci numbers." \
--max-tokens 200
```
### Python
```python
from mlx_lm import generate, load
model, tokenizer = load(
"Irfanuruchi/Qwen3-4B-Computer-Science-MLX-4bit"
)
response = generate(
model,
tokenizer,
prompt="Write a Python function that returns the first n Fibonacci numbers.",
max_tokens=200,
)
print(response)
```
---
## Conversion
The model was converted from:
```text
Irfanuruchi/Qwen3-4B-Computer-Science
```
Conversion configuration:
| Parameter | Value |
|---|---:|
| Quantization enabled | Yes |
| Quantization bits | 4 |
| Quantization group size | 64 |
| Effective bits per weight | 4.501 |
---
## Release Validation
The release was validated locally on Apple Silicon.
| Test | Result |
|---|---|
| MLX conversion | Passed |
| Model loading | Passed |
| Text generation | Passed |
| Generation speed | 53.512 tokens/sec |
| Peak memory | 2.356 GB |
Performance measurements are from one local generation test and may vary by
device, prompt, context length, and software version.
---
## Release Artifacts
```text
model.safetensors
model.safetensors.index.json
config.json
generation_config.json
tokenizer.json
tokenizer_config.json
added_tokens.json
special_tokens_map.json
merges.txt
vocab.json
README.conversion.md
SHA256SUMS
LICENSE
README.md
```
---
## Integrity Verification
Verify the downloaded files on macOS:
```bash
shasum -a 256 -c SHA256SUMS
```
On Linux:
```bash
sha256sum -c SHA256SUMS
```
---
## Limitations
- Quantization can affect output quality relative to the BF16 checkpoint.
- The model may produce incorrect or incomplete code.
- Generated code should be reviewed and tested before use.
- Performance depends on the Apple Silicon device and available memory.
- This release is intended for MLX-compatible systems.
---
## License
The model is distributed under the Apache License 2.0.
The source model is based on Qwen3-4B, which is also distributed under the
Apache License 2.0.
---
## Acknowledgements
- Alibaba Qwen Team
- Apple MLX Team
- Hugging Face
- SmolTalk contributors
- DeepCoder contributors
---
## Citation
```bibtex
@software{uruci2026qwen3computersciencemlx,
title={Qwen3-4B-Computer-Science-MLX-4bit},
author={Irfan Uruçi},
year={2026},
publisher={Hugging Face}
}
```