---
base_model: FritzStack/IRF-Llama-3.2-3B_4bit-merged_2epo
tags:
- text-generation-inference
- transformers
- unsloth
- llama
- mlx
- mlx-my-repo
license: apache-2.0
language:
- en
---

# FritzStack/IRF-Llama-3.2-3B_4bit-merged_2epo-mlx-4Bit

The Model [FritzStack/IRF-Llama-3.2-3B_4bit-merged_2epo-mlx-4Bit](https://huggingface.co/FritzStack/IRF-Llama-3.2-3B_4bit-merged_2epo-mlx-4Bit) was converted to MLX format from [FritzStack/IRF-Llama-3.2-3B_4bit-merged_2epo](https://huggingface.co/FritzStack/IRF-Llama-3.2-3B_4bit-merged_2epo) using mlx-lm version **0.29.1**.

## Use with mlx

```bash
pip install mlx-lm
!pip install git+https://github.com/Fede-stack/TONYpy.git
```

```python
from TONY.IRF import IRFPredictor_mlx

text = 'Some days I keep living, even though I feel completely alone in the world'
irf = IRFPredictor_mlx(model_name='FritzStack/IRF-Llama-3B-mlx-Q4')
irf.highlight_evidence_IRF(text)
```