---
base_model: FritzStack/HiTOP-Llama-3.2-3B_4bit-merged
tags:
- text-generation-inference
- transformers
- unsloth
- llama
- mlx
- mlx-my-repo
license: apache-2.0
language:
- en
---

# FritzStack/HiTOP-Llama-3.2-3B_4bit-merged-mlx-4Bit

The Model [FritzStack/HiTOP-Llama-3.2-3B_4bit-merged-mlx-4Bit](https://huggingface.co/FritzStack/HiTOP-Llama-3.2-3B_4bit-merged-mlx-4Bit) was converted to MLX format from [FritzStack/HiTOP-Llama-3.2-3B_4bit-merged](https://huggingface.co/FritzStack/HiTOP-Llama-3.2-3B_4bit-merged) using mlx-lm version **0.29.1**.

## Use with mlx

```bash
pip install mlx-lm
!pip install git+https://github.com/Fede-stack/TONYpy.git
```


```python
from TONY.HiTOP import HiTOPPredictor_mlx
text = 'Some days I keep living, even though I feel completely alone in the world'
hitop = HiTOP_Predictor_mlx(model_name='FritzStack/HiTOP-Llama-3B-mlx-Q4')
hitop.predict_HiTOP(text)
```