---
license: apache-2.0
base_model:
  - mistralai/Mistral-Small-3.1-24B-Instruct-2503
  - RedHatAI/Mistral-Small-3.1-24B-Instruct-2503-FP8-dynamic
tags:
  - flux2
  - text-encoder
  - fp8
  - mistral
---

# FLUX.2 Text Encoder (FP8)

Combined repo for FLUX.2 text encoding with FP8 quantization (~24GB VRAM instead of ~48GB).

## Components

| Component | Source |
|-----------|--------|
| FP8 Model Weights | [RedHatAI/Mistral-Small-3.1-24B-Instruct-2503-FP8-dynamic](https://huggingface.co/RedHatAI/Mistral-Small-3.1-24B-Instruct-2503-FP8-dynamic) |
| Tokenizer/Processor | [mistralai/Mistral-Small-3.1-24B-Instruct-2503](https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503) |

## Usage

```python
from transformers import AutoProcessor, Mistral3ForConditionalGeneration

model = Mistral3ForConditionalGeneration.from_pretrained(
    "TensorTemplar/flux2-text-encoder-fp8",
    local_files_only=True,  # or False for download
)
processor = AutoProcessor.from_pretrained(
    "TensorTemplar/flux2-text-encoder-fp8",
    use_fast=False,
)
```

## Purpose

This repo exists to simplify FLUX.2 deployment by combining all necessary text encoder
components into a single download. Used for extracting intermediate hidden states
(layers 10/20/30) for image generation conditioning.

## Attribution

- FP8 quantization by [RedHatAI](https://huggingface.co/RedHatAI) using llm-compressor
- Original model by [Mistral AI](https://huggingface.co/mistralai)