| license: apache-2.0 | |
| base_model: black-forest-labs/FLUX.2-klein-4B | |
| pipeline_tag: text-to-image | |
| library_name: mlx-gen | |
| tags: | |
| - mlx | |
| - mlx-gen | |
| - mflux | |
| - apple-silicon | |
| - 8-bit | |
| - flux | |
| - flux2 | |
| # flux.2-klein-4b-8bit | |
| This repository contains MLX-Gen saved weights for `black-forest-labs/FLUX.2-klein-4B`. The checkpoint is designed for local Apple Silicon inference with [`mlx-gen`](https://github.com/lpalbou/mlx-gen). | |
| It uses the mflux/MLX saved-weight layout and MLX quantization tensors. It is not a Diffusers or Transformers `from_pretrained()` checkpoint. | |
| ## Source Model | |
| Original model: [`black-forest-labs/FLUX.2-klein-4B`](https://huggingface.co/black-forest-labs/FLUX.2-klein-4B). | |
| ## License and Access | |
| This quantized derivative follows the Apache 2.0 license of the source model. | |
| ## Quantization | |
| This is an MLX q8 checkpoint. Quantizable modules are saved at 8-bit where the model layout supports MLX quantization; VAE weights and non-quantizable layers remain BF16. | |
| ## Compatibility | |
| Requires `mlx-gen >= 0.18.2`. | |
| Generated with `mlx-gen 0.18.2`. | |
| Use the `mlxgen` command and Python import path for new MLX-Gen projects. | |
| ## Usage | |
| ```bash | |
| python -m pip install -U mlx-gen | |
| mlxgen download --model AbstractFramework/flux.2-klein-4b-8bit | |
| mlxgen generate \ | |
| --model AbstractFramework/flux.2-klein-4b-8bit \ | |
| --prompt "Your prompt here" \ | |
| --steps 20 \ | |
| --seed 42 \ | |
| --output image.png | |
| ``` | |
| ## Attribution | |
| MLX-Gen is based on [mflux](https://github.com/filipstrand/mflux) by Filip Strand and the original mflux contributors. This model card is generated by MLX-Gen so derived checkpoints keep that attribution visible. | |
| Quantized and contributed by [@lpalbou](https://huggingface.co/lpalbou). | |