Instructions to use mlx-community/flux2-klein-4b-8bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use mlx-community/flux2-klein-4b-8bit with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] huggingface-cli download --local-dir flux2-klein-4b-8bit mlx-community/flux2-klein-4b-8bit
- Notebooks
- Google Colab
- Kaggle
- Local Apps
- LM Studio
mlx-community/flux2-klein-4b-8bit
This repository contains the 8-bit quantized weights for black-forest-labs/FLUX.2-klein-4B, generated using the mflux framework.
Quantized and Contributed by: @lpalbou
Usage
You can run this model locally on Apple Silicon using mflux:
pip install mflux
mflux-generate-flux2 --model mlx-community/flux2-klein-4b-8bit --prompt "A beautiful pencil sketch of a landscape" --steps 4 --seed 42
Hardware compatibility
Log In to add your hardware
Quantized
Model tree for mlx-community/flux2-klein-4b-8bit
Base model
black-forest-labs/FLUX.2-klein-4B