Instructions to use unsloth/FLUX.2-dev-FP8 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use unsloth/FLUX.2-dev-FP8 with Diffusers:

pip install -U diffusers transformers accelerate

import torch
from diffusers import DiffusionPipeline
from diffusers.utils import load_image

# switch to "mps" for apple devices
pipe = DiffusionPipeline.from_pretrained("unsloth/FLUX.2-dev-FP8", dtype=torch.bfloat16, device_map="cuda")

prompt = "cute sloth typing on a computer (INT8)"
input_image = load_image("https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/diffusers/cat.png")

image = pipe(image=input_image, prompt=prompt).images[0]

Diffusion Single File

How to use unsloth/FLUX.2-dev-FP8 with Diffusion Single File:

# No code snippets available yet for this library.

# To use this model, check the repository files and the library's documentation.

# Want to help? PRs adding snippets are welcome at:
# https://github.com/huggingface/huggingface.js

Notebooks
Google Colab
Kaggle
Local Apps Settings

Unsloth Studio

How to use unsloth/FLUX.2-dev-FP8 with Unsloth Studio:

Install Unsloth Studio (macOS, Linux, WSL)

curl -fsSL https://unsloth.ai/install.sh | sh
# Run unsloth studio
unsloth studio -H 0.0.0.0 -p 8888
# Then open http://localhost:8888 in your browser
# Search for unsloth/FLUX.2-dev-FP8 to start chatting

Install Unsloth Studio (Windows)

irm https://unsloth.ai/install.ps1 | iex
# Run unsloth studio
unsloth studio -H 0.0.0.0 -p 8888
# Then open http://localhost:8888 in your browser
# Search for unsloth/FLUX.2-dev-FP8 to start chatting

Using HuggingFace Spaces for Unsloth

# No setup required
# Open https://huggingface.co/spaces/unsloth/studio in your browser
# Search for unsloth/FLUX.2-dev-FP8 to start chatting

Load model with FastModel

pip install unsloth
from unsloth import FastModel
model, tokenizer = FastModel.from_pretrained(
    model_name="unsloth/FLUX.2-dev-FP8",
    max_seq_length=2048,
)

FLUX.2-dev-FP8 / samples /int8_2.png

Commit History

Add official model card and quantized samples

2ccf030
verified

danielhanchen commited on 24 days ago

Commit History

Add official model card and quantized samples 2ccf030 verified

Add official model card and quantized samples

2ccf030
verified