Instructions to use unsloth/FLUX.2-dev-FP8 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use unsloth/FLUX.2-dev-FP8 with Diffusers:

pip install -U diffusers transformers accelerate

import torch
from diffusers import DiffusionPipeline
from diffusers.utils import load_image

# switch to "mps" for apple devices
pipe = DiffusionPipeline.from_pretrained("unsloth/FLUX.2-dev-FP8", dtype=torch.bfloat16, device_map="cuda")

prompt = "cute sloth typing on a computer (INT8)"
input_image = load_image("https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/diffusers/cat.png")

image = pipe(image=input_image, prompt=prompt).images[0]

Diffusion Single File

How to use unsloth/FLUX.2-dev-FP8 with Diffusion Single File:

# No code snippets available yet for this library.

# To use this model, check the repository files and the library's documentation.

# Want to help? PRs adding snippets are welcome at:
# https://github.com/huggingface/huggingface.js

Notebooks
Google Colab
Kaggle
Local Apps Settings

Unsloth Studio

How to use unsloth/FLUX.2-dev-FP8 with Unsloth Studio:

Install Unsloth Studio (macOS, Linux, WSL)

curl -fsSL https://unsloth.ai/install.sh | sh
# Run unsloth studio
unsloth studio -H 0.0.0.0 -p 8888
# Then open http://localhost:8888 in your browser
# Search for unsloth/FLUX.2-dev-FP8 to start chatting

Install Unsloth Studio (Windows)

irm https://unsloth.ai/install.ps1 | iex
# Run unsloth studio
unsloth studio -H 0.0.0.0 -p 8888
# Then open http://localhost:8888 in your browser
# Search for unsloth/FLUX.2-dev-FP8 to start chatting

Using HuggingFace Spaces for Unsloth

# No setup required
# Open https://huggingface.co/spaces/unsloth/studio in your browser
# Search for unsloth/FLUX.2-dev-FP8 to start chatting

Load model with FastModel

pip install unsloth
from unsloth import FastModel
model, tokenizer = FastModel.from_pretrained(
    model_name="unsloth/FLUX.2-dev-FP8",
    max_seq_length=2048,
)

FLUX.2-dev-FP8 / FLUX.2-dev-INT8.pt

Commit History

Rename checkpoints to model-name files

9fb3555
verified

danielhanchen commited on 24 days ago

Commit History

Rename checkpoints to model-name files 9fb3555 verified

Rename checkpoints to model-name files

9fb3555
verified