Instructions to use neuralvfx/LibreFlux-SAM-ControlNet with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use neuralvfx/LibreFlux-SAM-ControlNet with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("neuralvfx/LibreFlux-SAM-ControlNet", dtype=torch.bfloat16, device_map="cuda") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - Notebooks
- Google Colab
- Kaggle
- Local Apps
- Draw Things
- DiffusionBee
Update README.md
Browse files
README.md
CHANGED
|
@@ -1,21 +1,18 @@
|
|
| 1 |
# LibreFLUX-ControlNet Inference (WIP)
|
| 2 |

|
| 3 |
|
| 4 |
-
|
| 5 |
|
| 6 |
-
|
| 7 |
-
-
|
| 8 |
-
-
|
|
|
|
| 9 |
|
| 10 |
**Disclaimer**, This is pieced together by modifying and borrowing from these repos:
|
| 11 |
- [https://huggingface.co/jimmycarter/LibreFLUX](https://huggingface.co/jimmycarter/LibreFLUX)
|
| 12 |
- [https://github.com/bghira/SimpleTuner](https://github.com/bghira/SimpleTuner)
|
| 13 |
|
| 14 |
|
| 15 |
-
## Status
|
| 16 |
-
Work in progress. Code is being transferred and adapted from my larger project.
|
| 17 |
-
|
| 18 |
-
|
| 19 |
# Compatibility
|
| 20 |
|
| 21 |
- Use these specific library versions:
|
|
|
|
| 1 |
# LibreFLUX-ControlNet Inference (WIP)
|
| 2 |

|
| 3 |
|
| 4 |
+
**ControlNet trained on top of LibreFLUX**
|
| 5 |
|
| 6 |
+
- Uses Attention Masking
|
| 7 |
+
- Inference runs with CFG
|
| 8 |
+
- Trained on 165K segmented images from Meta's [SA1B Dataset](https://ai.meta.com/datasets/segment-anything/)
|
| 9 |
+
- Trained using [https://github.com/NeuralVFX/LibreFLUX-ControlNet](https://github.com/NeuralVFX/LibreFLUX-ControlNet)
|
| 10 |
|
| 11 |
**Disclaimer**, This is pieced together by modifying and borrowing from these repos:
|
| 12 |
- [https://huggingface.co/jimmycarter/LibreFLUX](https://huggingface.co/jimmycarter/LibreFLUX)
|
| 13 |
- [https://github.com/bghira/SimpleTuner](https://github.com/bghira/SimpleTuner)
|
| 14 |
|
| 15 |
|
|
|
|
|
|
|
|
|
|
|
|
|
| 16 |
# Compatibility
|
| 17 |
|
| 18 |
- Use these specific library versions:
|