Text-to-Image
Diffusers
TensorBoard
stable-diffusion
diffusion
distillation
flow-matching
geometric-deep-learning
research
Instructions to use AbstractPhil/sd15-flow-matching with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use AbstractPhil/sd15-flow-matching with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("AbstractPhil/sd15-flow-matching", dtype=torch.bfloat16, device_map="cuda") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - Notebooks
- Google Colab
- Kaggle
- Local Apps
- Draw Things
- DiffusionBee
Update README.md
Browse files
README.md
CHANGED
|
@@ -26,6 +26,36 @@ I KNOW I KNOW, I'll get it worked out. For now this is epoch 9.
|
|
| 26 |
|
| 27 |
```
|
| 28 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 29 |
|
| 30 |
# Most original checkpoints are default sd15 after testing
|
| 31 |
For those who downloaded the models that either exhibit blobs or don't use flow matching noise - my sincerest apologies. They are defective. Blobs are expected, standard noise is not.
|
|
|
|
| 26 |
|
| 27 |
```
|
| 28 |
|
| 29 |
+
As of epoch 11 the blobs are reforming back into shapes, and the shapes are cohesing in fairly utilizable ways for the end product, they are still however - blobs for the time being.
|
| 30 |
+
|
| 31 |
+

|
| 32 |
+
|
| 33 |
+

|
| 34 |
+
|
| 35 |
+

|
| 36 |
+
|
| 37 |
+
This is a v-prediction flow-matching model that can be directly inferenced with euler-discreet flow-matching through diffusers, and I would advise doing this for testing purposes.
|
| 38 |
+
|
| 39 |
+
|
| 40 |
+
# E11+ new expectations
|
| 41 |
+
It's training directly with timestep-awareness using shift and timestep association.
|
| 42 |
+
|
| 43 |
+
The least accurate timestep buckets have their opinions removed from the classifier weight, as the classifier cannot help if it cannot classify what the teacher itself is trying to say. Which lines up roughly with the 90/10 rule that David seems to cap at - which is about 90% accuracy and 10% incorrect. So about 10% of timestep buckets are inactive.
|
| 44 |
+
|
| 45 |
+
Individual block losses have been correctly reintroduced and will train the timestep and patterns HOPEFULLY correctly.
|
| 46 |
+
|
| 47 |
+
```
|
| 48 |
+
# Timestep Weighting (David-guided adaptive sampling)
|
| 49 |
+
use_timestep_weighting: bool = True
|
| 50 |
+
use_david_weights: bool = True
|
| 51 |
+
timestep_shift: float = 3.0 # SD3-style shift (higher = bias toward clean)
|
| 52 |
+
base_jitter: int = 5 # Base ±jitter around bin center
|
| 53 |
+
adaptive_chaos: bool = True # Scale jitter by pattern difficulty
|
| 54 |
+
profile_samples: int = 2500 # Samples to profile David's difficulty
|
| 55 |
+
reliability_threshold: float = 0.15 # Minimum accuracy to trust David's guidance
|
| 56 |
+
```
|
| 57 |
+
|
| 58 |
+
|
| 59 |
|
| 60 |
# Most original checkpoints are default sd15 after testing
|
| 61 |
For those who downloaded the models that either exhibit blobs or don't use flow matching noise - my sincerest apologies. They are defective. Blobs are expected, standard noise is not.
|