Instructions to use TheRemixer/misc-small-experiment with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use TheRemixer/misc-small-experiment with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("CabalResearch/NoobAI-Flux2VAE-RectifiedFlow-0.3", dtype=torch.bfloat16, device_map="cuda") pipe.load_lora_weights("TheRemixer/misc-small-experiment") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- Draw Things
Figured out actual difference between Consistency tests.
Browse files
README.md
CHANGED
|
@@ -15,14 +15,18 @@ tags:
|
|
| 15 |
|
| 16 |
(So `loss_total = flow matching + 0.1 * latent_perceptual_loss`). I only did this if the timestep was less than 50% (`sigmas < 0.5`).
|
| 17 |
|
| 18 |
-
## **Loras/RF-Flux2VAE-Consistency-Test-
|
| 19 |
|
| 20 |
-
|
| 21 |
|
| 22 |
My thinking was at inference time the model **doesn't** only receive the `clean latent + gaussian noise` like in training, but also `+ discretization error + mispredicition error from previous step`
|
| 23 |
|
| 24 |
Works on [Mugen](https://huggingface.co/CabalResearch/Mugen) too, but trained on [NoobAI-Flux2VAE-RectifiedFlow-0.3](https://huggingface.co/CabalResearch/NoobAI-Flux2VAE-RectifiedFlow-0.3)
|
|
|
|
|
|
|
| 25 |
|
| 26 |
-
## **Loras/RF-Flux2VAE-Consistency-Test-000002.safetensors**
|
| 27 |
-
|
| 28 |
-
Same as above,
|
|
|
|
|
|
|
|
|
| 15 |
|
| 16 |
(So `loss_total = flow matching + 0.1 * latent_perceptual_loss`). I only did this if the timestep was less than 50% (`sigmas < 0.5`).
|
| 17 |
|
| 18 |
+
## **Loras/RF-Flux2VAE-Consistency-Test-000002.safetensors**
|
| 19 |
|
| 20 |
+
Trained by generating one forward pass from 20-30 timesteps before the target timestep with **no gradients**. Then simulating one euler step to the target timestep and using the resulting latent as the input to the model and training on that. So the model is trained on `clean latent + noise + discretization error + mispredicition error from previous step`
|
| 21 |
|
| 22 |
My thinking was at inference time the model **doesn't** only receive the `clean latent + gaussian noise` like in training, but also `+ discretization error + mispredicition error from previous step`
|
| 23 |
|
| 24 |
Works on [Mugen](https://huggingface.co/CabalResearch/Mugen) too, but trained on [NoobAI-Flux2VAE-RectifiedFlow-0.3](https://huggingface.co/CabalResearch/NoobAI-Flux2VAE-RectifiedFlow-0.3)
|
| 25 |
+
|
| 26 |
+
The one below performs **better**
|
| 27 |
|
| 28 |
+
## **Loras/RF-Flux2VAE-Consistency-Test-50-000002.safetensors**
|
| 29 |
+
|
| 30 |
+
Same exact settings as above, but trained using timestep jumps of 50-60.
|
| 31 |
+
|
| 32 |
+
Performs **better**
|