Text-to-Image
Diffusers
vladmandic commited on
Commit
305bb61
·
verified ·
1 Parent(s): 4c95a9f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +14 -7
README.md CHANGED
@@ -10,6 +10,8 @@ library_name: diffusers
10
  Inference includes noise correction based on current timestep, intentional blurring plus upscale interpolation: all with intention of providing as fast-as-possible reconstruction that is viable and consistent with any noise levels.
11
  Intended use-case is live-preview during generative model inference.
12
 
 
 
13
  - Model definition and training code [here](https://github.com/vladmandic/sdnext/blob/dev/modules/vae/sd_vae_micro_train.py)
14
  - Example inference code [here](https://github.com/vladmandic/sdnext/blob/dev/modules/vae/sd_vae_micro.py)
15
 
@@ -17,14 +19,19 @@ Example using **MicroDecoder** with `Flux.2-Klein-9B` and compared with official
17
 
18
  ![MicroDecoder](https://huggingface.co/vladmandic/MicroDecoder/resolve/main/MicroDecoder.jpg)
19
 
20
- ## Examples
21
 
22
  ```shell
23
- sd_vae_micro_train.py --dim 256 --epochs 350 --resolution 512 --scale 8 --lr 0.0003 --folder ~/generative/Input/vae/ --vae AutoencoderKLQwenImage21 --repo Qwen/Qwen-Image-2.1 --output AutoencoderKLQwenImage21.safetensors
24
- sd_vae_micro_train.py --dim 256 --epochs 350 --resolution 512 --scale 4 --lr 0.0003 --folder ~/generative/Input/vae/ --vae AutoencoderKLFlux2 --repo black-forest-labs/FLUX.2-klein-9B --output AutoencoderKLFlux2.safetensors
25
- sd_vae_micro_train.py --dim 256 --epochs 350 --resolution 512 --scale 4 --lr 0.0003 --folder ~/generative/Input/vae/ --vae AutoencoderKL --repo stabilityai/stable-diffusion-xl-base-1.0 --output AutoencoderKL.safetensors
26
- sd_vae_micro_train.py --dim 256 --epochs 350 --resolution 512 --scale 4 --lr 0.0003 --folder ~/generative/Input/vae/ --vae AutoencoderKLWan --repo Wan-AI/Wan2.2-I2V-A14B-Diffusers --output AutoencoderKLWan.safetensors
27
- sd_vae_micro_train.py --dim 256 --epochs 350 --resolution 512 --scale 4 --lr 0.0003 --folder ~/generative/Input/vae/ --vae AutoencoderKLQwenImage --repo krea/Krea-2-Turbo --output AutoencoderKLQwenImage.safetensors
 
 
 
 
 
28
  ```
29
 
30
  ```log
@@ -41,5 +48,5 @@ Epoch | Train Tot | Tr PSNR | Tr SSIM | Val Tot | Val PSNR | Val SSIM | Val L1
41
  350/350 | 2.3010 | 28.51 | 0.8511 | 0.9781 | 35.83 | 0.9734 | 0.0111 | 0.0278 *
42
 
43
  Training complete! Best validation PSNR: 35.83 dB (Epoch 350)
44
- Saved best EMA model weights to: AutoencoderKLFlux2.safetensors
45
  ```
 
10
  Inference includes noise correction based on current timestep, intentional blurring plus upscale interpolation: all with intention of providing as fast-as-possible reconstruction that is viable and consistent with any noise levels.
11
  Intended use-case is live-preview during generative model inference.
12
 
13
+ Shapes/Channels/etc are inferred from the base VAE, so no configuration changes are needed between different models.
14
+
15
  - Model definition and training code [here](https://github.com/vladmandic/sdnext/blob/dev/modules/vae/sd_vae_micro_train.py)
16
  - Example inference code [here](https://github.com/vladmandic/sdnext/blob/dev/modules/vae/sd_vae_micro.py)
17
 
 
19
 
20
  ![MicroDecoder](https://huggingface.co/vladmandic/MicroDecoder/resolve/main/MicroDecoder.jpg)
21
 
22
+ ## Example
23
 
24
  ```shell
25
+ sd_vae_micro_train.py \
26
+ --dim 256 \
27
+ --epochs 350 \
28
+ --resolution 512 \
29
+ --scale 4 \
30
+ --lr 0.0003
31
+ --folder ~/generative/Input/vae/ \
32
+ --vae AutoencoderKLQwenImage21 \
33
+ --repo Qwen/Qwen-Image-2.1
34
+ --output MicroVAE-qwen21.safetensors
35
  ```
36
 
37
  ```log
 
48
  350/350 | 2.3010 | 28.51 | 0.8511 | 0.9781 | 35.83 | 0.9734 | 0.0111 | 0.0278 *
49
 
50
  Training complete! Best validation PSNR: 35.83 dB (Epoch 350)
51
+ Saved best EMA model weights to: MicroVAE-qwen21.safetensors
52
  ```