Trained for 2 epochs and 3000 steps.

Trained with datasets ['text-embeds', 'mj-v6']
Learning rate 8e-06, batch size 32, and 4 gradient accumulation steps.
Used DDPM noise scheduler for training with epsilon prediction type and rescaled_betas_zero_snr=False
Using 'trailing' timestep spacing.
Base model: PixArt-alpha/PixArt-Sigma-XL-2-1024-MS
VAE: madebyollin/sdxl-vae-fp16-fix

README.md

@@ -211,7 +211,7 @@ You may reuse the base model text encoder for inference.
 ## Training settings
 
 - Training epochs: 2
-- Training steps: 2500
+- Training steps: 3000
 - Learning rate: 8e-06
 - Effective batch size: 128
   - Micro-batch size: 32

optimizer.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:dddf4c49ac67f35885c894ee9b3de8083fc8ac35e8cf4c6d7601a8eef0e37566
+oid sha256:6be48cc782677f2354537d6e0bfb7df6313e20da4a8b3b79c06b4120059c4dcf
 size 3665677155

random_states_0.pkl

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:0d0499bc783fafd3db4928e67bef35014ac3904fa9c57a5eaa8cff43f2ee5273
+oid sha256:7646cf26f263c7e311caf3d24424b072c2429f5ccf2c99d81f00af80f7de9052
 size 14344

scheduler.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:d394596b6a9a6eb220c4b514546efe6b5d39875b7f3c514eaa13e2af3c14e8d3
+oid sha256:4beec63126998040f00cefceadff78db11f493a3f2cc333822a34fdde9434243
 size 1000

training_state-mj-v6.json

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:224d58c5580e8b29acfd9ebfc0692bd0417f3a75e84eb04e36f45966ac71bfaa
-size 11808867
+oid sha256:1d16ab9d843c7ba0452f9553bd9da0aa833cdd0aaacf4e1388cf3d882bf835d9
+size 17056867

training_state.json

@@ -1 +1 @@
-{"global_step": 2500, "epoch_step": 153, "epoch": 3, "exhausted_backends": [], "repeats": {"mj-v6": 0}}
+{"global_step": 3000, "epoch_step": 653, "epoch": 3, "exhausted_backends": [], "repeats": {"mj-v6": 0}}

transformer/diffusion_pytorch_model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:01f153efd4afe63280b3a6812f3eb4cbbc4928db24b04396ee4d2526e301d78d
+oid sha256:8f2b3e2b0c02ab64e27cd0accada200e0af2e16cc0dfe94c9577dce408b852ff
 size 1221780352