Trained for 1 epochs and 2000 steps.

Trained with datasets ['text-embeds', 'mj-v6']
Learning rate 8e-06, batch size 32, and 4 gradient accumulation steps.
Used DDPM noise scheduler for training with epsilon prediction type and rescaled_betas_zero_snr=False
Using 'trailing' timestep spacing.
Base model: PixArt-alpha/PixArt-Sigma-XL-2-1024-MS
VAE: madebyollin/sdxl-vae-fp16-fix

README.md

@@ -211,7 +211,7 @@ You may reuse the base model text encoder for inference.
 ## Training settings
 
 - Training epochs: 1
-- Training steps: 1500
+- Training steps: 2000
 - Learning rate: 8e-06
 - Effective batch size: 128
   - Micro-batch size: 32

optimizer.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:b59ab5187438495f70ae65205ab85b3a89c32121446239c4451ad44ba69f8ac9
+oid sha256:709fe286305a67b23d5fda9c5222b44e830de0150e5aa11b867888d39afcad13
 size 3665677155

random_states_0.pkl

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:0095adc498355bd439cad9421b34a6d1c1d09f12fa9ef8fd47d6aa43a9d63704
+oid sha256:348f77d93153381368937426338c32f9870f95a362a50954869861a83c0ccc6e
 size 14344

scheduler.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:5e9401b92a0437e861b78763e41ede39d20dc2bdd763568f11b5463d73323d27
+oid sha256:2eb1cce730426e835242d18b368f2e671b3eb662cbe1682f8619450b7c2c1bb9
 size 1000

training_state-mj-v6.json

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:6f29ad928d40ef0bf3d488cdb9aaba3bcfb1d1cd94e268087cdeea897542a6a7
-size 12312675
+oid sha256:ac388b02b593d4407be82560c961ed11c58beba92b0af8980b97b6adac92038b
+size 17560675

training_state.json

@@ -1 +1 @@
-{"global_step": 1500, "epoch_step": 201, "epoch": 2, "exhausted_backends": [], "repeats": {"mj-v6": 0}}
+{"global_step": 2000, "epoch_step": 701, "epoch": 2, "exhausted_backends": [], "repeats": {"mj-v6": 0}}

transformer/diffusion_pytorch_model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:c7bfe5b2c7ab5cc1d27949b595d1844abedaa050fec5fc4a7ac68124c21ca0af
+oid sha256:88c393cc9a95a5fc97227138567a228c231c4ff496da3d92a9a8a2c1f424624e
 size 1221780352