control-edgedrawing-cv480edpf-rect-fp16

README.md

@@ -142,17 +142,19 @@ see experiment 3. cleaned original images following the [fastdup introduction](h
    321 too bright
     57 blurry
  68621 unique removed (that's 38%!)
+------
+111589 unique images (x2 left-right flip)
 ```
 
-restarted from 0 with left-right flipped images and `--mixed-precision="no"` to create a master release and converted to fp16 afterwards.
+restarted from 0 with left-right flipped images and `--mixed-precision="no"` to create a master release and convert to fp16 afterwards.
 
-**Experiment 6.0 - control-edgedrawing-cv480edpf-rect-fp16-checkpoint-XXXXX**
+**Experiment 6.0 - 2023-10-02 - control-edgedrawing-cv480edpf-rect-fp16-checkpoint-45000|90000|135000**
 
 see experiment 5.0.
-* included images with aspect ratio > 2
 * resized images with shortside to 512 which gives us rectangular images instead of 512x512 squares
-* center-cropped images to 512x(n)*64 (to make them SD compatible) and max longside 1024
-* sorted duplicates by `similarity` value from `laion2b-en-aesthetics65` to get the best `text` from all the duplicates
+* included images with aspect ratio > 2
+* center-cropped images to 512x(n)*64 | n=8..16 , which keeps them SD compatible
+* sorted duplicates by `similarity` value from `laion2b-en-aesthetics65` to get the "best" `text` from all the duplicates according to laion
 
 ```
 183410 images in total
@@ -162,12 +164,25 @@ see experiment 5.0.
    436 too bright
     31 blurry
  76288 unique removed (that's 42%!)
+------
+107122 unique images (x2 left-right flip)
 ```
 
+1 epoch = 107122 * 2 / 4 = 53561 steps per epoch
+
 restarted from 0 and `--mixed-precision="fp16"`.
 
+TODO: Why did I end up with less images after I added more images? fastdup suddenly finds even more duplicates. Is fastdup default threshold=0.9 too aggressive?
+
+**Experiment 6.1 - control-edgedrawing-cv480edpf-rect-fp16-gas16-checkpoint-XXXXX**
+
+see experiment 6.0. `--gradient_accumulation_steps=16`.
+
+1 epoch = 107122 * 2 / 16 = 13390 steps per epoch
+
 # Ideas
 
+* experiment with higher gradient accumulation steps
 * make conceptual captions for laion
 * integrate edcolor
 * try to fine-tune from canny

control-edgedrawing-cv480edpf-rect-fp16-checkpoint-1350000.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3700c770639bf383294cd58e94672ba4e4d8a9e1a40dfa13d2b60bceb345fef3
+size 722598616

control-edgedrawing-cv480edpf-rect-fp16-checkpoint-45000.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3baceacb0c118266c9ae301820bf65cce0127a7189f8ddc90f0d64fd5f43f981
+size 722598616

control-edgedrawing-cv480edpf-rect-fp16-checkpoint-90000.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2263d0f34a55ac9e73eb4ebefff5d7faadb235447fa1586147d18281796c5e1f
+size 722598616

control-edgedrawing-cv480edpf-rect-fp16-checkpoint-all.zip

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d94593a8df38ca945b97388c3bb344edc28099490511910410078dfe18b75491
+size 222528478