recoilme commited on
Commit
cfce8f8
·
1 Parent(s): 63c5f0a
samples/unet_384x768_0.jpg CHANGED

Git LFS Details

  • SHA256: c31d94cb6a9311f40a7ceb41d42d65385851b155d5416d13143cf3ddfa3452de
  • Pointer size: 131 Bytes
  • Size of remote file: 104 kB

Git LFS Details

  • SHA256: 81fe0324274c3b2b809291a85ddea5d9aba640df8b744f0d6cf39a723d1cc209
  • Pointer size: 131 Bytes
  • Size of remote file: 106 kB
samples/unet_416x768_0.jpg CHANGED

Git LFS Details

  • SHA256: 8f13b696eb73a16e349d1af8c7a49fdce35abafb19c67b788df6e1bb82753460
  • Pointer size: 130 Bytes
  • Size of remote file: 59.3 kB

Git LFS Details

  • SHA256: 188a5dddc43808d309477f7fde255bf609b5375a113ab4d1a451070784e9778b
  • Pointer size: 130 Bytes
  • Size of remote file: 63.7 kB
samples/unet_448x768_0.jpg CHANGED

Git LFS Details

  • SHA256: 1c5bbfae5758b169851db91b63b62dcc323902eefb249e642fdcf0bdc1cc95e0
  • Pointer size: 131 Bytes
  • Size of remote file: 124 kB

Git LFS Details

  • SHA256: 001abdd189fa57534ae2bcf3694fb2fd7022c396c082c2766cc1bec059f521d3
  • Pointer size: 131 Bytes
  • Size of remote file: 128 kB
samples/unet_480x768_0.jpg CHANGED

Git LFS Details

  • SHA256: 94b985a9fdefbe301e9146086fc333ddd91c202fabc520389396108cd083f227
  • Pointer size: 131 Bytes
  • Size of remote file: 149 kB

Git LFS Details

  • SHA256: a24f5089ef3430b034e11a919cd2248b975bd77b3a68252d7575a790ea374d36
  • Pointer size: 131 Bytes
  • Size of remote file: 113 kB
samples/unet_512x768_0.jpg CHANGED

Git LFS Details

  • SHA256: 6dc90f559bb696c5f4d3c35a6a032b582021bd1beb20f2af5470e4e075ab0d4e
  • Pointer size: 131 Bytes
  • Size of remote file: 266 kB

Git LFS Details

  • SHA256: 8aeb86a8e25d6f90de68dd3b6532cce3e8d1d4aa6b5c73677f05c17caa0d6c73
  • Pointer size: 131 Bytes
  • Size of remote file: 113 kB
samples/unet_544x768_0.jpg CHANGED

Git LFS Details

  • SHA256: 1868b53ea6df1ff82a3be9166659907dc52a329a495170ce7e34db741d2fe5db
  • Pointer size: 130 Bytes
  • Size of remote file: 83.1 kB

Git LFS Details

  • SHA256: 632d8950f7efcf981539a25278dfccd3b9aae0c6b7925148b64e8c2c93c19a42
  • Pointer size: 131 Bytes
  • Size of remote file: 140 kB
samples/unet_576x768_0.jpg CHANGED

Git LFS Details

  • SHA256: 098a0981874cccc3dd31e8a03d0a0a2efac9b7c62c13c74186a2c6272b35e807
  • Pointer size: 131 Bytes
  • Size of remote file: 100 kB

Git LFS Details

  • SHA256: a2a63d6fae326f3e626bd9b55a299b48da84077b6ba56ca7866e088d937a4f11
  • Pointer size: 130 Bytes
  • Size of remote file: 72.8 kB
samples/unet_608x768_0.jpg CHANGED

Git LFS Details

  • SHA256: 3de722ebcc80c553becc1d806a9ce3688bd0d30d0155f2d284ff784e0c057c0c
  • Pointer size: 130 Bytes
  • Size of remote file: 95.2 kB

Git LFS Details

  • SHA256: f8e7f1d57ea491553bfcbbc241aa4d61cad5bb225a36f7534e4632a7b0728e86
  • Pointer size: 131 Bytes
  • Size of remote file: 179 kB
samples/unet_640x768_0.jpg CHANGED

Git LFS Details

  • SHA256: e21123ea9c8647c22eb0e82cb03ab4166259dfdf748206b90755d5d41a118e18
  • Pointer size: 131 Bytes
  • Size of remote file: 142 kB

Git LFS Details

  • SHA256: 82bac014d05ead20b652b7c9ede7a5747dac08a3433523154c15f600ced9f1db
  • Pointer size: 130 Bytes
  • Size of remote file: 64.5 kB
samples/unet_672x768_0.jpg CHANGED

Git LFS Details

  • SHA256: 2e4da32f771eb2cf9192b91bf4632de5b0761ff667dc9c8e5937cd1e762f89c6
  • Pointer size: 130 Bytes
  • Size of remote file: 74.5 kB

Git LFS Details

  • SHA256: 683801b51b5096893ea2a7546edd9088503353d5ced2855d1bb3a1dd92055f00
  • Pointer size: 131 Bytes
  • Size of remote file: 140 kB
samples/unet_704x768_0.jpg CHANGED

Git LFS Details

  • SHA256: 39551b77b520c4f3e5b0ca121b28518414bcd454973916ec122127828da34a1f
  • Pointer size: 131 Bytes
  • Size of remote file: 160 kB

Git LFS Details

  • SHA256: 839ac2a061a6812e81bc3109a2783b6546eb77ebec4f8d4d449475a05635e46e
  • Pointer size: 131 Bytes
  • Size of remote file: 117 kB
samples/unet_736x768_0.jpg CHANGED

Git LFS Details

  • SHA256: aac31ccb66c3c013352a935e8ca25c02bd47ba04be2b8765822f122eb814b797
  • Pointer size: 130 Bytes
  • Size of remote file: 94.1 kB

Git LFS Details

  • SHA256: 0e5dd98220316ab67980eda0f1409011f2732be926f9cc48cd6ebb675c7ed46b
  • Pointer size: 131 Bytes
  • Size of remote file: 179 kB
samples/unet_768x384_0.jpg CHANGED

Git LFS Details

  • SHA256: 2c0d411167fecc6da9ce330ce84a400c6807f2b355fe497ebd767df4b5405d03
  • Pointer size: 131 Bytes
  • Size of remote file: 134 kB

Git LFS Details

  • SHA256: 6a924932034f4a0a069b9812b52000209f0c3f373922f44d05f75d8ea8e2dd54
  • Pointer size: 130 Bytes
  • Size of remote file: 66.5 kB
samples/unet_768x416_0.jpg CHANGED

Git LFS Details

  • SHA256: b551cf13e4b90e65bb80de5c488837c27e6908d37d40a478582a8812f49ef410
  • Pointer size: 130 Bytes
  • Size of remote file: 59.9 kB

Git LFS Details

  • SHA256: f143b25ed006355acea3318788fb4574476b256a95c9735aebe6e4d8fbf16142
  • Pointer size: 130 Bytes
  • Size of remote file: 84 kB
samples/unet_768x448_0.jpg CHANGED

Git LFS Details

  • SHA256: ff9f92093f9fe3f6f42278efdbd19bd0355c8865325e8ffd6944edb5a8ac5e2b
  • Pointer size: 130 Bytes
  • Size of remote file: 91 kB

Git LFS Details

  • SHA256: 0721687d359fe9d1f2d648cecf32bd81ca2e56632cdf076b9338af26cc3446d3
  • Pointer size: 131 Bytes
  • Size of remote file: 136 kB
samples/unet_768x480_0.jpg CHANGED

Git LFS Details

  • SHA256: 034ec77216964be75713bfef7eb3362db72fb13cecc1700d5f335722f3a4f22f
  • Pointer size: 131 Bytes
  • Size of remote file: 151 kB

Git LFS Details

  • SHA256: 9498e21da5240626ea8e87fda120ca6704644a05b72fedf8593d7bd431752c3b
  • Pointer size: 131 Bytes
  • Size of remote file: 152 kB
samples/unet_768x512_0.jpg CHANGED

Git LFS Details

  • SHA256: d502866d550b8fa7a1ad9ccc7c520b0e7a0c734f65466575e39f0a7eac10adc4
  • Pointer size: 131 Bytes
  • Size of remote file: 162 kB

Git LFS Details

  • SHA256: 29f9543c871185bfc2e2e87b75f536e5884f30c553cddd79482e84e6df4791c4
  • Pointer size: 130 Bytes
  • Size of remote file: 82.8 kB
samples/unet_768x544_0.jpg CHANGED

Git LFS Details

  • SHA256: 439e2eedb3256702e7486d1241f4c221694bbe6d5b715a4e281128f7883532d3
  • Pointer size: 131 Bytes
  • Size of remote file: 116 kB

Git LFS Details

  • SHA256: c111e8d150b43c055b2eaccb8f0c4df720559392385996c8edda78968c76d862
  • Pointer size: 131 Bytes
  • Size of remote file: 212 kB
samples/unet_768x576_0.jpg CHANGED

Git LFS Details

  • SHA256: 3e202f36f2e3316d908a0fa2bade4a5f396401dd37a027ac0bfea944591d3845
  • Pointer size: 130 Bytes
  • Size of remote file: 57.7 kB

Git LFS Details

  • SHA256: d74871359f94deea06c588d333f63d35224f669153945c3a1bee5686b200cc90
  • Pointer size: 131 Bytes
  • Size of remote file: 105 kB
samples/unet_768x608_0.jpg CHANGED

Git LFS Details

  • SHA256: 59744a32db00f0e6c5f8d40539ce09c665f52c5afbbcc4b5348a776c3553b9a3
  • Pointer size: 131 Bytes
  • Size of remote file: 149 kB

Git LFS Details

  • SHA256: 61a795ce864873d05e081d7864673692e5c74a0a801af1aba842debdf2db33d8
  • Pointer size: 131 Bytes
  • Size of remote file: 121 kB
samples/unet_768x640_0.jpg CHANGED

Git LFS Details

  • SHA256: 3299f80dd0536458074e4efed7af91b28247e1c4577ec0427bc188915f3889cc
  • Pointer size: 131 Bytes
  • Size of remote file: 223 kB

Git LFS Details

  • SHA256: 73c170d31aa63c90122109feaa86cc5104dd4d59300aff6a57518492e12ce72b
  • Pointer size: 131 Bytes
  • Size of remote file: 146 kB
samples/unet_768x672_0.jpg CHANGED

Git LFS Details

  • SHA256: f55b7eb9f15682634f0db94983f86719de721f0aa8e9d51843a585d96120ef6d
  • Pointer size: 131 Bytes
  • Size of remote file: 136 kB

Git LFS Details

  • SHA256: f773b0b679f886d1e633fedcd55badd0639544a363df0a0a038bbd360cccaebc
  • Pointer size: 131 Bytes
  • Size of remote file: 158 kB
samples/unet_768x704_0.jpg CHANGED

Git LFS Details

  • SHA256: 1fe1c1bf08f82bb30b142e313b2b7b300c7b19f6b49e2b291df60b5b432453fc
  • Pointer size: 130 Bytes
  • Size of remote file: 87.5 kB

Git LFS Details

  • SHA256: 0934cd542ee7a74d06526907b5e731b1053f724f0cb106ca10ddd7da8c71f8a3
  • Pointer size: 130 Bytes
  • Size of remote file: 89.3 kB
samples/unet_768x736_0.jpg CHANGED

Git LFS Details

  • SHA256: 6b0c0d0addba9ad99604f99e4f6396a2179c261cae5cdc324ef706ced751a446
  • Pointer size: 131 Bytes
  • Size of remote file: 207 kB

Git LFS Details

  • SHA256: cac2229f773f169da4a6083f370cfa1429addc71ca0990061ef09ad047fde81e
  • Pointer size: 130 Bytes
  • Size of remote file: 42.8 kB
samples/unet_768x768_0.jpg CHANGED

Git LFS Details

  • SHA256: 69f78847fed9e8a3e2124cc73ddb2fe00c5be9ec32db47b3af2240b6060c47f6
  • Pointer size: 131 Bytes
  • Size of remote file: 199 kB

Git LFS Details

  • SHA256: 12529f4e27e0f03b46d2f5dc28c8aa651f2ce4fec25592dce9d06c02a4e2c052
  • Pointer size: 130 Bytes
  • Size of remote file: 47.7 kB
train.py CHANGED
@@ -8,7 +8,7 @@ from torch.utils.data import DataLoader, Sampler
8
  from torch.utils.data.distributed import DistributedSampler
9
  from torch.optim.lr_scheduler import LambdaLR
10
  from collections import defaultdict
11
- from diffusers import UNet2DConditionModel, AutoencoderKL,AutoencoderKLFlux2
12
  from accelerate import Accelerator
13
  from datasets import load_from_disk
14
  from tqdm import tqdm
@@ -32,7 +32,7 @@ project = "unet"
32
  batch_size = 36
33
  base_learning_rate = 2.7e-5
34
  min_learning_rate = 1e-5 #2.7e-5
35
- num_epochs = 80
36
  sample_interval_share = 5
37
  max_length = 192
38
  use_wandb = True
@@ -49,11 +49,11 @@ comet_ml_api_key = "Agctp26mbqnoYrrlvQuKSTk6r"
49
  comet_ml_workspace = "recoilme"
50
  torch.backends.cuda.matmul.allow_tf32 = True
51
  torch.backends.cudnn.allow_tf32 = True
52
- torch.backends.cuda.enable_mem_efficient_sdp(False)
53
  dtype = torch.float32
54
  save_barrier = 1.01
55
  warmup_percent = 0.01
56
- percentile_clipping = 96 #97
57
  betta2 = 0.999
58
  eps = 1e-7
59
  clip_grad_norm = 1.0
@@ -71,7 +71,7 @@ device = accelerator.device
71
  # Параметры для диффузии
72
  n_diffusion_steps = 40
73
  samples_to_generate = 12
74
- guidance_scale = 2
75
 
76
  # Папки для сохранения результатов
77
  generated_folder = "samples"
@@ -736,8 +736,8 @@ for epoch in range(start_epoch, start_epoch + num_epochs):
736
 
737
  if global_step % sample_interval == 0:
738
  # Передаем tuple (emb, mask) для негатива
739
- if epoch % 10 == 0:
740
- generate_and_save_samples(fixed_samples, (uncond_emb, uncond_mask), global_step)
741
  last_n = sample_interval
742
 
743
  if save_model:
 
8
  from torch.utils.data.distributed import DistributedSampler
9
  from torch.optim.lr_scheduler import LambdaLR
10
  from collections import defaultdict
11
+ from diffusers import UNet2DConditionModel, AutoencoderKL#,AutoencoderKLFlux2
12
  from accelerate import Accelerator
13
  from datasets import load_from_disk
14
  from tqdm import tqdm
 
32
  batch_size = 36
33
  base_learning_rate = 2.7e-5
34
  min_learning_rate = 1e-5 #2.7e-5
35
+ num_epochs = 20
36
  sample_interval_share = 5
37
  max_length = 192
38
  use_wandb = True
 
49
  comet_ml_workspace = "recoilme"
50
  torch.backends.cuda.matmul.allow_tf32 = True
51
  torch.backends.cudnn.allow_tf32 = True
52
+ #torch.backends.cuda.enable_mem_efficient_sdp(False)
53
  dtype = torch.float32
54
  save_barrier = 1.01
55
  warmup_percent = 0.01
56
+ percentile_clipping = 95 #96 #97
57
  betta2 = 0.999
58
  eps = 1e-7
59
  clip_grad_norm = 1.0
 
71
  # Параметры для диффузии
72
  n_diffusion_steps = 40
73
  samples_to_generate = 12
74
+ guidance_scale = 4
75
 
76
  # Папки для сохранения результатов
77
  generated_folder = "samples"
 
736
 
737
  if global_step % sample_interval == 0:
738
  # Передаем tuple (emb, mask) для негатива
739
+ #if epoch % 10 == 0:
740
+ generate_and_save_samples(fixed_samples, (uncond_emb, uncond_mask), global_step)
741
  last_n = sample_interval
742
 
743
  if save_model:
unet/diffusion_pytorch_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:6c9cc2753742ec7627ccddab26e135a2016ac587d40a6c699ee4c7058e5e5107
3
  size 7444321360
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:798a8bad743e0f338c462ffc5939c695367beacc54006359f8cf4a52e3340c3f
3
  size 7444321360