Hugging Face's logo

ButterChicken98
/
plantVillage-stableDiffusion-2-test

Text-to-Image
Diffusers
TensorBoard
Safetensors
StableDiffusionPipeline
stable-diffusion
stable-diffusion-diffusers
diffusers-training
Model card Files
xet
 Metrics Community
ButterChicken98 commited on
Commit
5515b4c
·
verified ·
1 Parent(s): 61c9c45

End of training

Browse files
This view is limited to 50 files because it contains too many changes.   See raw diff
Files changed (50) hide show
  1. .gitattributes +1 -0
  2. README.md +68 -0
  3. checkpoint-1000/optimizer.bin +3 -0
  4. checkpoint-1000/random_states_0.pkl +3 -0
  5. checkpoint-1000/scaler.pt +3 -0
  6. checkpoint-1000/scheduler.bin +3 -0
  7. checkpoint-1000/unet/config.json +68 -0
  8. checkpoint-1000/unet/diffusion_pytorch_model.safetensors +3 -0
  9. checkpoint-1500/optimizer.bin +3 -0
  10. checkpoint-1500/random_states_0.pkl +3 -0
  11. checkpoint-1500/scaler.pt +3 -0
  12. checkpoint-1500/scheduler.bin +3 -0
  13. checkpoint-1500/unet/config.json +68 -0
  14. checkpoint-1500/unet/diffusion_pytorch_model.safetensors +3 -0
  15. checkpoint-2000/optimizer.bin +3 -0
  16. checkpoint-2000/random_states_0.pkl +3 -0
  17. checkpoint-2000/scaler.pt +3 -0
  18. checkpoint-2000/scheduler.bin +3 -0
  19. checkpoint-2000/unet/config.json +68 -0
  20. checkpoint-2000/unet/diffusion_pytorch_model.safetensors +3 -0
  21. checkpoint-2500/optimizer.bin +3 -0
  22. checkpoint-2500/random_states_0.pkl +3 -0
  23. checkpoint-2500/scaler.pt +3 -0
  24. checkpoint-2500/scheduler.bin +3 -0
  25. checkpoint-2500/unet/config.json +68 -0
  26. checkpoint-2500/unet/diffusion_pytorch_model.safetensors +3 -0
  27. checkpoint-3000/optimizer.bin +3 -0
  28. checkpoint-3000/random_states_0.pkl +3 -0
  29. checkpoint-3000/scaler.pt +3 -0
  30. checkpoint-3000/scheduler.bin +3 -0
  31. checkpoint-3000/unet/config.json +68 -0
  32. checkpoint-3000/unet/diffusion_pytorch_model.safetensors +3 -0
  33. feature_extractor/preprocessor_config.json +27 -0
  34. logs/text2image-fine-tune/1743706315.6283333/events.out.tfevents.1743706315.d57f9cfefe69.1413.1 +3 -0
  35. logs/text2image-fine-tune/1743706315.6304178/hparams.yml +55 -0
  36. logs/text2image-fine-tune/1743706513.3664665/events.out.tfevents.1743706513.d57f9cfefe69.2646.1 +3 -0
  37. logs/text2image-fine-tune/1743706513.368659/hparams.yml +55 -0
  38. logs/text2image-fine-tune/1743706606.2160504/events.out.tfevents.1743706606.d57f9cfefe69.6292.1 +3 -0
  39. logs/text2image-fine-tune/1743706606.2181096/hparams.yml +55 -0
  40. logs/text2image-fine-tune/events.out.tfevents.1743706315.d57f9cfefe69.1413.0 +3 -0
  41. logs/text2image-fine-tune/events.out.tfevents.1743706511.d57f9cfefe69.2646.0 +3 -0
  42. logs/text2image-fine-tune/events.out.tfevents.1743706604.d57f9cfefe69.6292.0 +3 -0
  43. model_index.json +38 -0
  44. safety_checker/config.json +31 -0
  45. safety_checker/model.safetensors +3 -0
  46. scheduler/scheduler_config.json +15 -0
  47. text_encoder/config.json +25 -0
  48. text_encoder/model.safetensors +3 -0
  49. tokenizer/merges.txt +0 -0
  50. tokenizer/special_tokens_map.json +24 -0
.gitattributes CHANGED
@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ val_imgs_grid.png filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,68 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: stable-diffusion-v1-5/stable-diffusion-v1-5
3
+ library_name: diffusers
4
+ license: creativeml-openrail-m
5
+ inference: true
6
+ tags:
7
+ - stable-diffusion
8
+ - stable-diffusion-diffusers
9
+ - text-to-image
10
+ - diffusers
11
+ - diffusers-training
12
+ ---
13
+
14
+ <!-- This model card has been generated automatically according to the information the training script had access to. You
15
+ should probably proofread and complete it, then remove this comment. -->
16
+
17
+
18
+ # Text-to-image finetuning - ButterChicken98/plantVillage-stableDiffusion-2-test
19
+
20
+ This pipeline was finetuned from **stable-diffusion-v1-5/stable-diffusion-v1-5** on the **ButterChicken98/controlnet_canny_segmented_tomato_Tomato_mosaic_virus** dataset. Below are some example images generated with the finetuned pipeline using the following prompts: ['A tomato leaf with mosaic-like patterns of light and dark green areas, indicative of Tomato mosaic virus.']:
21
+
22
+ ![val_imgs_grid](./val_imgs_grid.png)
23
+
24
+
25
+ ## Pipeline usage
26
+
27
+ You can use the pipeline like so:
28
+
29
+ ```python
30
+ from diffusers import DiffusionPipeline
31
+ import torch
32
+
33
+ pipeline = DiffusionPipeline.from_pretrained("ButterChicken98/plantVillage-stableDiffusion-2-test", torch_dtype=torch.float16)
34
+ prompt = "A tomato leaf with mosaic-like patterns of light and dark green areas, indicative of Tomato mosaic virus."
35
+ image = pipeline(prompt).images[0]
36
+ image.save("my_image.png")
37
+ ```
38
+
39
+ ## Training info
40
+
41
+ These are the key hyperparameters used during training:
42
+
43
+ * Epochs: 64
44
+ * Learning rate: 1e-06
45
+ * Batch size: 4
46
+ * Gradient accumulation steps: 1
47
+ * Image resolution: 256
48
+ * Mixed-precision: fp16
49
+
50
+
51
+ More information on all the CLI arguments and the environment are available on your [`wandb` run page](https://wandb.ai/butterchicken-iit-indore/text2image-fine-tune/runs/g4uxpdfl).
52
+
53
+
54
+ ## Intended uses & limitations
55
+
56
+ #### How to use
57
+
58
+ ```python
59
+ # TODO: add an example code snippet for running this diffusion pipeline
60
+ ```
61
+
62
+ #### Limitations and bias
63
+
64
+ [TODO: provide examples of latent issues and potential remediations]
65
+
66
+ ## Training details
67
+
68
+ [TODO: describe the data used to train the model]
checkpoint-1000/optimizer.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cbce0afc50d4ebcb33802d1b8887f54821a21200d56bd2cb5078d10a98663fa0
3
+ size 6876750164
checkpoint-1000/random_states_0.pkl ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:92ce19d19fbb4e626692990a37d0fa326f7a9509fbe713438309c5930e7b0fe2
3
+ size 14668
checkpoint-1000/scaler.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9d8fdcd0311eba9854fff738038ed4c1a269832665b4d88ba4e4e3d02a1a7e0e
3
+ size 988
checkpoint-1000/scheduler.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:89a7da3e6d27c72f90ebeab2b9608a263f7043b7fc070cdaccf606b64c686b1d
3
+ size 1000
checkpoint-1000/unet/config.json ADDED
@@ -0,0 +1,68 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_class_name": "UNet2DConditionModel",
3
+ "_diffusers_version": "0.33.0.dev0",
4
+ "_name_or_path": "stable-diffusion-v1-5/stable-diffusion-v1-5",
5
+ "act_fn": "silu",
6
+ "addition_embed_type": null,
7
+ "addition_embed_type_num_heads": 64,
8
+ "addition_time_embed_dim": null,
9
+ "attention_head_dim": 8,
10
+ "attention_type": "default",
11
+ "block_out_channels": [
12
+ 320,
13
+ 640,
14
+ 1280,
15
+ 1280
16
+ ],
17
+ "center_input_sample": false,
18
+ "class_embed_type": null,
19
+ "class_embeddings_concat": false,
20
+ "conv_in_kernel": 3,
21
+ "conv_out_kernel": 3,
22
+ "cross_attention_dim": 768,
23
+ "cross_attention_norm": null,
24
+ "down_block_types": [
25
+ "CrossAttnDownBlock2D",
26
+ "CrossAttnDownBlock2D",
27
+ "CrossAttnDownBlock2D",
28
+ "DownBlock2D"
29
+ ],
30
+ "downsample_padding": 1,
31
+ "dropout": 0.0,
32
+ "dual_cross_attention": false,
33
+ "encoder_hid_dim": null,
34
+ "encoder_hid_dim_type": null,
35
+ "flip_sin_to_cos": true,
36
+ "freq_shift": 0,
37
+ "in_channels": 4,
38
+ "layers_per_block": 2,
39
+ "mid_block_only_cross_attention": null,
40
+ "mid_block_scale_factor": 1,
41
+ "mid_block_type": "UNetMidBlock2DCrossAttn",
42
+ "norm_eps": 1e-05,
43
+ "norm_num_groups": 32,
44
+ "num_attention_heads": null,
45
+ "num_class_embeds": null,
46
+ "only_cross_attention": false,
47
+ "out_channels": 4,
48
+ "projection_class_embeddings_input_dim": null,
49
+ "resnet_out_scale_factor": 1.0,
50
+ "resnet_skip_time_act": false,
51
+ "resnet_time_scale_shift": "default",
52
+ "reverse_transformer_layers_per_block": null,
53
+ "sample_size": 64,
54
+ "time_cond_proj_dim": null,
55
+ "time_embedding_act_fn": null,
56
+ "time_embedding_dim": null,
57
+ "time_embedding_type": "positional",
58
+ "timestep_post_act": null,
59
+ "transformer_layers_per_block": 1,
60
+ "up_block_types": [
61
+ "UpBlock2D",
62
+ "CrossAttnUpBlock2D",
63
+ "CrossAttnUpBlock2D",
64
+ "CrossAttnUpBlock2D"
65
+ ],
66
+ "upcast_attention": false,
67
+ "use_linear_projection": false
68
+ }
checkpoint-1000/unet/diffusion_pytorch_model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a8d9a8e42726fcf13a9e351a6a3d29f3d73baa763ec8a009e4d1a1f9fbfa280b
3
+ size 3438167536
checkpoint-1500/optimizer.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ce94fa9c914061b61e1389dc6d36c3cbf148a79d3f21b096dc47f762f968a8b7
3
+ size 6876750164
checkpoint-1500/random_states_0.pkl ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:00bdf271647afea097433532e422efd47bcbcbf80a95d4b7cb6566baf7a03cc6
3
+ size 14668
checkpoint-1500/scaler.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c2a4b6e0ef05ca249f2d6b7f9f3ad1dff81e55842a962df795bb9740c17c8e92
3
+ size 988
checkpoint-1500/scheduler.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c84ccb331b6333c2f984c4666031f8a7a4d7ae1c03010fb3ea0d503397aa911b
3
+ size 1000
checkpoint-1500/unet/config.json ADDED
@@ -0,0 +1,68 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_class_name": "UNet2DConditionModel",
3
+ "_diffusers_version": "0.33.0.dev0",
4
+ "_name_or_path": "stable-diffusion-v1-5/stable-diffusion-v1-5",
5
+ "act_fn": "silu",
6
+ "addition_embed_type": null,
7
+ "addition_embed_type_num_heads": 64,
8
+ "addition_time_embed_dim": null,
9
+ "attention_head_dim": 8,
10
+ "attention_type": "default",
11
+ "block_out_channels": [
12
+ 320,
13
+ 640,
14
+ 1280,
15
+ 1280
16
+ ],
17
+ "center_input_sample": false,
18
+ "class_embed_type": null,
19
+ "class_embeddings_concat": false,
20
+ "conv_in_kernel": 3,
21
+ "conv_out_kernel": 3,
22
+ "cross_attention_dim": 768,
23
+ "cross_attention_norm": null,
24
+ "down_block_types": [
25
+ "CrossAttnDownBlock2D",
26
+ "CrossAttnDownBlock2D",
27
+ "CrossAttnDownBlock2D",
28
+ "DownBlock2D"
29
+ ],
30
+ "downsample_padding": 1,
31
+ "dropout": 0.0,
32
+ "dual_cross_attention": false,
33
+ "encoder_hid_dim": null,
34
+ "encoder_hid_dim_type": null,
35
+ "flip_sin_to_cos": true,
36
+ "freq_shift": 0,
37
+ "in_channels": 4,
38
+ "layers_per_block": 2,
39
+ "mid_block_only_cross_attention": null,
40
+ "mid_block_scale_factor": 1,
41
+ "mid_block_type": "UNetMidBlock2DCrossAttn",
42
+ "norm_eps": 1e-05,
43
+ "norm_num_groups": 32,
44
+ "num_attention_heads": null,
45
+ "num_class_embeds": null,
46
+ "only_cross_attention": false,
47
+ "out_channels": 4,
48
+ "projection_class_embeddings_input_dim": null,
49
+ "resnet_out_scale_factor": 1.0,
50
+ "resnet_skip_time_act": false,
51
+ "resnet_time_scale_shift": "default",
52
+ "reverse_transformer_layers_per_block": null,
53
+ "sample_size": 64,
54
+ "time_cond_proj_dim": null,
55
+ "time_embedding_act_fn": null,
56
+ "time_embedding_dim": null,
57
+ "time_embedding_type": "positional",
58
+ "timestep_post_act": null,
59
+ "transformer_layers_per_block": 1,
60
+ "up_block_types": [
61
+ "UpBlock2D",
62
+ "CrossAttnUpBlock2D",
63
+ "CrossAttnUpBlock2D",
64
+ "CrossAttnUpBlock2D"
65
+ ],
66
+ "upcast_attention": false,
67
+ "use_linear_projection": false
68
+ }
checkpoint-1500/unet/diffusion_pytorch_model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:24d29ad574f6a0bed937a60df09c0bd70699c52fc692f579134a8642b5da879b
3
+ size 3438167536
checkpoint-2000/optimizer.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b6a85fb7e8440bdd9063d5a1f7fc64e628a54d566a6d3495e9ac254450df5b92
3
+ size 6876750164
checkpoint-2000/random_states_0.pkl ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:31daf2c5c6549fd308ac9a111bbd605839a3b6f85679205cb01d99e2276f3159
3
+ size 14668
checkpoint-2000/scaler.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3c50a9cebe5d66d453d25b140738bff479749ac03e0a43597d8776bc22f6ed0c
3
+ size 988
checkpoint-2000/scheduler.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0f2515f4bd62bdb441bec39e1208e843a7d2045b529bf1ce39d912c5927135f6
3
+ size 1000
checkpoint-2000/unet/config.json ADDED
@@ -0,0 +1,68 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_class_name": "UNet2DConditionModel",
3
+ "_diffusers_version": "0.33.0.dev0",
4
+ "_name_or_path": "stable-diffusion-v1-5/stable-diffusion-v1-5",
5
+ "act_fn": "silu",
6
+ "addition_embed_type": null,
7
+ "addition_embed_type_num_heads": 64,
8
+ "addition_time_embed_dim": null,
9
+ "attention_head_dim": 8,
10
+ "attention_type": "default",
11
+ "block_out_channels": [
12
+ 320,
13
+ 640,
14
+ 1280,
15
+ 1280
16
+ ],
17
+ "center_input_sample": false,
18
+ "class_embed_type": null,
19
+ "class_embeddings_concat": false,
20
+ "conv_in_kernel": 3,
21
+ "conv_out_kernel": 3,
22
+ "cross_attention_dim": 768,
23
+ "cross_attention_norm": null,
24
+ "down_block_types": [
25
+ "CrossAttnDownBlock2D",
26
+ "CrossAttnDownBlock2D",
27
+ "CrossAttnDownBlock2D",
28
+ "DownBlock2D"
29
+ ],
30
+ "downsample_padding": 1,
31
+ "dropout": 0.0,
32
+ "dual_cross_attention": false,
33
+ "encoder_hid_dim": null,
34
+ "encoder_hid_dim_type": null,
35
+ "flip_sin_to_cos": true,
36
+ "freq_shift": 0,
37
+ "in_channels": 4,
38
+ "layers_per_block": 2,
39
+ "mid_block_only_cross_attention": null,
40
+ "mid_block_scale_factor": 1,
41
+ "mid_block_type": "UNetMidBlock2DCrossAttn",
42
+ "norm_eps": 1e-05,
43
+ "norm_num_groups": 32,
44
+ "num_attention_heads": null,
45
+ "num_class_embeds": null,
46
+ "only_cross_attention": false,
47
+ "out_channels": 4,
48
+ "projection_class_embeddings_input_dim": null,
49
+ "resnet_out_scale_factor": 1.0,
50
+ "resnet_skip_time_act": false,
51
+ "resnet_time_scale_shift": "default",
52
+ "reverse_transformer_layers_per_block": null,
53
+ "sample_size": 64,
54
+ "time_cond_proj_dim": null,
55
+ "time_embedding_act_fn": null,
56
+ "time_embedding_dim": null,
57
+ "time_embedding_type": "positional",
58
+ "timestep_post_act": null,
59
+ "transformer_layers_per_block": 1,
60
+ "up_block_types": [
61
+ "UpBlock2D",
62
+ "CrossAttnUpBlock2D",
63
+ "CrossAttnUpBlock2D",
64
+ "CrossAttnUpBlock2D"
65
+ ],
66
+ "upcast_attention": false,
67
+ "use_linear_projection": false
68
+ }
checkpoint-2000/unet/diffusion_pytorch_model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9c9a24ef851aa42461c0896998d6172bea306ec7a4f3caf6879918ee124dd684
3
+ size 3438167536
checkpoint-2500/optimizer.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:51e7d91cc44e6aeaee1a9ad31cfa19cffde5f5655fe27c873ed0a2d50003c8f5
3
+ size 6876750164
checkpoint-2500/random_states_0.pkl ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:67686a2ead08274d2660c0df67306467276561e60ddfa2b73704ef1aa3a3cb32
3
+ size 14668
checkpoint-2500/scaler.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:48e2d97f563bb838328076a1666504681962151a3975a2f064be3a03e6500740
3
+ size 988
checkpoint-2500/scheduler.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b8dc0d71279a3dd6f7ca516f8616a3a3bf9651833e3a607e25a5b6a4c92dd066
3
+ size 1000
checkpoint-2500/unet/config.json ADDED
@@ -0,0 +1,68 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_class_name": "UNet2DConditionModel",
3
+ "_diffusers_version": "0.33.0.dev0",
4
+ "_name_or_path": "stable-diffusion-v1-5/stable-diffusion-v1-5",
5
+ "act_fn": "silu",
6
+ "addition_embed_type": null,
7
+ "addition_embed_type_num_heads": 64,
8
+ "addition_time_embed_dim": null,
9
+ "attention_head_dim": 8,
10
+ "attention_type": "default",
11
+ "block_out_channels": [
12
+ 320,
13
+ 640,
14
+ 1280,
15
+ 1280
16
+ ],
17
+ "center_input_sample": false,
18
+ "class_embed_type": null,
19
+ "class_embeddings_concat": false,
20
+ "conv_in_kernel": 3,
21
+ "conv_out_kernel": 3,
22
+ "cross_attention_dim": 768,
23
+ "cross_attention_norm": null,
24
+ "down_block_types": [
25
+ "CrossAttnDownBlock2D",
26
+ "CrossAttnDownBlock2D",
27
+ "CrossAttnDownBlock2D",
28
+ "DownBlock2D"
29
+ ],
30
+ "downsample_padding": 1,
31
+ "dropout": 0.0,
32
+ "dual_cross_attention": false,
33
+ "encoder_hid_dim": null,
34
+ "encoder_hid_dim_type": null,
35
+ "flip_sin_to_cos": true,
36
+ "freq_shift": 0,
37
+ "in_channels": 4,
38
+ "layers_per_block": 2,
39
+ "mid_block_only_cross_attention": null,
40
+ "mid_block_scale_factor": 1,
41
+ "mid_block_type": "UNetMidBlock2DCrossAttn",
42
+ "norm_eps": 1e-05,
43
+ "norm_num_groups": 32,
44
+ "num_attention_heads": null,
45
+ "num_class_embeds": null,
46
+ "only_cross_attention": false,
47
+ "out_channels": 4,
48
+ "projection_class_embeddings_input_dim": null,
49
+ "resnet_out_scale_factor": 1.0,
50
+ "resnet_skip_time_act": false,
51
+ "resnet_time_scale_shift": "default",
52
+ "reverse_transformer_layers_per_block": null,
53
+ "sample_size": 64,
54
+ "time_cond_proj_dim": null,
55
+ "time_embedding_act_fn": null,
56
+ "time_embedding_dim": null,
57
+ "time_embedding_type": "positional",
58
+ "timestep_post_act": null,
59
+ "transformer_layers_per_block": 1,
60
+ "up_block_types": [
61
+ "UpBlock2D",
62
+ "CrossAttnUpBlock2D",
63
+ "CrossAttnUpBlock2D",
64
+ "CrossAttnUpBlock2D"
65
+ ],
66
+ "upcast_attention": false,
67
+ "use_linear_projection": false
68
+ }
checkpoint-2500/unet/diffusion_pytorch_model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bb13fefa8f8fa349a82966431c70417f0660fdbdca3091959d23477408cce138
3
+ size 3438167536
checkpoint-3000/optimizer.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8924f2be6b4972932ebaa400016751a814909521bfcc5392f9a0d8f4115b620a
3
+ size 6876750164
checkpoint-3000/random_states_0.pkl ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:905f545e34c16a4088d8c8a2f63e636a5b6db82b8e59627c19b3c3c076224a56
3
+ size 14668
checkpoint-3000/scaler.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:21aba8ed0f38ed1c04994c10a9ca7e9925e55ef2ed51283c43ff8e2cce78585f
3
+ size 988
checkpoint-3000/scheduler.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:09bb16ecc2ea58072cde8c696d4b711f6484fe536d28e16b95b2728aa3514dae
3
+ size 1000
checkpoint-3000/unet/config.json ADDED
@@ -0,0 +1,68 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_class_name": "UNet2DConditionModel",
3
+ "_diffusers_version": "0.33.0.dev0",
4
+ "_name_or_path": "stable-diffusion-v1-5/stable-diffusion-v1-5",
5
+ "act_fn": "silu",
6
+ "addition_embed_type": null,
7
+ "addition_embed_type_num_heads": 64,
8
+ "addition_time_embed_dim": null,
9
+ "attention_head_dim": 8,
10
+ "attention_type": "default",
11
+ "block_out_channels": [
12
+ 320,
13
+ 640,
14
+ 1280,
15
+ 1280
16
+ ],
17
+ "center_input_sample": false,
18
+ "class_embed_type": null,
19
+ "class_embeddings_concat": false,
20
+ "conv_in_kernel": 3,
21
+ "conv_out_kernel": 3,
22
+ "cross_attention_dim": 768,
23
+ "cross_attention_norm": null,
24
+ "down_block_types": [
25
+ "CrossAttnDownBlock2D",
26
+ "CrossAttnDownBlock2D",
27
+ "CrossAttnDownBlock2D",
28
+ "DownBlock2D"
29
+ ],
30
+ "downsample_padding": 1,
31
+ "dropout": 0.0,
32
+ "dual_cross_attention": false,
33
+ "encoder_hid_dim": null,
34
+ "encoder_hid_dim_type": null,
35
+ "flip_sin_to_cos": true,
36
+ "freq_shift": 0,
37
+ "in_channels": 4,
38
+ "layers_per_block": 2,
39
+ "mid_block_only_cross_attention": null,
40
+ "mid_block_scale_factor": 1,
41
+ "mid_block_type": "UNetMidBlock2DCrossAttn",
42
+ "norm_eps": 1e-05,
43
+ "norm_num_groups": 32,
44
+ "num_attention_heads": null,
45
+ "num_class_embeds": null,
46
+ "only_cross_attention": false,
47
+ "out_channels": 4,
48
+ "projection_class_embeddings_input_dim": null,
49
+ "resnet_out_scale_factor": 1.0,
50
+ "resnet_skip_time_act": false,
51
+ "resnet_time_scale_shift": "default",
52
+ "reverse_transformer_layers_per_block": null,
53
+ "sample_size": 64,
54
+ "time_cond_proj_dim": null,
55
+ "time_embedding_act_fn": null,
56
+ "time_embedding_dim": null,
57
+ "time_embedding_type": "positional",
58
+ "timestep_post_act": null,
59
+ "transformer_layers_per_block": 1,
60
+ "up_block_types": [
61
+ "UpBlock2D",
62
+ "CrossAttnUpBlock2D",
63
+ "CrossAttnUpBlock2D",
64
+ "CrossAttnUpBlock2D"
65
+ ],
66
+ "upcast_attention": false,
67
+ "use_linear_projection": false
68
+ }
checkpoint-3000/unet/diffusion_pytorch_model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1f4796c76b103d10c11ecfeec6b519f24be754562051ab67e4ee9826df97f15a
3
+ size 3438167536
feature_extractor/preprocessor_config.json ADDED
@@ -0,0 +1,27 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "crop_size": {
3
+ "height": 224,
4
+ "width": 224
5
+ },
6
+ "do_center_crop": true,
7
+ "do_convert_rgb": true,
8
+ "do_normalize": true,
9
+ "do_rescale": true,
10
+ "do_resize": true,
11
+ "image_mean": [
12
+ 0.48145466,
13
+ 0.4578275,
14
+ 0.40821073
15
+ ],
16
+ "image_processor_type": "CLIPImageProcessor",
17
+ "image_std": [
18
+ 0.26862954,
19
+ 0.26130258,
20
+ 0.27577711
21
+ ],
22
+ "resample": 3,
23
+ "rescale_factor": 0.00392156862745098,
24
+ "size": {
25
+ "shortest_edge": 224
26
+ }
27
+ }
logs/text2image-fine-tune/1743706315.6283333/events.out.tfevents.1743706315.d57f9cfefe69.1413.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3655533345478a60cf241a6538f8c74b21e47369a31e43469abb5c91eb71a677
3
+ size 2576
logs/text2image-fine-tune/1743706315.6304178/hparams.yml ADDED
@@ -0,0 +1,55 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ adam_beta1: 0.9
2
+ adam_beta2: 0.999
3
+ adam_epsilon: 1.0e-08
4
+ adam_weight_decay: 0.01
5
+ allow_tf32: false
6
+ cache_dir: null
7
+ caption_column: captions
8
+ center_crop: false
9
+ checkpointing_steps: 1000
10
+ checkpoints_total_limit: null
11
+ dataloader_num_workers: 8
12
+ dataset_config_name: null
13
+ dataset_name: ButterChicken98/controlnet_canny_segmented_tomato_Tomato_mosaic_virus
14
+ dream_detail_preservation: 1.0
15
+ dream_training: false
16
+ enable_xformers_memory_efficient_attention: false
17
+ foreach_ema: false
18
+ gradient_accumulation_steps: 16
19
+ gradient_checkpointing: false
20
+ hub_model_id: plantVillage-stableDiffusion-2-test
21
+ hub_token: null
22
+ image_column: image
23
+ input_perturbation: 0
24
+ learning_rate: 1.0e-06
25
+ local_rank: 0
26
+ logging_dir: logs
27
+ lr_scheduler: cosine
28
+ lr_warmup_steps: 300
29
+ max_grad_norm: 1.0
30
+ max_train_samples: null
31
+ max_train_steps: 3000
32
+ mixed_precision: fp16
33
+ noise_offset: 0
34
+ non_ema_revision: null
35
+ num_train_epochs: 250
36
+ offload_ema: false
37
+ output_dir: /data/march/text_to_image/out1
38
+ prediction_type: null
39
+ pretrained_model_name_or_path: stabilityai/stable-diffusion-2
40
+ push_to_hub: true
41
+ random_flip: true
42
+ report_to: tensorboard
43
+ resolution: 256
44
+ resume_from_checkpoint: null
45
+ revision: null
46
+ scale_lr: false
47
+ seed: 1337
48
+ snr_gamma: null
49
+ tracker_project_name: text2image-fine-tune
50
+ train_batch_size: 1
51
+ train_data_dir: null
52
+ use_8bit_adam: false
53
+ use_ema: false
54
+ validation_epochs: 5
55
+ variant: null
logs/text2image-fine-tune/1743706513.3664665/events.out.tfevents.1743706513.d57f9cfefe69.2646.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b3da3950670915ec3be9adb50746abcd124a7c4c16d84bbd5481417ef5e5c1f1
3
+ size 2648
logs/text2image-fine-tune/1743706513.368659/hparams.yml ADDED
@@ -0,0 +1,55 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ adam_beta1: 0.9
2
+ adam_beta2: 0.999
3
+ adam_epsilon: 1.0e-08
4
+ adam_weight_decay: 0.01
5
+ allow_tf32: false
6
+ cache_dir: null
7
+ caption_column: captions
8
+ center_crop: true
9
+ checkpointing_steps: 500
10
+ checkpoints_total_limit: 5
11
+ dataloader_num_workers: 8
12
+ dataset_config_name: null
13
+ dataset_name: ButterChicken98/controlnet_canny_segmented_tomato_Tomato_mosaic_virus
14
+ dream_detail_preservation: 1.0
15
+ dream_training: false
16
+ enable_xformers_memory_efficient_attention: false
17
+ foreach_ema: false
18
+ gradient_accumulation_steps: 16
19
+ gradient_checkpointing: false
20
+ hub_model_id: plantVillage-stableDiffusion-2-test
21
+ hub_token: null
22
+ image_column: image
23
+ input_perturbation: 0
24
+ learning_rate: 1.0e-06
25
+ local_rank: 0
26
+ logging_dir: logs
27
+ lr_scheduler: cosine
28
+ lr_warmup_steps: 300
29
+ max_grad_norm: 1.0
30
+ max_train_samples: null
31
+ max_train_steps: 3000
32
+ mixed_precision: fp16
33
+ noise_offset: 0
34
+ non_ema_revision: null
35
+ num_train_epochs: 250
36
+ offload_ema: false
37
+ output_dir: /data/march/text_to_image/out1
38
+ prediction_type: null
39
+ pretrained_model_name_or_path: stable-diffusion-v1-5/stable-diffusion-v1-5
40
+ push_to_hub: true
41
+ random_flip: true
42
+ report_to: all
43
+ resolution: 256
44
+ resume_from_checkpoint: null
45
+ revision: null
46
+ scale_lr: false
47
+ seed: 1337
48
+ snr_gamma: null
49
+ tracker_project_name: text2image-fine-tune
50
+ train_batch_size: 1
51
+ train_data_dir: null
52
+ use_8bit_adam: false
53
+ use_ema: false
54
+ validation_epochs: 5
55
+ variant: null
logs/text2image-fine-tune/1743706606.2160504/events.out.tfevents.1743706606.d57f9cfefe69.6292.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e0c725eb375fd463b88f0df6b87c3a754e8c4f06ae347b4e3854c9182483185c
3
+ size 2648
logs/text2image-fine-tune/1743706606.2181096/hparams.yml ADDED
@@ -0,0 +1,55 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ adam_beta1: 0.9
2
+ adam_beta2: 0.999
3
+ adam_epsilon: 1.0e-08
4
+ adam_weight_decay: 0.01
5
+ allow_tf32: false
6
+ cache_dir: null
7
+ caption_column: captions
8
+ center_crop: true
9
+ checkpointing_steps: 500
10
+ checkpoints_total_limit: 5
11
+ dataloader_num_workers: 8
12
+ dataset_config_name: null
13
+ dataset_name: ButterChicken98/controlnet_canny_segmented_tomato_Tomato_mosaic_virus
14
+ dream_detail_preservation: 1.0
15
+ dream_training: false
16
+ enable_xformers_memory_efficient_attention: false
17
+ foreach_ema: false
18
+ gradient_accumulation_steps: 1
19
+ gradient_checkpointing: false
20
+ hub_model_id: plantVillage-stableDiffusion-2-test
21
+ hub_token: null
22
+ image_column: image
23
+ input_perturbation: 0
24
+ learning_rate: 1.0e-06
25
+ local_rank: 0
26
+ logging_dir: logs
27
+ lr_scheduler: cosine
28
+ lr_warmup_steps: 300
29
+ max_grad_norm: 1.0
30
+ max_train_samples: null
31
+ max_train_steps: 3000
32
+ mixed_precision: fp16
33
+ noise_offset: 0
34
+ non_ema_revision: null
35
+ num_train_epochs: 64
36
+ offload_ema: false
37
+ output_dir: /data/march/text_to_image/out1
38
+ prediction_type: null
39
+ pretrained_model_name_or_path: stable-diffusion-v1-5/stable-diffusion-v1-5
40
+ push_to_hub: true
41
+ random_flip: true
42
+ report_to: all
43
+ resolution: 256
44
+ resume_from_checkpoint: null
45
+ revision: null
46
+ scale_lr: false
47
+ seed: 1337
48
+ snr_gamma: null
49
+ tracker_project_name: text2image-fine-tune
50
+ train_batch_size: 4
51
+ train_data_dir: null
52
+ use_8bit_adam: false
53
+ use_ema: false
54
+ validation_epochs: 5
55
+ variant: null
logs/text2image-fine-tune/events.out.tfevents.1743706315.d57f9cfefe69.1413.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5ba3b83f9b7014f109d45733d85c24bb841f06de6a8959385d77b1a3f650622e
3
+ size 280
logs/text2image-fine-tune/events.out.tfevents.1743706511.d57f9cfefe69.2646.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7021fee2428e55f0614ac77444569f5e59304ecb07a632789fe90e106885ed81
3
+ size 583606
logs/text2image-fine-tune/events.out.tfevents.1743706604.d57f9cfefe69.6292.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f458c680a455454c56b76e50d30f2880c9c03ca9d7efe0156f85f72ae06966b9
3
+ size 7477975
model_index.json ADDED
@@ -0,0 +1,38 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_class_name": "StableDiffusionPipeline",
3
+ "_diffusers_version": "0.33.0.dev0",
4
+ "_name_or_path": "stable-diffusion-v1-5/stable-diffusion-v1-5",
5
+ "feature_extractor": [
6
+ "transformers",
7
+ "CLIPImageProcessor"
8
+ ],
9
+ "image_encoder": [
10
+ null,
11
+ null
12
+ ],
13
+ "requires_safety_checker": true,
14
+ "safety_checker": [
15
+ "stable_diffusion",
16
+ "StableDiffusionSafetyChecker"
17
+ ],
18
+ "scheduler": [
19
+ "diffusers",
20
+ "PNDMScheduler"
21
+ ],
22
+ "text_encoder": [
23
+ "transformers",
24
+ "CLIPTextModel"
25
+ ],
26
+ "tokenizer": [
27
+ "transformers",
28
+ "CLIPTokenizer"
29
+ ],
30
+ "unet": [
31
+ "diffusers",
32
+ "UNet2DConditionModel"
33
+ ],
34
+ "vae": [
35
+ "diffusers",
36
+ "AutoencoderKL"
37
+ ]
38
+ }
safety_checker/config.json ADDED
@@ -0,0 +1,31 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_name_or_path": "/root/.cache/huggingface/hub/models--stable-diffusion-v1-5--stable-diffusion-v1-5/snapshots/451f4fe16113bff5a5d2269ed5ad43b0592e9a14/safety_checker",
3
+ "architectures": [
4
+ "StableDiffusionSafetyChecker"
5
+ ],
6
+ "initializer_factor": 1.0,
7
+ "logit_scale_init_value": 2.6592,
8
+ "model_type": "clip",
9
+ "projection_dim": 768,
10
+ "text_config": {
11
+ "dropout": 0.0,
12
+ "hidden_size": 768,
13
+ "intermediate_size": 3072,
14
+ "model_type": "clip_text_model",
15
+ "num_attention_heads": 12,
16
+ "torch_dtype": "float32"
17
+ },
18
+ "torch_dtype": "float32",
19
+ "transformers_version": "4.49.0",
20
+ "vision_config": {
21
+ "_attn_implementation_autoset": true,
22
+ "dropout": 0.0,
23
+ "hidden_size": 1024,
24
+ "intermediate_size": 4096,
25
+ "model_type": "clip_vision_model",
26
+ "num_attention_heads": 16,
27
+ "num_hidden_layers": 24,
28
+ "patch_size": 14,
29
+ "torch_dtype": "float32"
30
+ }
31
+ }
safety_checker/model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fb351a5ded815c3ff744968ad9c6b218d071b9d313d04f35e813b84b4c0ffde8
3
+ size 1215979664
scheduler/scheduler_config.json ADDED
@@ -0,0 +1,15 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_class_name": "PNDMScheduler",
3
+ "_diffusers_version": "0.33.0.dev0",
4
+ "beta_end": 0.012,
5
+ "beta_schedule": "scaled_linear",
6
+ "beta_start": 0.00085,
7
+ "clip_sample": false,
8
+ "num_train_timesteps": 1000,
9
+ "prediction_type": "epsilon",
10
+ "set_alpha_to_one": false,
11
+ "skip_prk_steps": true,
12
+ "steps_offset": 1,
13
+ "timestep_spacing": "leading",
14
+ "trained_betas": null
15
+ }
text_encoder/config.json ADDED
@@ -0,0 +1,25 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_name_or_path": "stable-diffusion-v1-5/stable-diffusion-v1-5",
3
+ "architectures": [
4
+ "CLIPTextModel"
5
+ ],
6
+ "attention_dropout": 0.0,
7
+ "bos_token_id": 0,
8
+ "dropout": 0.0,
9
+ "eos_token_id": 2,
10
+ "hidden_act": "quick_gelu",
11
+ "hidden_size": 768,
12
+ "initializer_factor": 1.0,
13
+ "initializer_range": 0.02,
14
+ "intermediate_size": 3072,
15
+ "layer_norm_eps": 1e-05,
16
+ "max_position_embeddings": 77,
17
+ "model_type": "clip_text_model",
18
+ "num_attention_heads": 12,
19
+ "num_hidden_layers": 12,
20
+ "pad_token_id": 1,
21
+ "projection_dim": 768,
22
+ "torch_dtype": "float16",
23
+ "transformers_version": "4.49.0",
24
+ "vocab_size": 49408
25
+ }
text_encoder/model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:660c6f5b1abae9dc498ac2d21e1347d2abdb0cf6c0c0c8576cd796491d9a6cdd
3
+ size 246144152
tokenizer/merges.txt ADDED
The diff for this file is too large to render. See raw diff
 
tokenizer/special_tokens_map.json ADDED
@@ -0,0 +1,24 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "bos_token": {
3
+ "content": "<|startoftext|>",
4
+ "lstrip": false,
5
+ "normalized": true,
6
+ "rstrip": false,
7
+ "single_word": false
8
+ },
9
+ "eos_token": {
10
+ "content": "<|endoftext|>",
11
+ "lstrip": false,
12
+ "normalized": true,
13
+ "rstrip": false,
14
+ "single_word": false
15
+ },
16
+ "pad_token": "<|endoftext|>",
17
+ "unk_token": {
18
+ "content": "<|endoftext|>",
19
+ "lstrip": false,
20
+ "normalized": true,
21
+ "rstrip": false,
22
+ "single_word": false
23
+ }
24
+ }