ronchern commited on
Commit
f86afa5
·
verified ·
1 Parent(s): b89d7fb

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +112 -0
README.md ADDED
@@ -0,0 +1,112 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ # For reference on model card metadata, see the spec: https://github.com/huggingface/hub-docs/blob/main/modelcard.md?plain=1
3
+ # Doc / guide: https://huggingface.co/docs/hub/model-cards
4
+ {}
5
+ ---
6
+
7
+ ### Model Description
8
+
9
+ This repository contains the trained checkpoints (.pt) and generated samples (.png) for two generative models trained on a subset of the STL-10 dataset.
10
+
11
+ - Pixel DDPM: Standard diffusion on 96x96 RGB images.
12
+
13
+ - Latent DDPM (LDM): Diffusion on a compressed 12x12x4 latent space (using a VAE).
14
+
15
+ Note: This repository only contains the weights. To load and use these models,
16
+ you must have the original model definitions (DDPM.py and VAE.py) in your local Python environment.
17
+
18
+
19
+ - **Developed by:** Linoy Geva & Ron Chernoguz
20
+ - **Model type:** DDPM/LPM
21
+
22
+
23
+ ## Uses
24
+
25
+ This model is designed to generate synthetic data that mimics the characteristics of the STL-10 dataset.
26
+ It is intended for use in experimental research comparing the effectiveness of diffusion-based data augmentation
27
+ against traditional/manual augmentation techniques for CNN classification.
28
+
29
+
30
+ ### Recommendations
31
+
32
+ <!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
33
+
34
+
35
+ ## Training Details
36
+
37
+
38
+ ### Training Data
39
+
40
+ <!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
41
+
42
+ [More Information Needed]
43
+
44
+ ### Training Procedure
45
+
46
+ <!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
47
+
48
+ #### Training Hyperparameters
49
+
50
+ ===========================================================
51
+ PIXEL DDPM (Baseline Model)
52
+ ===========================================================
53
+ • Optimization Strategy:
54
+ - Optimizer: AdamW
55
+ - Learning Rate: 2e-4 (with Cosine Annealing)
56
+ - Weight Decay: 1e-3
57
+ - Batch Size: 32
58
+ - Total Epochs: 225
59
+
60
+ • Model Architecture:
61
+ - Input: 96x96 RGB Images
62
+ - Base Channels: 64
63
+ - Channel Mults: (1, 2, 4, 8)
64
+ - EMA: Disabled
65
+ - Diffusion: 1000 Timesteps (Linear Schedule)
66
+
67
+ ===========================================================
68
+ LATENT DDPM (LDM)
69
+ ===========================================================
70
+ • Optimization Strategy:
71
+ - Optimizer: AdamW
72
+ - Learning Rate: 1e-4 (with Cosine Annealing)
73
+ - Weight Decay: 1e-3
74
+ - Batch Size: 64
75
+ - Total Epochs: 2500 (Target)
76
+
77
+ • Model Architecture:
78
+ - Input: 12x12x4 Latents (via VAE)
79
+ - Base Channels: 128
80
+ - Channel Mults: (2, 2)
81
+ - EMA: Enabled (Decay: 0.99)
82
+
83
+ • Conditioning (CFG):
84
+ - Label Dropout: 15% (during training)
85
+ - Guidance Scale: 5.0 (during inference)
86
+ ===========================================================
87
+
88
+
89
+ #### Testing Data
90
+
91
+ <!-- This should link to a Dataset Card if possible. -->
92
+
93
+ [More Information Needed]
94
+
95
+
96
+
97
+ ### Results
98
+
99
+ [More Information Needed]
100
+
101
+ #### Summary
102
+
103
+
104
+
105
+ ### Compute Infrastructure
106
+
107
+ [More Information Needed]
108
+
109
+ #### Hardware
110
+
111
+ [More Information Needed]
112
+