PrakhAI commited on
Commit
d6f77c9
·
1 Parent(s): 7cdea59

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +15 -7
README.md CHANGED
@@ -6,6 +6,8 @@ datasets:
6
 
7
  GAN model trained on [CIFAR10 (Airplane)](https://www.tensorflow.org/datasets/catalog/cifar10) and [FGVC Aircraft](https://www.robots.ox.ac.uk/~vgg/data/fgvc-aircraft/) images. The model leverages [Progressive Growing](https://arxiv.org/pdf/1710.10196.pdf) with [Spectral Normalization](https://arxiv.org/pdf/1802.05957.pdf).
8
 
 
 
9
  | Generated Images | Real Images (for comparison) |
10
  | -------- | --------- |
11
  | ![generated_1691259071.png](https://cdn-uploads.huggingface.co/production/uploads/649f9483d76ca0fe679011c2/DNio2mes1414p6cgm7K62.png) | ![image.png](https://cdn-uploads.huggingface.co/production/uploads/649f9483d76ca0fe679011c2/4Sp33Hl9JK2cfHzBXHXfh.png) |
@@ -26,16 +28,22 @@ The Generator uses Transposed Convolutions (2x2 kernel) with strides for upsampl
26
 
27
  # Spectral Normalization
28
 
29
- # Progressive Growing
30
 
31
- Progressive Growing of GAN resolutions is suggested to improve the Quality and Stability of GAN training, especially for higher resolution models (1024x1024).
32
 
33
- For 32x32 images of Airplanes, even a short initial round of Progressive Growing clearly has an impact:
34
 
35
- | Flat Growing (50K steps) | Progressive Growing (50K steps) |
36
  | ----------- | ------------ |
37
- | ![image.png](https://cdn-uploads.huggingface.co/production/uploads/649f9483d76ca0fe679011c2/QnTET-5ae_0x11CcXeWgR.png) | ![image.png](https://cdn-uploads.huggingface.co/production/uploads/649f9483d76ca0fe679011c2/lT_IwqkL60M1RSxEtJLaJ.png) |
 
 
 
 
38
 
39
- Moreover, the additional parameter cost is very small (876.6 KB vs 855.1 KB for the generator).
40
 
41
- # Does the model simply memorize the images?
 
 
 
6
 
7
  GAN model trained on [CIFAR10 (Airplane)](https://www.tensorflow.org/datasets/catalog/cifar10) and [FGVC Aircraft](https://www.robots.ox.ac.uk/~vgg/data/fgvc-aircraft/) images. The model leverages [Progressive Growing](https://arxiv.org/pdf/1710.10196.pdf) with [Spectral Normalization](https://arxiv.org/pdf/1802.05957.pdf).
8
 
9
+ Try out this model [here](https://huggingface.co/spaces/PrakhAI/AIPlane).
10
+
11
  | Generated Images | Real Images (for comparison) |
12
  | -------- | --------- |
13
  | ![generated_1691259071.png](https://cdn-uploads.huggingface.co/production/uploads/649f9483d76ca0fe679011c2/DNio2mes1414p6cgm7K62.png) | ![image.png](https://cdn-uploads.huggingface.co/production/uploads/649f9483d76ca0fe679011c2/4Sp33Hl9JK2cfHzBXHXfh.png) |
 
28
 
29
  # Spectral Normalization
30
 
31
+ Spectral Normalization is a technique suggested for training GANs in [this paper](https://arxiv.org/pdf/1802.05957.pdf).
32
 
33
+ It aims to make the Critic's (Discriminator's) outputs mathematically continuous w.r.t. the space of input images, avoiding exploding gradients.
34
 
35
+ It works very well in practice to stabilize the training of the GAN, as demonstrated by the example below (comparison at equivalent points during training):
36
 
37
+ | Batch Normalization | Spectral Normalization |
38
  | ----------- | ------------ |
39
+ | ![image.png](https://cdn-uploads.huggingface.co/production/uploads/649f9483d76ca0fe679011c2/PNbqYRjw24OhMManXaMS9.png) | ![image.png](https://cdn-uploads.huggingface.co/production/uploads/649f9483d76ca0fe679011c2/F8q4y2vshssfdc70jH_X2.png) |
40
+
41
+ # Progressive Growing
42
+
43
+ Progressive Growing of GAN resolutions is suggested to improve the Quality and Stability of GAN training, especially for higher resolution models (1024x1024).
44
 
45
+ For 32x32 images of Airplanes, even a short initial round of Progressive Growing provides significant improvement (comparison at equivalent points during training):
46
 
47
+ | Flat Growing | Progressive Growing |
48
+ | ----------- | ------------ |
49
+ | ![image.png](https://cdn-uploads.huggingface.co/production/uploads/649f9483d76ca0fe679011c2/QnTET-5ae_0x11CcXeWgR.png) | ![image.png](https://cdn-uploads.huggingface.co/production/uploads/649f9483d76ca0fe679011c2/F8q4y2vshssfdc70jH_X2.png) |