Update README.md
Browse files
README.md
CHANGED
|
@@ -6,6 +6,8 @@ datasets:
|
|
| 6 |
|
| 7 |
GAN model trained on [CIFAR10 (Airplane)](https://www.tensorflow.org/datasets/catalog/cifar10) and [FGVC Aircraft](https://www.robots.ox.ac.uk/~vgg/data/fgvc-aircraft/) images. The model leverages [Progressive Growing](https://arxiv.org/pdf/1710.10196.pdf) with [Spectral Normalization](https://arxiv.org/pdf/1802.05957.pdf).
|
| 8 |
|
|
|
|
|
|
|
| 9 |
| Generated Images | Real Images (for comparison) |
|
| 10 |
| -------- | --------- |
|
| 11 |
|  |  |
|
|
@@ -26,16 +28,22 @@ The Generator uses Transposed Convolutions (2x2 kernel) with strides for upsampl
|
|
| 26 |
|
| 27 |
# Spectral Normalization
|
| 28 |
|
| 29 |
-
|
| 30 |
|
| 31 |
-
|
| 32 |
|
| 33 |
-
|
| 34 |
|
| 35 |
-
|
|
| 36 |
| ----------- | ------------ |
|
| 37 |
-
| ](https://www.tensorflow.org/datasets/catalog/cifar10) and [FGVC Aircraft](https://www.robots.ox.ac.uk/~vgg/data/fgvc-aircraft/) images. The model leverages [Progressive Growing](https://arxiv.org/pdf/1710.10196.pdf) with [Spectral Normalization](https://arxiv.org/pdf/1802.05957.pdf).
|
| 8 |
|
| 9 |
+
Try out this model [here](https://huggingface.co/spaces/PrakhAI/AIPlane).
|
| 10 |
+
|
| 11 |
| Generated Images | Real Images (for comparison) |
|
| 12 |
| -------- | --------- |
|
| 13 |
|  |  |
|
|
|
|
| 28 |
|
| 29 |
# Spectral Normalization
|
| 30 |
|
| 31 |
+
Spectral Normalization is a technique suggested for training GANs in [this paper](https://arxiv.org/pdf/1802.05957.pdf).
|
| 32 |
|
| 33 |
+
It aims to make the Critic's (Discriminator's) outputs mathematically continuous w.r.t. the space of input images, avoiding exploding gradients.
|
| 34 |
|
| 35 |
+
It works very well in practice to stabilize the training of the GAN, as demonstrated by the example below (comparison at equivalent points during training):
|
| 36 |
|
| 37 |
+
| Batch Normalization | Spectral Normalization |
|
| 38 |
| ----------- | ------------ |
|
| 39 |
+
|  |  |
|
| 40 |
+
|
| 41 |
+
# Progressive Growing
|
| 42 |
+
|
| 43 |
+
Progressive Growing of GAN resolutions is suggested to improve the Quality and Stability of GAN training, especially for higher resolution models (1024x1024).
|
| 44 |
|
| 45 |
+
For 32x32 images of Airplanes, even a short initial round of Progressive Growing provides significant improvement (comparison at equivalent points during training):
|
| 46 |
|
| 47 |
+
| Flat Growing | Progressive Growing |
|
| 48 |
+
| ----------- | ------------ |
|
| 49 |
+
|  |  |
|