|
|
--- |
|
|
datasets: |
|
|
- https://www.robots.ox.ac.uk/~vgg/data/fgvc-aircraft/ |
|
|
--- |
|
|
|
|
|
| Generated | Real (for comparison) | |
|
|
| ----- | --------- | |
|
|
|  |  | |
|
|
|
|
|
This GAN model is trained on the [FGVC Aircraft](https://www.robots.ox.ac.uk/~vgg/data/fgvc-aircraft/) dataset. The model uses [Progressive Growing](https://arxiv.org/pdf/1710.10196.pdf) with [Spectral Normalization](https://arxiv.org/pdf/1802.05957.pdf). |
|
|
|
|
|
The work builds up on https://huggingface.co/PrakhAI/AIPlane and https://huggingface.co/PrakhAI/AIPlane2. |
|
|
|
|
|
This model was trained to generate 256x256 images of Aircrafts. The implementation in JAX on Colab can be found [here](https://colab.research.google.com/github/prakharbanga/AIPlane3/blob/main/AIPlane3_ProGAN_%2B_Spectral_Norm_(256x256).ipynb). |
|
|
|
|
|
# Convolutional Architecture |
|
|
|
|
|
A significant improvement over https://huggingface.co/PrakhAI/AIPlane2 is the elimination of "checkerboard" artifacts. This is done by using Image Resize followed by Convolution layer in the Generator instead of a Transposed Convolution where the kernel size is not divisible by the stride. |
|
|
|
|
|
| Transposed Convolution (kernel size not divisible by stride) | Resize followed by convolution | |
|
|
| - | - | |
|
|
|  |  | |
|
|
|
|
|
# Image Quality |
|
|
|
|
|
The model, while generating several high quality images of Airplanes, also generates poor quality images. |
|
|
|
|
|
A total of 400 generated images were labeled by hand as either desirable (151) or undesirable (249). |
|
|
|
|
|
| Sample desirable outputs | Sample undesirable outputs | |
|
|
| --------- | ------------ | |
|
|
|  |  | |
|
|
|
|
|
# Latent Space Interpolation |
|
|
|
|
|
Latent Space Interpolation can an educational exercise to get deeper insight into the model. |
|
|
|
|
|
It can be observed below that several aspects of the generated image such as the color of the sky, grounded-ness of the plane, as well as the plane shape and color are frequently continuous through the latent space. |
|
|
|
|
|
 |
|
|
|
|
|
# Training Progression |
|
|
|
|
|
<video controls width="50%" src="https://cdn-uploads.huggingface.co/production/uploads/649f9483d76ca0fe679011c2/o2NDDMQPhdEY5Vc96b31G.mp4"></video> |
|
|
|
