Commit
·
13e9a0b
1
Parent(s):
5329b65
Update README.md
Browse files
README.md
CHANGED
|
@@ -40,12 +40,10 @@ This model is still in its infancy and it's meant to be constantly updated and t
|
|
| 40 |
- #### Stable:
|
| 41 |
- No stable version available right now.
|
| 42 |
- #### Beta:
|
| 43 |
-
- [vae.
|
| 44 |
- [maskgit.1206000.p](https://huggingface.co/Sygil/Sygil-Muse/blob/main/maskgit.1206000.pt): Maskgit trained from the VAE for 1.20M steps
|
| 45 |
|
| 46 |
-
Note: Checkpoints under the Beta section are updated daily or at least 3-4 times a week.
|
| 47 |
-
this is done until they are stable enough to be moved into a proper release, usually every 1 or 2 weeks.
|
| 48 |
-
While the beta checkpoints can be used as they are only the latest version is kept on the repo and the older checkpoints are removed when a new one
|
| 49 |
is uploaded to keep the repo clean.
|
| 50 |
|
| 51 |
## Training
|
|
@@ -55,16 +53,16 @@ The model was trained on the following dataset:
|
|
| 55 |
- [Imaginary Network Expanded Dataset](https://github.com/Sygil-Dev/INE-dataset) dataset.
|
| 56 |
|
| 57 |
**Hardware and others**
|
| 58 |
-
- **Hardware:** 1 x Nvidia RTX
|
| 59 |
- **Hours Trained:** NaN.
|
| 60 |
-
- **Gradient Accumulations**:
|
| 61 |
- **Batch:** 1
|
| 62 |
- **Learning Rate:** 7e-08
|
| 63 |
- **Warmup Steps:** 10,000
|
| 64 |
-
- **Resolution/Image Size**: First trained at a resolution of 64x64
|
| 65 |
-
- **Dimension:**
|
| 66 |
- **vq_codebook_size:** 256
|
| 67 |
-
- **Total Training Steps:** 2,
|
| 68 |
|
| 69 |
Note: On Muse we can change the image_size or resolution at any time without having to train the model from scratch again, this allows us to first train the model at low resolution using the same `dim` and `vq_codebook_size` to train faster and then we can increase the `image_size` and use a higher resolution once the model has trained enough.
|
| 70 |
|
|
|
|
| 40 |
- #### Stable:
|
| 41 |
- No stable version available right now.
|
| 42 |
- #### Beta:
|
| 43 |
+
- [vae.2700500.pt](https://huggingface.co/Sygil/Sygil-Muse/blob/main/vae.2700500.pt): Trained from scratch for 2.70M steps
|
| 44 |
- [maskgit.1206000.p](https://huggingface.co/Sygil/Sygil-Muse/blob/main/maskgit.1206000.pt): Maskgit trained from the VAE for 1.20M steps
|
| 45 |
|
| 46 |
+
Note: Checkpoints under the Beta section are updated daily or at least 3-4 times a week. While the beta checkpoints can be used as they are only the latest version is kept on the repo and the older checkpoints are removed when a new one
|
|
|
|
|
|
|
| 47 |
is uploaded to keep the repo clean.
|
| 48 |
|
| 49 |
## Training
|
|
|
|
| 53 |
- [Imaginary Network Expanded Dataset](https://github.com/Sygil-Dev/INE-dataset) dataset.
|
| 54 |
|
| 55 |
**Hardware and others**
|
| 56 |
+
- **Hardware:** 1 x Nvidia RTX 3050 GPU
|
| 57 |
- **Hours Trained:** NaN.
|
| 58 |
+
- **Gradient Accumulations**: 10
|
| 59 |
- **Batch:** 1
|
| 60 |
- **Learning Rate:** 7e-08
|
| 61 |
- **Warmup Steps:** 10,000
|
| 62 |
+
- **Resolution/Image Size**: First trained at a resolution of 64x64, then increased to 256x256 and then to 512x512. Check the notes down below for more details on this.
|
| 63 |
+
- **Dimension:** 128
|
| 64 |
- **vq_codebook_size:** 256
|
| 65 |
+
- **Total Training Steps:** 2,700,500
|
| 66 |
|
| 67 |
Note: On Muse we can change the image_size or resolution at any time without having to train the model from scratch again, this allows us to first train the model at low resolution using the same `dim` and `vq_codebook_size` to train faster and then we can increase the `image_size` and use a higher resolution once the model has trained enough.
|
| 68 |
|