Commit ·
abb74f5
1
Parent(s): 32bda17
update readme
Browse files
README.md
CHANGED
|
@@ -1,3 +1,34 @@
|
|
| 1 |
---
|
| 2 |
license: gpl-3.0
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 3 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
license: gpl-3.0
|
| 3 |
+
datasets:
|
| 4 |
+
- pawkanarek/spraix_1024_9frames
|
| 5 |
+
library_name: diffusers
|
| 6 |
+
pipeline_tag: text-to-image
|
| 7 |
+
tags:
|
| 8 |
+
- art
|
| 9 |
---
|
| 10 |
+
### Why
|
| 11 |
+
My intention was to creat model that could generate animated sprites.
|
| 12 |
+
|
| 13 |
+
### How
|
| 14 |
+
Trained for ~48 hours in total 25 epochs, on Google TPU v3-8 with this my custom script [train_text_to_image_flax_sdxl](https://github.com/PawKanarek/spraix/blob/48d8c209a359622e6db56e6d555667ac466dc952/train_text_to_image_flax_sdxl.py) on my custom dataset [spraix_1024_9frames](https://huggingface.co/datasets/pawkanarek/spraix_1024_9frames).
|
| 15 |
+
|
| 16 |
+
This is my second attempt to create such model. This time i changed dataset to always consist 9 frames, but it doesn't help much.
|
| 17 |
+
|
| 18 |
+
### Appendix
|
| 19 |
+
|
| 20 |
+
This is demonstration only. This is my first time where i wrote training script of such complicated model in flax framework. Scirpt is probably full of bugs. Dataset that i prepared is also far from perfect. But I'm happy that i can train, save, and load my custom SDXL model.
|
| 21 |
+
|
| 22 |
+
### How to use
|
| 23 |
+
Intented to use with FLAX
|
| 24 |
+
|
| 25 |
+
Model will generate ugly sprite animations, out of shape, deformed, pixelated and uneven.
|
| 26 |
+
Prompt ideas
|
| 27 |
+
```
|
| 28 |
+
"Pixel-art animation of a blue water droplet with legs, that: is swiniging axe, facing: East",
|
| 29 |
+
"Pixel-art animation of a Tree, that: is Idle, facing: South",
|
| 30 |
+
"Pixel-art animation of a Dinosaur with a backpack, that: is jumping, facing: North",
|
| 31 |
+
"Pixel-art animation of a Fire demon with axe, that: is running, facing West",
|
| 32 |
+
```
|
| 33 |
+
|
| 34 |
+
Samples of the output of this model can be seen here:
|