pawkanarek commited on
Commit
abb74f5
·
1 Parent(s): 32bda17

update readme

Browse files
Files changed (1) hide show
  1. README.md +31 -0
README.md CHANGED
@@ -1,3 +1,34 @@
1
  ---
2
  license: gpl-3.0
 
 
 
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: gpl-3.0
3
+ datasets:
4
+ - pawkanarek/spraix_1024_9frames
5
+ library_name: diffusers
6
+ pipeline_tag: text-to-image
7
+ tags:
8
+ - art
9
  ---
10
+ ### Why
11
+ My intention was to creat model that could generate animated sprites.
12
+
13
+ ### How
14
+ Trained for ~48 hours in total 25 epochs, on Google TPU v3-8 with this my custom script [train_text_to_image_flax_sdxl](https://github.com/PawKanarek/spraix/blob/48d8c209a359622e6db56e6d555667ac466dc952/train_text_to_image_flax_sdxl.py) on my custom dataset [spraix_1024_9frames](https://huggingface.co/datasets/pawkanarek/spraix_1024_9frames).
15
+
16
+ This is my second attempt to create such model. This time i changed dataset to always consist 9 frames, but it doesn't help much.
17
+
18
+ ### Appendix
19
+
20
+ This is demonstration only. This is my first time where i wrote training script of such complicated model in flax framework. Scirpt is probably full of bugs. Dataset that i prepared is also far from perfect. But I'm happy that i can train, save, and load my custom SDXL model.
21
+
22
+ ### How to use
23
+ Intented to use with FLAX
24
+
25
+ Model will generate ugly sprite animations, out of shape, deformed, pixelated and uneven.
26
+ Prompt ideas
27
+ ```
28
+ "Pixel-art animation of a blue water droplet with legs, that: is swiniging axe, facing: East",
29
+ "Pixel-art animation of a Tree, that: is Idle, facing: South",
30
+ "Pixel-art animation of a Dinosaur with a backpack, that: is jumping, facing: North",
31
+ "Pixel-art animation of a Fire demon with axe, that: is running, facing West",
32
+ ```
33
+
34
+ Samples of the output of this model can be seen here: