Ciara
commited on
Commit
·
721d172
1
Parent(s):
8c65296
Readme
Browse files
README.md
CHANGED
|
@@ -1,3 +1,21 @@
|
|
| 1 |
---
|
| 2 |
license: openrail
|
| 3 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
license: openrail
|
| 3 |
---
|
| 4 |
+
Beta version of TemporalNet, to improve temporal consistency for results like this: https://twitter.com/CiaraRowles1/status/1637486561917906944
|
| 5 |
+
|
| 6 |
+
Note: this will not remove all flickering, just reduce it, especially at higher denoise levels.
|
| 7 |
+
|
| 8 |
+
The best results will probably be achieved with this and several other methods in conjunction.
|
| 9 |
+
|
| 10 |
+
Instructions for Use:
|
| 11 |
+
|
| 12 |
+
1) Make a Folder with a folder called "New Folder" containing the input frames, a png called init.png that is already stylized in the style you want and the temporalvideo.py script.)
|
| 13 |
+
2) modify the temporalvideo.py script with any changes you want, i.e the resolution for the image, the prompt and the controlnet settings.
|
| 14 |
+
3) Run Automatic1111s Web UI with the --api setting enabled.
|
| 15 |
+
4) Run the python script.
|
| 16 |
+
|
| 17 |
+
Note: The init image will not significantly affect the style of the output video, it's just to ensure there isn't a big jump in aesthetic over the first few frames.
|
| 18 |
+
|
| 19 |
+
ToDo:
|
| 20 |
+
1) Write an extension to work with this so you can just use it out of the web ui.
|
| 21 |
+
2) Add functionality so the init image will auto-generate if none is provided.
|