AEmotionStudio commited on
Commit
e192528
·
verified ·
1 Parent(s): 1cd85de

Add README and MIT LICENSE

Browse files
Files changed (2) hide show
  1. LICENSE +21 -0
  2. README.md +49 -3
LICENSE ADDED
@@ -0,0 +1,21 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ MIT License
2
+
3
+ Copyright (c) 2024 Yanrui Bin, Wenbo Hu, Haoyuan Wang, Xinya Chen, Bing Wang
4
+
5
+ Permission is hereby granted, free of charge, to any person obtaining a copy
6
+ of this software and associated documentation files (the "Software"), to deal
7
+ in the Software without restriction, including without limitation the rights
8
+ to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
9
+ copies of the Software, and to permit persons to whom the Software is
10
+ furnished to do so, subject to the following conditions:
11
+
12
+ The above copyright notice and this permission notice shall be included in all
13
+ copies or substantial portions of the Software.
14
+
15
+ THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
16
+ IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
17
+ FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
18
+ AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
19
+ LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
20
+ OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
21
+ SOFTWARE.
README.md CHANGED
@@ -1,3 +1,49 @@
1
- ---
2
- license: apache-2.0
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # NormalCrafter — Video Normal Map Estimation
2
+
3
+ Mirror of [Yanrui95/NormalCrafter](https://huggingface.co/Yanrui95/NormalCrafter) hosted by [AEmotionStudio](https://huggingface.co/AEmotionStudio) for use with [ComfyUI-FFMPEGA](https://github.com/AEmotionStudio/ComfyUI-FFMPEGA).
4
+
5
+ ## Model Description
6
+
7
+ NormalCrafter generates **temporally consistent surface normal maps** from video using a Stable Video Diffusion (SVD) backbone fine-tuned for normal estimation. Unlike image-based methods (e.g., Marigold), NormalCrafter operates natively on video sequences, producing smooth frame-to-frame normals without flickering.
8
+
9
+ ## Key Features
10
+
11
+ - **Video-native**: Processes temporal sequences for coherent normals across frames
12
+ - **SVD backbone**: Built on `stabilityai/stable-video-diffusion-img2vid-xt`
13
+ - **High resolution**: Supports up to 1024px inference
14
+ - **MIT Licensed**: Free for commercial and personal use
15
+
16
+ ## Model Files
17
+
18
+ | File | Size | Description |
19
+ |------|------|-------------|
20
+ | `unet/diffusion_pytorch_model.safetensors` | 3.05 GB | Fine-tuned UNet for normal estimation |
21
+ | `image_encoder/model.fp16.safetensors` | 1.26 GB | CLIP image encoder (fp16) |
22
+ | `vae/diffusion_pytorch_model.safetensors` | 196 MB | VAE decoder |
23
+
24
+ ## Usage in ComfyUI-FFMPEGA
25
+
26
+ NormalCrafter is available as:
27
+ - **Standalone skill**: `normalcrafter` in the FFMPEGA agent
28
+ - **No-LLM mode**: Select `normalcrafter` in the agent node dropdown
29
+ - **AI Relighting**: Enable "Use NormalCrafter" in the Video Editor's Relight panel for physically-based relighting
30
+
31
+ ## Citation
32
+
33
+ ```bibtex
34
+ @article{normalcrafter2024,
35
+ title={NormalCrafter: Learning Temporally Consistent Normals from Video Diffusion Priors},
36
+ author={Yanrui Bin and Wenbo Hu and Haoyuan Wang and Xinya Chen and Bing Wang},
37
+ year={2024}
38
+ }
39
+ ```
40
+
41
+ ## License
42
+
43
+ MIT — see [LICENSE](LICENSE) for details.
44
+
45
+ ## Links
46
+
47
+ - **Paper**: [NormalCrafter](https://github.com/Binyr/NormalCrafter)
48
+ - **Upstream weights**: [Yanrui95/NormalCrafter](https://huggingface.co/Yanrui95/NormalCrafter)
49
+ - **ComfyUI-FFMPEGA**: [AEmotionStudio/ComfyUI-FFMPEGA](https://github.com/AEmotionStudio/ComfyUI-FFMPEGA)