Update README.md
Browse files
README.md
CHANGED
|
@@ -14,6 +14,38 @@ tags:
|
|
| 14 |
|
| 15 |
# Bernini-R-S2V
|
| 16 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 17 |
<video controls width="100%" height="480">
|
| 18 |
<source src="https://huggingface.co/rzgar/Bernini-R-S2V/resolve/main/Bernini-R-S2V-FP8/video/ComfyUI__00005-audio.mp4" type="video/mp4">
|
| 19 |
Your browser does not support the video tag.
|
|
|
|
| 14 |
|
| 15 |
# Bernini-R-S2V
|
| 16 |
|
| 17 |
+
## ComfyUI Bernini-R-S2V custom node v2 (update)
|
| 18 |
+
|
| 19 |
+
**Bernini S2V Conditioning v2** - Bernini in-context video/image conditioning with masked lip-sync for one or two speakers.
|
| 20 |
+
<video controls width="100%" height="480">
|
| 21 |
+
<source src="https://huggingface.co/rzgar/Bernini-R-S2V/resolve/main/video/ComfyUI__00003-audio.mp4" type="video/mp4">
|
| 22 |
+
Your browser does not support the video tag.
|
| 23 |
+
</video>
|
| 24 |
+
|
| 25 |
+
Unzip [ComfyUI-WanBerniniS2V_v2.zip](https://huggingface.co/rzgar/Bernini-R-S2V/resolve/main/ComfyUI-WanBerniniS2V_v2/ComfyUI-WanBerniniS2V_v2.zip) into `ComfyUI/custom_nodes/`, then restart ComfyUI.
|
| 26 |
+
|
| 27 |
+
```
|
| 28 |
+
or save the Python files in: ComfyUI/custom_nodes/ComfyUI-WanBerniniS2V_v2/
|
| 29 |
+
```
|
| 30 |
+
|
| 31 |
+
Disable or remove the older `ComfyUI-WanBerniniS2V` folder if you only want v2.
|
| 32 |
+
|
| 33 |
+
### One speaker
|
| 34 |
+
|
| 35 |
+
- `audio_1` + `mask_1`
|
| 36 |
+
- Leave `audio_2` / `mask_2` unwired
|
| 37 |
+
|
| 38 |
+
### Two speakers (dialog)
|
| 39 |
+
|
| 40 |
+
- `audio_1` + `mask_1` - first speaker
|
| 41 |
+
- `audio_2` + `mask_2` - second speaker
|
| 42 |
+
- `speaker_2_start_frame = -1` - second audio starts when the first clip ends
|
| 43 |
+
|
| 44 |
+
### Masks
|
| 45 |
+
|
| 46 |
+
Paint on the **output frame** where each speaker's face appears. Masks control lip-sync placement only, they are not tied to `reference_image_N` slots.
|
| 47 |
+
|
| 48 |
+
________
|
| 49 |
<video controls width="100%" height="480">
|
| 50 |
<source src="https://huggingface.co/rzgar/Bernini-R-S2V/resolve/main/Bernini-R-S2V-FP8/video/ComfyUI__00005-audio.mp4" type="video/mp4">
|
| 51 |
Your browser does not support the video tag.
|