Spaces:
Running
on
Zero
Running
on
Zero
Update README.md
Browse files
README.md
CHANGED
|
@@ -4,11 +4,91 @@ emoji: ๐จ
|
|
| 4 |
colorFrom: purple
|
| 5 |
colorTo: yellow
|
| 6 |
sdk: gradio
|
| 7 |
-
sdk_version: 5.
|
| 8 |
app_file: app.py
|
| 9 |
pinned: false
|
| 10 |
license: apache-2.0
|
| 11 |
short_description: A Unified Framework for Custom Image and Video generation
|
| 12 |
---
|
| 13 |
|
| 14 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 4 |
colorFrom: purple
|
| 5 |
colorTo: yellow
|
| 6 |
sdk: gradio
|
| 7 |
+
sdk_version: 5.35.0
|
| 8 |
app_file: app.py
|
| 9 |
pinned: false
|
| 10 |
license: apache-2.0
|
| 11 |
short_description: A Unified Framework for Custom Image and Video generation
|
| 12 |
---
|
| 13 |
|
| 14 |
+
## English Description
|
| 15 |
+
|
| 16 |
+
**DreamO Video - AI-Powered Image and Video Generation**
|
| 17 |
+
|
| 18 |
+
DreamO Video is an advanced AI application that combines cutting-edge image generation with video synthesis capabilities. Built on the FLUX.1-dev model and enhanced with the DreamO pipeline, this tool allows users to create highly customized images and transform them into dynamic 2-second videos.
|
| 19 |
+
|
| 20 |
+
### Key Features:
|
| 21 |
+
|
| 22 |
+
1. **Dual Reference Image System**: Upload up to two reference images to guide the generation process, with flexible task options:
|
| 23 |
+
- **IP (Image Prompt)**: Use images as visual prompts to influence the overall composition
|
| 24 |
+
- **ID (Identity)**: Preserve facial features and identity from reference images
|
| 25 |
+
- **Style**: Transfer artistic style from reference images to generated content
|
| 26 |
+
|
| 27 |
+
2. **Advanced Image Generation**:
|
| 28 |
+
- Customizable resolution (768-1024 pixels)
|
| 29 |
+
- Fine-tuned guidance controls for precise output
|
| 30 |
+
- Seed-based generation for reproducible results
|
| 31 |
+
- Background removal and face alignment preprocessing
|
| 32 |
+
|
| 33 |
+
3. **Video Synthesis**: Transform any generated image into a 2-second animated video with natural motion and smooth transitions (Note: Full version supports up to 60-second videos)
|
| 34 |
+
|
| 35 |
+
4. **Professional Features**:
|
| 36 |
+
- Automatic watermarking for video outputs
|
| 37 |
+
- Advanced CFG (Classifier-Free Guidance) controls
|
| 38 |
+
- Negative prompting for refined results
|
| 39 |
+
- Gallery of preprocessing results for transparency
|
| 40 |
+
|
| 41 |
+
### Technical Specifications:
|
| 42 |
+
- Powered by FLUX.1-dev and DreamO pipeline
|
| 43 |
+
- GPU-accelerated processing using CUDA
|
| 44 |
+
- Integrated face restoration and background removal tools
|
| 45 |
+
- FFmpeg-based video post-processing
|
| 46 |
+
|
| 47 |
+
### Use Cases:
|
| 48 |
+
- Creative content generation for social media
|
| 49 |
+
- Character design and animation
|
| 50 |
+
- Product visualization and marketing materials
|
| 51 |
+
- Artistic style transfer and experimentation
|
| 52 |
+
- Personal avatar and portrait creation
|
| 53 |
+
|
| 54 |
+
---
|
| 55 |
+
|
| 56 |
+
## ํ๊ธ ์ค๋ช
|
| 57 |
+
|
| 58 |
+
**DreamO Video - AI ๊ธฐ๋ฐ ์ด๋ฏธ์ง ๋ฐ ๋น๋์ค ์์ฑ ๋๊ตฌ**
|
| 59 |
+
|
| 60 |
+
DreamO Video๋ ์ต์ฒจ๋จ ์ด๋ฏธ์ง ์์ฑ๊ณผ ๋น๋์ค ํฉ์ฑ ๊ธฐ๋ฅ์ ๊ฒฐํฉํ ๊ณ ๊ธ AI ์ ํ๋ฆฌ์ผ์ด์
์
๋๋ค. FLUX.1-dev ๋ชจ๋ธ์ ๊ธฐ๋ฐ์ผ๋ก ํ๊ณ DreamO ํ์ดํ๋ผ์ธ์ผ๋ก ๊ฐํ๋ ์ด ๋๊ตฌ๋ฅผ ํตํด ์ฌ์ฉ์๋ ๊ณ ๋๋ก ๋ง์ถคํ๋ ์ด๋ฏธ์ง๋ฅผ ์์ฑํ๊ณ ์ด๋ฅผ ์ญ๋์ ์ธ 2์ด ๋์์์ผ๋ก ๋ณํํ ์ ์์ต๋๋ค.
|
| 61 |
+
|
| 62 |
+
### ์ฃผ์ ๊ธฐ๋ฅ:
|
| 63 |
+
|
| 64 |
+
1. **์ด์ค ์ฐธ์กฐ ์ด๋ฏธ์ง ์์คํ
**: ์ต๋ 2๊ฐ์ ์ฐธ์กฐ ์ด๋ฏธ์ง๋ฅผ ์
๋ก๋ํ์ฌ ์์ฑ ๊ณผ์ ์ ์๋ดํ๋ฉฐ, ์ ์ฐํ ์์
์ต์
์ ๊ณต:
|
| 65 |
+
- **IP (์ด๋ฏธ์ง ํ๋กฌํํธ)**: ์ด๋ฏธ์ง๋ฅผ ์๊ฐ์ ํ๋กฌํํธ๋ก ์ฌ์ฉํ์ฌ ์ ์ฒด ๊ตฌ์ฑ์ ์ํฅ
|
| 66 |
+
- **ID (์ ์)**: ์ฐธ์กฐ ์ด๋ฏธ์ง์ ์ผ๊ตด ํน์ง๊ณผ ์ ์ ๋ณด์กด
|
| 67 |
+
- **Style (์คํ์ผ)**: ์ฐธ์กฐ ์ด๋ฏธ์ง์ ์์ ์ ์คํ์ผ์ ์์ฑ ์ฝํ
์ธ ๋ก ์ ์ก
|
| 68 |
+
|
| 69 |
+
2. **๊ณ ๊ธ ์ด๋ฏธ์ง ์์ฑ**:
|
| 70 |
+
- ์ฌ์ฉ์ ์ ์ ๊ฐ๋ฅํ ํด์๋ (768-1024 ํฝ์
)
|
| 71 |
+
- ์ ๋ฐํ ์ถ๋ ฅ์ ์ํ ๋ฏธ์ธ ์กฐ์ ๋ ๊ฐ์ด๋์ค ์ปจํธ๋กค
|
| 72 |
+
- ์ฌํ ๊ฐ๋ฅํ ๊ฒฐ๊ณผ๋ฅผ ์ํ ์๋ ๊ธฐ๋ฐ ์์ฑ
|
| 73 |
+
- ๋ฐฐ๊ฒฝ ์ ๊ฑฐ ๋ฐ ์ผ๊ตด ์ ๋ ฌ ์ ์ฒ๋ฆฌ
|
| 74 |
+
|
| 75 |
+
3. **๋น๋์ค ํฉ์ฑ**: ์์ฑ๋ ๋ชจ๋ ์ด๋ฏธ์ง๋ฅผ ์์ฐ์ค๋ฌ์ด ์์ง์๊ณผ ๋ถ๋๋ฌ์ด ์ ํ์ด ์๋ 2์ด ์ ๋๋ฉ์ด์
๋น๋์ค๋ก ๋ณํ (์ฐธ๊ณ : ์ ์ ๋ฒ์ ์ ์ต๋ 60์ด ๋น๋์ค ์ง์)
|
| 76 |
+
|
| 77 |
+
4. **์ ๋ฌธ ๊ธฐ๋ฅ**:
|
| 78 |
+
- ๋น๋์ค ์ถ๋ ฅ๋ฌผ์ ๋ํ ์๋ ์ํฐ๋งํน
|
| 79 |
+
- ๊ณ ๊ธ CFG (Classifier-Free Guidance) ์ปจํธ๋กค
|
| 80 |
+
- ์ ์ ๋ ๊ฒฐ๊ณผ๋ฅผ ์ํ ๋ค๊ฑฐํฐ๋ธ ํ๋กฌํํ
|
| 81 |
+
- ํฌ๋ช
์ฑ์ ์ํ ์ ์ฒ๋ฆฌ ๊ฒฐ๊ณผ ๊ฐค๋ฌ๋ฆฌ
|
| 82 |
+
|
| 83 |
+
### ๊ธฐ์ ์ฌ์:
|
| 84 |
+
- FLUX.1-dev ๋ฐ DreamO ํ์ดํ๋ผ์ธ ๊ตฌ๋
|
| 85 |
+
- CUDA๋ฅผ ์ฌ์ฉํ GPU ๊ฐ์ ์ฒ๋ฆฌ
|
| 86 |
+
- ํตํฉ๋ ์ผ๊ตด ๋ณต์ ๋ฐ ๋ฐฐ๊ฒฝ ์ ๊ฑฐ ๋๊ตฌ
|
| 87 |
+
- FFmpeg ๊ธฐ๋ฐ ๋น๋์ค ํ์ฒ๋ฆฌ
|
| 88 |
+
|
| 89 |
+
### ์ฌ์ฉ ์ฌ๋ก:
|
| 90 |
+
- ์์
๋ฏธ๋์ด๋ฅผ ์ํ ์ฐฝ์์ ์ธ ์ฝํ
์ธ ์์ฑ
|
| 91 |
+
- ์บ๋ฆญํฐ ๋์์ธ ๋ฐ ์ ๋๋ฉ์ด์
|
| 92 |
+
- ์ ํ ์๊ฐํ ๋ฐ ๋ง์ผํ
์๋ฃ
|
| 93 |
+
- ์์ ์ ์คํ์ผ ์ ์ก ๋ฐ ์คํ
|
| 94 |
+
- ๊ฐ์ธ ์๋ฐํ ๋ฐ ์ด์ํ ์ ์
|