| # 🎬 Longer Video Generation Models | |
| ## Available Models by Duration | |
| ### 🥇 Longest Videos (10+ seconds) | |
| #### 1. **Runway Gen-3** - Up to 10 seconds ⭐ | |
| - **Model ID:** `runway` | |
| - **Replicate:** `stability-ai/stable-video-diffusion-img2vid-xt` | |
| - **Duration:** Up to 10 seconds | |
| - **Quality:** Professional, cinematic | |
| - **Cost:** ~$0.15-0.25 per video | |
| - **Best for:** Professional content, commercials, high-quality shorts | |
| #### 2. **Kling AI** - Up to 10 seconds | |
| - **Not yet on Replicate** (Chinese model) | |
| - **Duration:** Up to 10 seconds | |
| - **Quality:** Very high, comparable to Hailuo | |
| - **Best for:** Realistic scenes, character animations | |
| --- | |
| ### 🥈 Medium Length (5-7 seconds) | |
| #### 3. **Hailuo Video-01** - 6 seconds | |
| - **Model ID:** `hailuo` | |
| - **Replicate:** `minimax/video-01` | |
| - **Duration:** 6 seconds | |
| - **Quality:** Excellent | |
| - **Cost:** ~$0.05-0.10 per video | |
| - **Best for:** General purpose, high quality | |
| #### 4. **CogVideoX-5B** - 6 seconds | |
| - **Model ID:** `cogvideox` | |
| - **Replicate:** `lucataco/cogvideox-5b` | |
| - **Duration:** 6 seconds (49 frames at 8fps) | |
| - **Quality:** High | |
| - **Cost:** ~$0.05 per video | |
| - **Best for:** Good balance of quality and cost | |
| #### 5. **HunyuanVideo** - 5+ seconds | |
| - **Model ID:** `hunyuan` | |
| - **Replicate:** `tencent/hunyuan-video` | |
| - **Duration:** 5+ seconds | |
| - **Quality:** State-of-the-art | |
| - **Cost:** ~$0.08-0.12 per video | |
| - **Best for:** High-quality, smooth motion | |
| #### 6. **Luma Dream Machine** - 5 seconds | |
| - **Model ID:** `luma` | |
| - **Replicate:** `fofr/dream-machine` | |
| - **Duration:** 5 seconds | |
| - **Quality:** Cinematic | |
| - **Cost:** ~$0.10 per video | |
| - **Best for:** Cinematic shots, smooth camera movements | |
| --- | |
| ### 🥉 Shorter Videos (3-4 seconds) | |
| #### 7. **Pika Labs** - 3 seconds (extendable) | |
| - Can extend videos by generating continuations | |
| - Good for creating longer sequences | |
| #### 8. **AnimateDiff** - 2-4 seconds | |
| - Fast generation | |
| - Lower cost | |
| - Good for quick tests | |
| --- | |
| ## 📊 Comparison Table | |
| | Model | Duration | Quality | Cost/Video | Speed | Best For | | |
| |-------|----------|---------|------------|-------|----------| | |
| | **Runway Gen-3** | 10s | ⭐⭐⭐⭐⭐ | $0.15-0.25 | Slow | Professional | | |
| | **Hailuo** | 6s | ⭐⭐⭐⭐⭐ | $0.05-0.10 | Medium | General | | |
| | **CogVideoX-5B** | 6s | ⭐⭐⭐⭐ | $0.05 | Medium | Balanced | | |
| | **HunyuanVideo** | 5s+ | ⭐⭐⭐⭐⭐ | $0.08-0.12 | Medium | High quality | | |
| | **Luma** | 5s | ⭐⭐⭐⭐ | $0.10 | Medium | Cinematic | | |
| | **Pika** | 3s | ⭐⭐⭐ | $0.03 | Fast | Quick tests | | |
| --- | |
| ## 🎯 How to Use Longer Video Models | |
| ### In Your App | |
| The models are now available in your dropdown: | |
| 1. **Via Web UI:** | |
| - Select "Runway Gen-3 - 10s ⭐" for longest videos | |
| - Select "Hailuo Video-01 - 6s" for good balance | |
| - Enter your prompt and generate! | |
| 2. **Via API:** | |
| ```bash | |
| curl -X POST https://your-app.vercel.app/api/generate-video \ | |
| -H "Content-Type: application/json" \ | |
| -d '{ | |
| "prompt": "A golden retriever running through flowers", | |
| "model": "runway" | |
| }' | |
| ``` | |
| 3. **Via Python Backend:** | |
| ```python | |
| import requests | |
| response = requests.post('http://localhost:5000/generate-video', json={ | |
| 'prompt': 'Ocean waves at sunset', | |
| 'model': 'runway' # For 10s videos | |
| }) | |
| video_url = response.json()['video_url'] | |
| ``` | |
| --- | |
| ## 💡 Tips for Longer Videos | |
| ### 1. **Be More Specific** | |
| Longer videos need more detailed prompts: | |
| ``` | |
| ❌ Bad: "A dog running" | |
| ✅ Good: "A golden retriever running through a field of sunflowers, | |
| camera tracking from the side, golden hour lighting, | |
| slow motion, cinematic" | |
| ``` | |
| ### 2. **Use Camera Movements** | |
| Longer videos benefit from camera direction: | |
| - "Camera slowly zooms in" | |
| - "Tracking shot following the subject" | |
| - "Pan from left to right" | |
| ### 3. **Specify Pacing** | |
| - "Slow motion" | |
| - "Time-lapse" | |
| - "Smooth, continuous motion" | |
| ### 4. **Consider Cost** | |
| - Runway (10s): ~$0.20 per video | |
| - Hailuo (6s): ~$0.08 per video | |
| - Test with shorter/cheaper models first | |
| --- | |
| ## 🚀 Future: Even Longer Videos | |
| ### Coming Soon: | |
| - **Sora (OpenAI)** - Up to 60 seconds (not yet public) | |
| - **Kling 1.5** - Extended duration modes | |
| - **Runway Gen-4** - Longer outputs expected | |
| ### Workarounds for Now: | |
| 1. **Video Extension:** Generate multiple clips and stitch | |
| 2. **Loop Seamlessly:** Create loopable content | |
| 3. **Multi-shot:** Generate scenes separately, edit together | |
| --- | |
| ## 🔧 Technical Details | |
| ### Why Are Videos Short? | |
| 1. **Computational Cost:** Each frame requires significant GPU time | |
| 2. **Memory Requirements:** Longer videos = more VRAM needed | |
| 3. **Quality Trade-off:** Maintaining quality over time is hard | |
| 4. **Training Data:** Most training videos are short clips | |
| ### Frame Rates: | |
| - **CogVideoX:** 49 frames at 8 fps = 6.1 seconds | |
| - **Hailuo:** 48 frames at 8 fps = 6 seconds | |
| - **Runway:** 80 frames at 8 fps = 10 seconds | |
| --- | |
| ## 💰 Cost Optimization | |
| ### For Budget-Conscious Users: | |
| 1. **Start with CogVideoX** ($0.05) or **Hailuo** ($0.08) | |
| 2. **Use Runway** ($0.20) only for final/important videos | |
| 3. **Test prompts** with shorter models first | |
| 4. **Batch generate** to save on setup costs | |
| ### For Quality-First: | |
| 1. **Use Runway** for professional work | |
| 2. **HunyuanVideo** for high-quality content | |
| 3. **Hailuo** for general high-quality needs | |
| --- | |
| ## 📝 Example Prompts for Longer Videos | |
| ### 10-Second Videos (Runway): | |
| ``` | |
| "A surfer riding a massive wave, camera following from behind, | |
| slow motion, golden hour, spray and mist, cinematic 4k" | |
| "City street time-lapse from day to night, cars and people | |
| moving fast, lights turning on, smooth transition" | |
| "A bird taking flight from a branch, slow motion, camera | |
| tracking upward following the bird into the sky" | |
| ``` | |
| ### 6-Second Videos (Hailuo/CogVideoX): | |
| ``` | |
| "A cat jumping onto a windowsill, looking outside at falling | |
| snow, soft lighting, cozy atmosphere" | |
| "Fireworks exploding over a city skyline at night, colorful | |
| bursts, reflection on water below" | |
| "A coffee cup being filled, steam rising, close-up shot, | |
| morning light through window" | |
| ``` | |
| --- | |
| ## ✅ Updated in Your Project | |
| I've updated: | |
| - ✅ `api/generate-video.js` - Added all longer video models | |
| - ✅ `api/models.js` - Listed models with durations | |
| - ✅ `backend_replicate.py` - Added model support | |
| - ✅ UI will now show duration in model names | |
| **Commit and deploy to use the new models!** | |
| --- | |
| **For the longest videos (10s), use `model: "runway"` in your requests! 🎬✨** | |