File size: 1,648 Bytes
b50bcb9
 
 
32943d5
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
3d2afc1
 
 
 
 
 
 
 
 
 
 
 
32943d5
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
---
license: apache-2.0
---


# Video-Coder 9B Model


This repository contains the Video-Coder-9B for [Video-Coder: Reinforcing Agentic Coding for Video Generation]().


[**🌐 Project Page**]() | [**πŸ“– Paper**]() | [**πŸ’» Code**]()


# πŸ‘€ Intro


<div align="center">
  <img src="https://raw.githubusercontent.com/CYWang735/Video-Coder/main/assets/teaser.png" alt="Video-Coder Overview" width="80%">
</div>


We introduce **Video-Coder**, the first attempt to train a **code-driven video generation agent**, which autonomously
writes and executes code to **construct a dynamic 3D scene (Draft Video)** that provides structure and
motion signals to downstream video generators. 

We curate two high-quality datasets, **Video-Coder-SFT-10k** and **Video-Coder-RL-4k**,
which contain diverse prompts and ground-truth reference videos. 

We further develop the **Video-Coder Harness**, a unified interactive environment integrating code execution, 3D scene rendering,
and execution feedback for agent training and inference. 

Video-Coder achieves significant gains,
improving Minimax-H3 by **approximately 7 points on PhyGenBench and 24 points on VBench-2.0**.




## πŸŽ₯ Demo




<div align="center">
  <img src="https://raw.githubusercontent.com/CYWang735/Video-Coder/main/assets/qualitative.png" alt="Inference Process" width="85%">
</div>

## πŸš€ Training and Inference

For detailed instructions on setup, SFT/RL training, and inference, please refer to the [official GitHub repository](https://github.com/CYWang735/Video-Coder).


## Citation


If you find this work helpful for your research, please consider citing:


```bibtex


```