Update README.md
Browse files
README.md
CHANGED
|
@@ -1,3 +1,77 @@
|
|
| 1 |
---
|
| 2 |
license: apache-2.0
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 3 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
license: apache-2.0
|
| 3 |
+
language:
|
| 4 |
+
- en
|
| 5 |
+
base_model:
|
| 6 |
+
- tencent/HunyuanVideo
|
| 7 |
+
- Qwen/Qwen2.5-VL-7B-Instruct
|
| 8 |
+
pipeline_tag: any-to-any
|
| 9 |
+
tags:
|
| 10 |
+
- video
|
| 11 |
---
|
| 12 |
+
<div align="center">
|
| 13 |
+
|
| 14 |
+
<h1><b>UniVideo: Unified Understanding, Generation, and Editing for Videos</b></h1>
|
| 15 |
+
|
| 16 |
+
</div>
|
| 17 |
+
|
| 18 |
+
<div align="center">
|
| 19 |
+
|
| 20 |
+
**[Cong Wei<sup>*,1,2</sup>](https://congwei1230.github.io/)  **
|
| 21 |
+
**[Quande Liu<sup>†,2</sup>](https://liuquande.github.io/)  **
|
| 22 |
+
**[Zixuan Ye<sup>2</sup>](https://openreview.net/profile?id=~Zixuan_Ye1)  **
|
| 23 |
+
**[Qiulin Wang<sup>2</sup>](https://scholar.google.com/citations?user=3vvZdy8AAAAJ&hl=en)  **
|
| 24 |
+
**[Xintao Wang<sup>2</sup>](https://xinntao.github.io/)**
|
| 25 |
+
|
| 26 |
+
**[Pengfei Wan<sup>2</sup>](https://magicwpf.github.io/)  **
|
| 27 |
+
**[Kun Gai<sup>2</sup>](https://openreview.net/profile?id=~Kun_Gai1)  **
|
| 28 |
+
**[Wenhu Chen<sup>†,1</sup>](https://wenhuchen.github.io/)**
|
| 29 |
+
<p>
|
| 30 |
+
<sup>1</sup>University of Waterloo
|
| 31 |
+
<sup>2</sup>Kling Team, Kuaishou Technology<br>
|
| 32 |
+
<sup>*</sup>Work done during an internship at Kling Team, Kuaishou Technology
|
| 33 |
+
<sup>†</sup>Corresponding author
|
| 34 |
+
</p>
|
| 35 |
+
</div>
|
| 36 |
+
|
| 37 |
+
<p align="center">
|
| 38 |
+
<a href='https://congwei1230.github.io/UniVideo/'><img src='https://img.shields.io/badge/Project-Page-Green'></a>
|
| 39 |
+
|
| 40 |
+
<a href="https://arxiv.org/abs/2510.08377"><img src="https://img.shields.io/static/v1?label=Arxiv&message=UniVideo&color=red&logo=arxiv"></a>
|
| 41 |
+
|
| 42 |
+
<a href='https://huggingface.co/KlingTeam/UniVideo'><img src='https://img.shields.io/badge/%F0%9F%A4%97%20Hugging%20Face-Model-orange'></a>
|
| 43 |
+
|
| 44 |
+
<a href="https://github.com/KlingTeam/UniVideo">
|
| 45 |
+
<img src="https://img.shields.io/badge/GitHub-Code-red?logo=github">
|
| 46 |
+
</a>
|
| 47 |
+
</p>
|
| 48 |
+
|
| 49 |
+
|
| 50 |
+
## 🔔News
|
| 51 |
+
|
| 52 |
+
- [2026-01-07]: Released [Code](https://github.com/KlingTeam/UniVideo) and [Model](https://huggingface.co/KlingTeam/UniVideo).
|
| 53 |
+
- [2025-10-09]: Released [Arxiv Preprint](https://arxiv.org/abs/2510.08377) and the [Project Page](https://congwei1230.github.io/UniVideo/)
|
| 54 |
+
|
| 55 |
+
## How to use
|
| 56 |
+
|
| 57 |
+
- Please refer to [**🔗 GitHub**](https://github.com/KlingTeam/UniVideo) for usage.
|
| 58 |
+
|
| 59 |
+
|
| 60 |
+
## Acknowledgement
|
| 61 |
+
|
| 62 |
+
- [HunyuanVideo](https://github.com/Tencent-Hunyuan/HunyuanVideo): the base video generation model used in this work. Thanks to the authors for their excellent contribution.
|
| 63 |
+
- [Qwen2.5-VL](https://github.com/QwenLM): the base vlm model used in this work. Thanks to the authors for their excellent contribution.
|
| 64 |
+
- [MetaQueries](https://xichenpan.com/metaquery/): we adopt their query implementation. Thanks to the authors for their excellent contribution.
|
| 65 |
+
|
| 66 |
+
## 🌟 Citation
|
| 67 |
+
|
| 68 |
+
If you find UniVideo useful for your research and applications, please cite using this BibTeX:
|
| 69 |
+
|
| 70 |
+
```bibtex
|
| 71 |
+
@article{wei2025univideo,
|
| 72 |
+
title={Univideo: Unified understanding, generation, and editing for videos},
|
| 73 |
+
author={Wei, Cong and Liu, Quande and Ye, Zixuan and Wang, Qiulin and Wang, Xintao and Wan, Pengfei and Gai, Kun and Chen, Wenhu},
|
| 74 |
+
journal={arXiv preprint arXiv:2510.08377},
|
| 75 |
+
year={2025}
|
| 76 |
+
}
|
| 77 |
+
```
|