README.md

Sci-Fi: Symmetric Constraint for Frame Inbetweening

Liuhan Chen¹, Xiaodong Cun^2,*, Xiaoyu Li³, Xianyi He^1,4, Shenghai Yuan^1,4, Jie Chen¹, Ying Shan³, Li Yuan^1,*

¹Shenzhen Graduate School, Peking University     ²GVC Lab, Great Bay University     ³ARC Lab, Tencent PCG     ⁴Rabbitpre Intelligence

Start frame	End frame	Generated video

Deployment for frame inbetweening

1. Setup repository and environment

git clone https://github.com/GVCLab/Sci-Fi.git
cd Sci-Fi
conda create -n Sci-Fi python==3.12
conda activate Sci-Fi
pip install -r requirements.txt

2. Download checkpoint

Download the CogVideoX-5B-I2V model (due to fine-tuning, the weights of the transformer denoiser are different from the original) and EF-Net. The weights are available at 🤗HuggingFace and 🤖ModelScope.

3. Launch the inference script!

The example input keyframe pairs are in examples/ folder, and the corresponding generated videos (720x480, 49 frames) are placed in outputs/ folder.
To interpolate, run:

bash Sci_Fi_frame_inbetweening.sh