sft / README.md
redflash6's picture
Remove checkpoint step details from model card
0106c0a verified
|
Raw History Blame Contribute Delete
2.31 kB
---
library_name: transformers
license: apache-2.0
pipeline_tag: image-text-to-text
base_model: Qwen/Qwen3.5-9B
base_model_relation: finetune
tags:
- reel
- visual-memory
- tool-use
- video-generation
---
# REEL — sft
[Project page](https://xuhang07.github.io/REEL/) · [Code](https://github.com/xuhang07/REEL) · [Paper](https://xuhang07.github.io/REEL/assets/reel.pdf)
REEL is a tool-using visual-memory planner for long-horizon, multi-shot video generation, built on Qwen3.5-9B. It retrieves and creates visual evidence, assesses generated candidates, and updates memory for later shots.
## Checkpoint
- **Stage:** Supervised fine-tuning.
- **Parent checkpoint:** [Qwen/Qwen3.5-9B](https://huggingface.co/Qwen/Qwen3.5-9B).
- **Stored precision:** float32, in Hugging Face Safetensors format.
This release contains the planner, tokenizer, processor configuration, and chat template. Video generators, optimizer states, and training data are not included. The GRPO releases use BF16 inference exports of their selected training checkpoints.
## Use
Use a Transformers version with `Qwen3_5ForConditionalGeneration` support:
```python
import torch
from transformers import AutoProcessor, Qwen3_5ForConditionalGeneration
model_id = "redflash6/sft"
processor = AutoProcessor.from_pretrained(model_id)
model = Qwen3_5ForConditionalGeneration.from_pretrained(
model_id, dtype=torch.bfloat16, device_map="auto"
)
```
This loads the planner, not an end-to-end video generator. Use the [REEL tool runtime and backend adapters](https://github.com/xuhang07/REEL#planner-and-backend-integration) to execute memory actions and connect separately deployed video-generation services.
## Released stages
[SFT](https://huggingface.co/redflash6/sft) · [Single-shot GRPO](https://huggingface.co/redflash6/singleshotgrpo) · [Multi-shot GRPO](https://huggingface.co/redflash6/multishotgrpo)
## Citation
```bibtex
@misc{xu2026reel,
title = {REEL: Learning to Retrieve, Evaluate, and Evolve Visual Memory for Any Long-Horizon Multi-Shot Video Generation},
author = {Hang Xu and Guohui Zhang and Xiaoxiao Ma and Hu Yu and Jie Huang and Jiayin Xiao and Lin Song and Haoyang Huang and Nan Duan and Feng Zhao},
year = {2026},
note = {Preprint},
url = {https://xuhang07.github.io/REEL/}
}
```