multishotgrpo / README.md
redflash6's picture
Remove checkpoint step details from model card
3b48b39 verified
|
Raw History Blame Contribute Delete
2.35 kB
metadata
library_name: transformers
license: apache-2.0
pipeline_tag: image-text-to-text
base_model: redflash6/singleshotgrpo
base_model_relation: finetune
tags:
  - reel
  - visual-memory
  - tool-use
  - video-generation

REEL — multishotgrpo

Project page · Code · Paper

REEL is a tool-using visual-memory planner for long-horizon, multi-shot video generation, built on Qwen3.5-9B. It retrieves and creates visual evidence, assesses generated candidates, and updates memory for later shots.

Checkpoint

  • Stage: Multi-shot GRPO.
  • Parent checkpoint: redflash6/singleshotgrpo.
  • Stored precision: bfloat16, in Hugging Face Safetensors format.

This release contains the planner, tokenizer, processor configuration, and chat template. Video generators, optimizer states, and training data are not included. The GRPO releases use BF16 inference exports of their selected training checkpoints.

Use

Use a Transformers version with Qwen3_5ForConditionalGeneration support:

import torch
from transformers import AutoProcessor, Qwen3_5ForConditionalGeneration

model_id = "redflash6/multishotgrpo"
processor = AutoProcessor.from_pretrained(model_id)
model = Qwen3_5ForConditionalGeneration.from_pretrained(
    model_id, dtype=torch.bfloat16, device_map="auto"
)

This loads the planner, not an end-to-end video generator. Use the REEL tool runtime and backend adapters to execute memory actions and connect separately deployed video-generation services.

Released stages

SFT · Single-shot GRPO · Multi-shot GRPO

Citation

@misc{xu2026reel,
  title = {REEL: Learning to Retrieve, Evaluate, and Evolve Visual Memory for Any Long-Horizon Multi-Shot Video Generation},
  author = {Hang Xu and Guohui Zhang and Xiaoxiao Ma and Hu Yu and Jie Huang and Jiayin Xiao and Lin Song and Haoyang Huang and Nan Duan and Feng Zhao},
  year = {2026},
  note = {Preprint},
  url = {https://xuhang07.github.io/REEL/}
}