Video-Text-to-Text
Transformers
Safetensors
English
Chinese
mllama
text-generation
multimodal
video
vision-language
custom_code
text-generation-inference
Instructions to use OpenMOSS-Team/moss-video-preview-base with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use OpenMOSS-Team/moss-video-preview-base with Transformers:
# Load model directly from transformers import AutoProcessor, AutoModelForCausalLM processor = AutoProcessor.from_pretrained("OpenMOSS-Team/moss-video-preview-base", trust_remote_code=True) model = AutoModelForCausalLM.from_pretrained("OpenMOSS-Team/moss-video-preview-base", trust_remote_code=True, device_map="auto") - Notebooks
- Google Colab
- Kaggle
Update README links and citation
Browse files
README.md
CHANGED
|
@@ -15,6 +15,11 @@ tags:
|
|
| 15 |
|
| 16 |
# MOSS-Video-Preview-Base
|
| 17 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 18 |
## Introduction
|
| 19 |
|
| 20 |
We introduce **MOSS-Video-Preview-Base**, the pretrained foundation checkpoint in the MOSS-Video-Preview series.
|
|
@@ -45,7 +50,7 @@ This repo contains the **pretrained weights** that are intended to serve as the
|
|
| 45 |
- **Cross-Modal Projector**: Powered by the proprietary `VideoMllamaTextCrossAttention` mechanism, it achieves high-efficiency semantic alignment between temporal visual features and linguistic context.
|
| 46 |
- **Unified Spatio-Temporal Encoding**: Aligns video frame sequences with text tokens, providing a robust backbone for long-context multimodal reasoning.
|
| 47 |
|
| 48 |
-
For architecture diagrams and full system details, see the top-level repository: [
|
| 49 |
|
| 50 |
## 🚀 Quickstart
|
| 51 |
|
|
@@ -55,7 +60,7 @@ For architecture diagrams and full system details, see the top-level repository:
|
|
| 55 |
```python
|
| 56 |
import torch
|
| 57 |
from transformers import AutoModelForCausalLM, AutoProcessor
|
| 58 |
-
checkpoint = "
|
| 59 |
video_path = "data/example_video.mp4"
|
| 60 |
prompt = "" # For base model, prompt is set to empty to perform completion task.
|
| 61 |
|
|
@@ -111,7 +116,7 @@ print(processor.decode(output_ids[0], skip_special_tokens=True))
|
|
| 111 |
import torch
|
| 112 |
from PIL import Image
|
| 113 |
from transformers import AutoModelForCausalLM, AutoProcessor
|
| 114 |
-
checkpoint = "
|
| 115 |
image_path = "data/example_image.jpg"
|
| 116 |
prompt = "" # For base model, prompt is set to empty to perform completion task.
|
| 117 |
|
|
@@ -200,11 +205,14 @@ For full environment setup (including optional FlashAttention2 extras), see the
|
|
| 200 |
|
| 201 |
## Citation
|
| 202 |
```bibtex
|
| 203 |
-
@
|
| 204 |
-
title = {{MOSS-Video-Preview:
|
| 205 |
-
author = {
|
| 206 |
year = {2026},
|
| 207 |
-
|
| 208 |
-
|
|
|
|
|
|
|
|
|
|
| 209 |
}
|
| 210 |
```
|
|
|
|
| 15 |
|
| 16 |
# MOSS-Video-Preview-Base
|
| 17 |
|
| 18 |
+
<p align="center">
|
| 19 |
+
📄 <a href="https://arxiv.org/abs/2606.07639">Tech Report</a> |
|
| 20 |
+
💻 <a href="https://github.com/OpenMOSS/MOSS-Video-Preview">GitHub</a>
|
| 21 |
+
</p>
|
| 22 |
+
|
| 23 |
## Introduction
|
| 24 |
|
| 25 |
We introduce **MOSS-Video-Preview-Base**, the pretrained foundation checkpoint in the MOSS-Video-Preview series.
|
|
|
|
| 50 |
- **Cross-Modal Projector**: Powered by the proprietary `VideoMllamaTextCrossAttention` mechanism, it achieves high-efficiency semantic alignment between temporal visual features and linguistic context.
|
| 51 |
- **Unified Spatio-Temporal Encoding**: Aligns video frame sequences with text tokens, providing a robust backbone for long-context multimodal reasoning.
|
| 52 |
|
| 53 |
+
For architecture diagrams and full system details, see the top-level repository: [OpenMOSS/MOSS-Video-Preview](https://github.com/OpenMOSS/MOSS-Video-Preview).
|
| 54 |
|
| 55 |
## 🚀 Quickstart
|
| 56 |
|
|
|
|
| 60 |
```python
|
| 61 |
import torch
|
| 62 |
from transformers import AutoModelForCausalLM, AutoProcessor
|
| 63 |
+
checkpoint = "OpenMOSS-Team/moss-video-preview-base"
|
| 64 |
video_path = "data/example_video.mp4"
|
| 65 |
prompt = "" # For base model, prompt is set to empty to perform completion task.
|
| 66 |
|
|
|
|
| 116 |
import torch
|
| 117 |
from PIL import Image
|
| 118 |
from transformers import AutoModelForCausalLM, AutoProcessor
|
| 119 |
+
checkpoint = "OpenMOSS-Team/moss-video-preview-base"
|
| 120 |
image_path = "data/example_image.jpg"
|
| 121 |
prompt = "" # For base model, prompt is set to empty to perform completion task.
|
| 122 |
|
|
|
|
| 205 |
|
| 206 |
## Citation
|
| 207 |
```bibtex
|
| 208 |
+
@article{wang2026mossvideo,
|
| 209 |
+
title = {{MOSS-Video-Preview: Toward Real-Time Video Understanding via Cross-Attention}},
|
| 210 |
+
author = {Pengyu Wang, Chenkun Tan, Shaojun Zhou, Wei Huang, Qirui Zhou, Zhan Huang, Zhen Ye, Jijun Cheng, Xiaomeng Qian, Yanxin Chen, Xingyang He, Huazheng Zeng, Chenghao Wang, Pengfei Wang, Hongkai Wang, Shanqing Gao, Yixian Tian, Chenghao Liu, Xinghao Wang, Botian Jiang, Xipeng Qiu},
|
| 211 |
year = {2026},
|
| 212 |
+
journal = {arXiv preprint arXiv:2606.07639},
|
| 213 |
+
eprint = {2606.07639},
|
| 214 |
+
archivePrefix = {arXiv},
|
| 215 |
+
primaryClass = {cs.CV},
|
| 216 |
+
url = {https://arxiv.org/abs/2606.07639}
|
| 217 |
}
|
| 218 |
```
|