Vimoo-1.0

Vimoo-1.0 generates video from text (T2V) or from a reference image and text (I2V), with a separate ≈11.7B model for each task. It is the highest-quality model in the Vimoo 1.0 family.

• Diffusers Pipeline: Quick Start · Vimoo-1.0
• ComfyUI Workflows: ComfyUI-Vimoo · ComfyUI Weights · Lite ComfyUI Weights
• MLX (Apple Silicon): Vimoo-1.0-MLX · MLX Weights

🔥 News

• [2026-10] Release Vimoo 1.0: T2V / I2V models, Diffusers inference examples and ComfyUI workflows.

🎬 Showcase

🌐 Online API

Use Vimoo 1.0 directly via API. https://vimoo.ai

The model API includes three use cases: Vimoo 1.0, Vimoo 1.0 - Ecom, and Vimoo 1.0 - Lite.

Repository	Task	Use case
Vimoo-1.0	Text-to-Video	Turn text prompts into videos. Describe scenes, stories, camera moves, and mood; the API returns cinematic, story-driven video. Supports 5-second clips at 720P.
	Image-to-Video	Animate images with reference images and text prompts. Describe emotions, storylines, and camera moves; the API returns video that keeps the reference image's look and subject consistency.
Vimoo-1.0-Ecom	E-Commerce Video	Create e-commerce videos from product reference images. Combine 1–9 images with optional titles, descriptions, and selling points to make 20-second, 9:16, 720P videos for product showcases and promotions.
Vimoo-1.0-Lite	Text/Image-to-Video	Generates videos from text prompts, with an optional first-frame image. It prioritizes speed and lower resource usage, outputting 5-second 720p video.

🗺️ System Overview

The complete Vimoo system consists of the following three modules:

• Vimoo-PE: We developed a dedicated system that deeply interprets and refines incoming multimodal instructions, then transforms them into a format that Vimoo can easily process for generation. Vimoo-PE plays a crucial role in determining the quality of the final output; we highly recommend integrating it into your generation pipeline—or following the 'Prompt Guide' to build your own prompt system.
• Vimoo-Base: Generates 720p video based on the Vimoo-PE output.
• Vimoo-Enhancer: Feeds the 720p video to regenerate the output at 1080p resolution. It combines the resolution and clarity enhancement associated with generative repair of defects in appearance and motion, enabling it to produce high-resolution outputs with more accurate details and greater visual fidelity.

To help the community deploy Vimoo correctly, we provide three approaches.

• Open Platform API: Since Vimoo consists of three modules: Vimoo-PE, Vimoo-Base, and Vimoo-Enhancer, we offer the Open Platform API to support full end-to-end invocation of the complete pipeline, while the Enhancer is optional.
• OpenSource: We have open-sourced the Vimoo-Base model to enable validation of 720p output. For better results, you can refer to the 'Prompt Guide' section, which provides a detailed tutorial to help the community develop their own prompting systems. You may also further call the standalone Enhancer API to obtain high-definition 1080P results.
• Run Locally: We provide locally deployable models, including ComfyUI and MLX versions, to support running Vimoo-Base on lower-end devices. Here too, the 'Prompt Guide' section is essential.

In addition, we provide an e-commerce video generation API, specifically designed for product and advertising video generation. It follows the same three-stage pipeline and outputs a 20-second story-driven e-commerce video.

📦 Model Zoo

Vimoo 1.0 comes in two models, Vimoo 1.0 and Vimoo 1.0 - Lite. Each Hugging Face repository packages one of them for one runtime:

Model	Hugging Face	Inference code	Description
Vimoo 1.0 ≈11.7B per model			T2V and I2V for the Vimoo Diffusers fork
			T2V, I2V and their Distilled versions for ComfyUI
Vimoo 1.0 - Lite ≈9.5B			TI2V for the Vimoo Diffusers fork
			TI2V and TI2V Distilled for ComfyUI
			TI2V Distilled for MLX on Apple Silicon

Each ComfyUI repository bundles its checkpoints, distilled LoRA adapters, shared encoders and VAE. Distilled models are available only for ComfyUI and MLX. Vimoo-1.0 T2V Distilled and I2V Distilled use different base checkpoints from Vimoo-1.0 T2V and I2V; download each task's matching base and adapter listed in the ComfyUI guide. The Vimoo-1.0 T2V Distilled, Vimoo-1.0 I2V Distilled and Vimoo-1.0-Lite TI2V Distilled adapters are not interchangeable. Parameters count the video denoiser only.

🚀 Quick Start

Installation

Use the Vimoo inference code on Linux with an NVIDIA CUDA GPU and Python 3.10 or later (python3 --version). Use PyTorch 2.9.0 with CUDA 13.0 (cu130) and an NVIDIA driver compatible with CUDA 13.0. On Debian/Ubuntu, install virtual environment support with sudo apt install python3-venv:

git clone https://github.com/Vimoo-AI/Vimoo-1.0.git
cd Vimoo-1.0
python3 -m venv .venv
source .venv/bin/activate
python3 -m pip install "torch==2.9.0+cu130" "torchvision==0.24.0+cu130" --index-url https://download.pytorch.org/whl/cu130
python3 -m pip install -r requirements.txt
python3 -m pip install "git+https://github.com/Vimoo-AI/diffusers.git"

See the installation guide for environment requirements.

The T2V and I2V examples default to PyTorch SDPA, with no additional attention package. To select --attention-backend fa2, fa3, fa4 or sage, first install that backend's dependencies from the runtime options.

Download weights

hf download Vimoo-AI/Vimoo-1.0 --local-dir ./models/Vimoo-1.0

To download one task only, add --exclude "transformer_i2v/*" for T2V or --exclude "transformer/*" for I2V. On the first run, Diffusers downloads Qwen2.5-VL-7B-Instruct, the Wan 2.2 VAE and, for I2V, SigLIP from Hugging Face at the revisions recorded in modular_model_index.json. For offline use, run once with network access, then set HF_HUB_OFFLINE=1.

Generate video

Run from the inference repository root, replacing the image with your own file:

python3 examples/vimoo_1_0_t2v.py --model ./models/Vimoo-1.0 --prompt 'A young woman in a red coat walks through a snowy city street and looks up at the falling snow.' --output t2v.mp4
python3 examples/vimoo_1_0_i2v.py --model ./models/Vimoo-1.0 --prompt 'The dog shakes its whole body, then sits back down in the same spot. The camera remains fixed throughout.' --image dog.png --output i2v.mp4

The examples output 1280 × 720, 121 frames at 24 fps.

📝 Prompting Guide

Use English prompts. The current open-source models have been validated only with English prompts. Generation quality and prompt adherence in other languages have not been validated. We recommend translating prompts into English before generation.

Write clear, detailed prompts. Specific descriptions of the subject, scene, action sequence, and camera movement can help produce results that better match your intent than short, vague prompts. See the Prompt Guide for structure and examples, and focus on relevant, consistent visual details.

The Prompt Guide describes automatic prompt enhancement in the hosted service. Local examples use your input prompt directly; follow the guide's writing structure and examples when preparing prompts.

📖 Technical Architecture

Vimoo 1.0 uses a 40-block dual-stream MMDiT backbone. Joint attention connects the video and conditioning streams, combining prompt semantics, in-video text and optional reference-image features. A Wan 2.2 VAE encodes and decodes the video, while flow matching generates video latents.

Each Vimoo-1.0 Transformer has ≈11.7B denoiser parameters, excluding encoders and the VAE. See the Vimoo 1.0 README for the model architecture and inference components.

Highlights

• Prompt adherence: a dedicated text encoder turns prompts into precise generation conditions. An optional prompt enhancer can add visual, cinematic, temporal, and contextual detail, or be disabled to preserve the original wording.
• Cinematic visual quality: training on carefully curated aesthetic data, with detailed annotations for lighting, composition, contrast, color grading, and more, enables precise control over cinematic styles and a wide range of aesthetic preferences.
• Advanced motion generation: a larger and more diverse training corpus improves generalization across motion, semantics, and visual aesthetics, delivering leading performance among open-source and proprietary video generation models.
• E-commerce video generation: by faithfully highlighting product selling points and features while preserving fine-grained product details, it ensures strong product consistency across frames, delivering reliable and visually coherent results that meet the practical demands of e-commerce content creation.
• Efficient high-definition generation: the lightweight variant uses 32×32×4 spatiotemporal compression and supports T2V and I2V at 720p and 24 fps.

📈 Evaluation & Benchmarks

Generation Quality

Vimoo-VBench is a human evaluation developed by the Vimoo team, with 500 prompts covering advertising, social media, storytelling, education and entertainment. T2V is evaluated for instruction following, frame aesthetics, visual quality and motion; I2V also measures image-video consistency.

The tables compare model families on this evaluation set. Results for individual checkpoints depend on their weights and generation settings.

T2V human evaluation (%)

Metric	Other models			Vimoo
	Wan 2.2	LTX 2.5	Veo 3.1	Vimoo 1.0 - Lite	Vimoo 1.0
Overall	23%	27%	34%	32%	35%
Instruction following	58%	60%	85%	71%	83%
Frame aesthetics	78%	77%	82%	87%	91%
Visual quality	81%	82%	88%	84%	88%
Motion effects	52%	55%	69%	51%	53%

I2V human evaluation (%)

Metric	Other models			Vimoo
	Wan 2.2	LTX 2.5	Veo 3.1	Vimoo 1.0 - Lite	Vimoo 1.0
Overall	30%	35%	44%	41%	47%
Image-video consistency	70%	65%	84%	80%	89%
Instruction following	56%	64%	88%	88%	90%
Frame aesthetics	80%	77%	84%	81%	89%
Visual quality	83%	86%	93%	89%	91%
Motion effects	61%	65%	77%	59%	63%

📁 Model Files

Path	Purpose
transformer/	Text-to-video model
transformer_i2v/	Image-to-video model

modular_model_index.json defines the required components.

Component provenance

The public model index records component locations and upstream revisions. Text conditioning uses Qwen2.5-VL and a Glyph encoder; image conditioning uses SigLIP, and video decoding uses the Wan VAE. Keep the bundled Glyph encoder and tokenizer with the model.

Glyph identities are recorded in glyph_source.json; the public preparation helper is prepare_glyph_encoder.py.

📜 License

Vimoo-authored code and Vimoo model weights in this repository are provided under the Apache License 2.0.

• Commercial use, modification, and redistribution are permitted under the terms of the license.
• Redistribution must include a copy of the license, retain applicable copyright and attribution notices, and identify modified files.
• Attribution and third-party component notices are provided in THIRD_PARTY_NOTICES.md. Third-party components remain subject to their own licenses.