Request for research access to Omni Creator 2.0 / OmniVideo weights

#11
by desirel - opened

Hi FrameAI team,

First of all – huge respect for what you built. I’ve been digging into your Omni-Image-Editor and Omni-Video-Factory Spaces, and I reverse-engineered the app.pyc – the architecture is beautiful: the 8B unified DiT (OmniMMDitV2), RoPE + SwiGLU, and especially the PiFlowPolicyNetwork / OmniScheduler for multi-step velocity prediction. It’s exactly the kind of unified image+video approach I’ve been prototyping.

I understand the production checkpoint (“OmniVideo”) is private and loaded from your internal repo – the public Spaces only ship the UI wrapper, which is why a clone runs on CPU but can’t generate.

Would you consider granting research-only access to the Omni Creator 2.0 weights? I’m working on:

comparing your hybrid flow-diffusion scheduler against standard DDIM
building a lightweight demo that credits you fully

I’m happy to sign any non-distribution agreement, keep the weights private, and share back any benchmarks or optimizations I find on low-VRAM setups.

Thanks for open-sourcing the Spaces and for the inspiration – even without weights, the design taught me a lot.

Best,
desirel

https://huggingface.co/QuantStack/Wan2.2-T2V-A14B-GGUF/tree/main
https://huggingface.co/BigDannyPt/WAN-2.2-SmoothMix-GGUF/tree/main/I2V/v2.0

You can use any of the models from the two repositories mentioned above. Our workflow is highly compatible with Wan 2.2, as it is largely based on that model and incorporates much of its structural design.

We have tested both of the weights I shared earlier, and the results are excellent, so feel free to use those open-source versions directly.

I have also attached the workflow below for you to download.

https://github.com/selfitcamera/ComfyUIVideo/tree/main/workflows

Regarding our OmniVideo model, the training actually took place in the second half of last year. Since it has been over six months now, the results aren't exactly cutting-edge compared to some of the latest models available today.

FrameAI4687 changed discussion status to closed

Sign up or log in to comment