Instructions to use omnimem/self_forcing_from_cd with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use omnimem/self_forcing_from_cd with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("omnimem/self_forcing_from_cd", dtype=torch.bfloat16, device_map="cuda") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - SelfForcing
How to use omnimem/self_forcing_from_cd with SelfForcing:
# No code snippets available yet for this library. # To use this model, check the repository files and the library's documentation. # Want to help? PRs adding snippets are welcome at: # https://github.com/huggingface/huggingface.js
- Notebooks
- Google Colab
- Kaggle
# No code snippets available yet for this library.
# To use this model, check the repository files and the library's documentation.
# Want to help? PRs adding snippets are welcome at:
# https://github.com/huggingface/huggingface.jsself_forcing_from_cd
OmniMem ordinary self-forcing checkpoint initialized from CD-trained generator weights.
This release contains the generator EMA weights at self-forcing training step 600. It is the initialization checkpoint used by long_rolling_plain_from_cd.
Checkpoint lineage
CD step-4500 EMA โ ordinary self-forcing step-600 EMA โ plain rolling training.
Contents
config.json- Two
safetensorsweight shards and their index SHA256SUMSfor payload integrity checking
The weights retain their original FP32 storage. The model configuration uses NSA top-12 block selection.
Usage
Use compatible OmniMem code with CausalWanNSAModel and CausalWanT2VPipeline.
The Wan2.1 VAE, UMT5 text encoder, and tokenizer are separate required components.
from omnimem.models.transformers.causal_wan_nsa_model import CausalWanNSAModel
model = CausalWanNSAModel.from_pretrained(
"omnimem/self_forcing_from_cd"
)
The original checkpoint configuration is preserved unchanged. Its saved class name
records the training wrapper, and _name_or_path records the upstream CD initialization source.
The released payload is the ordinary self-forcing step-600 EMA checkpoint.
- Downloads last month
- 5