self_forcing_from_ode_init

OmniMem ordinary self-forcing checkpoint initialized from ODE-trained generator weights.

This release contains the generator EMA weights at self-forcing training step 800. It is the shared initialization checkpoint used for the plain and prompt-switching rolling-training branches.

Checkpoint lineage

ODE step-800 generator weights โ†’ ordinary self-forcing step-800 EMA โ†’ rolling-training branches.

The downstream releases are:

Contents

  • config.json
  • Two safetensors weight shards and their index
  • SHA256SUMS for payload integrity checking

The weights retain their original FP32 storage. The model configuration uses NSA top-12 block selection.

Usage

Use compatible OmniMem code with CausalWanNSAModel and CausalWanT2VPipeline. The Wan2.1 VAE, UMT5 text encoder, and tokenizer are separate required components.

from omnimem.models.transformers.causal_wan_nsa_model import CausalWanNSAModel

model = CausalWanNSAModel.from_pretrained(
    "omnimem/self_forcing_from_ode_init"
)

The original checkpoint configuration is preserved unchanged. Its saved class name records the training wrapper, and _name_or_path records the upstream ODE initialization source. The released payload is the ordinary self-forcing step-800 EMA checkpoint.

Downloads last month
6
Safetensors
Model size
1B params
Tensor type
F32
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support