README.md

metadata

license: cc-by-nc-4.0
tags:
  - bagel
  - vlm-gym
  - world-model
  - pusht
  - cot

pusht_cot_chunk_k3_world_model

BAGEL-7B-MoT world-model SFT checkpoint (EMA weights only, raw fp32).

• task: pusht variant: cot step: 5000
• All-step interleaved chain-of-thought world model; re-grounds on the true frame every K=3 steps. Keep-last interleaving recipe used by the final evaluation.
• weights: fp32 EMA, sharded into 2 safetensors files (ema-XXXXX-of-00002.safetensors) plus ema.safetensors.index.json (fp32 exceeds the 50GB single-file limit). Optimizer state NOT included — for inference / eval, not resume.

Load

This is an SFT delta on the public BAGEL-7B-MoT base. Load the base config / tokenizer / VAE / ViT from BAGEL-7B-MoT together with these EMA weights; point the loader at the repo folder (or its ema.safetensors.index.json) and it assembles the shards, e.g. with the eval runners: --bagel-path <this repo> --bagel-base-path <BAGEL-7B-MoT>.

Image transforms (pusht): VAE 256/256, ViT 224/224, JPEG q90, 96px render (norm4 action space). Prompt is stop-required; CoT is all-step interleaved.