README.md

---
library_name: stable-baselines3
pipeline_tag: reinforcement-learning
license: mit
tags:
  - reinforcement-learning
  - stable-baselines3
  - ppo
  - supermariobrosnes-turbo
  - rlab
  - SuperMarioBros-Nes-v0
metrics:
  - success-rate
---

# SuperMarioBros-Nes-v0 — Level2-1 — PPO

Stable-Baselines3 PPO policy for `SuperMarioBros-Nes-v0` `Level2-1`, trained and evaluated with
[`rlab`](https://github.com/tsilva/rlab).

## At a Glance

| Item | Value |
|---|---|
| Task | Complete `SuperMarioBros-Nes-v0` `Level2-1` |
| Provider | `supermariobrosnes-turbo` |
| Algorithm | `ppo` |
| Checkpoint | Step `10000000` |
| Evaluation | `stochastic` full evaluation, `100` episodes |
| Success | minimum `82.0%`, mean `82.0%` |
| Mean return | `2914.370` |
| Release | `v1` |
| Preview | Root `replay.mp4` |
| YouTube | [Watch on YouTube](https://www.youtube.com/watch?v=RlcQZP8Q7HM) |

## Quick Start

```bash
git clone https://github.com/tsilva/rlab
cd rlab
git checkout 1e18630ff20f40c4038d6bee5b023ff704c7277b
uv sync --frozen
```

Import the ROM, then play or evaluate the immutable checkpoint:

```bash
uv run rlab import-roms ~/roms --game SuperMarioBros-Nes-v0
uv run rlab play https://huggingface.co/tsilva/Level2-1_stable-baselines3-ppo_4792f358/resolve/v1/model.zip
uv run rlab eval https://huggingface.co/tsilva/Level2-1_stable-baselines3-ppo_4792f358/resolve/v1/model.zip
```

## Evaluation

Action selection was `stochastic` under the published evaluation environment contract.

| Start | Episodes | Successes | Success rate | Mean return |
|---|---:|---:|---:|---:|
| Level2-1 | 100 | 82 | 82.0% | 2914.370 |

## Environment and Policy Contract

| Item | Value |
|---|---|
| Environment | `supermariobrosnes-turbo:SuperMarioBros-Nes-v0` |
| Environment hash | `sha256:31d6d9ced20024347d67573787dd6afe60053a82055a10a5e6951dfb591393ca` |
| Preprocessing | `{"frame_skip":4,"frame_stack":4,"max_pool_frames":false,"obs_copy":"safe_view","obs_crop":[32,0,0,0],"obs_crop_fill":0,"obs_crop_mode":"remove","obs_grayscale":true,"obs_resize":[84,84],"obs_resize_algorithm":"area","pipeline":"supermariobrosnes_turbo_native_vec_env","policy_observation_layout":"channel_first","sticky_action_prob":0.0}` |
| Action contract | `{"set":"simple"}` |

## Provenance

| Item | Value |
|---|---|
| Source | [rlab](https://github.com/tsilva/rlab) |
| Run | [Level2-1_base_s1_20260704T110948Z](https://wandb.ai/tsilva/SuperMarioBros-Nes-v0/runs/osxjhs99) |
| Recipe | `base` |
| Seed | `1` |
| Source commit | `1e18630ff20f40c4038d6bee5b023ff704c7277b` |
| Evaluated artifact | `tsilva/SuperMarioBros-Nes-v0/Level2-1_base_s1_20260704T110948Z-checkpoint:step-10000000` |

## Files

| File | Purpose |
|---|---|
| `model.zip` | Stable-Baselines3 policy checkpoint |
| `model.json` | Versioned checkpoint identity, policy type, provenance, and recipe binding |
| `recipe.json` | Versioned execution and evaluation contract |
| `release_manifest.json` | Release identity, evaluation evidence, and artifact hashes |
| `replay.mp4` | Browser-safe representative episode |
| `LICENSE` | License for rlab-authored policy weights and publication material |

## Limitations

Evaluation establishes performance only for the published environment hash, start distribution,
policy preprocessing, and action-selection protocol. It does not establish generalization to
other levels, environments, ROM revisions, or contracts.

## Licensing

The rlab-authored policy weights and publication material are licensed under the MIT License in
`LICENSE`. Emulator/runtime software and game assets remain governed by their own licenses and
terms. This repository does not redistribute a game ROM.

## Policy Lineage

This is a legacy `rlab` policy trained by Stable-Baselines3 PPO. It is not a GradLab-trained checkpoint and no GradLab compatibility is claimed.

- Trainer: `Stable-Baselines3`
- Algorithm: `PPO`
- Model class: `stable_baselines3.ppo.ppo.PPO`
- Full lineage digest: `4792f358ffdd62b3e1bc9388c5e30ae9077b10b635727f2fde740e590dcabc44`
- Immutable release: `hf://tsilva/Level2-1_stable-baselines3-ppo_4792f358@v1`
- Exact checkpoint tag: `checkpoint-10000000`

The mutable main branch contains this corrected card; the original v1 release files, commit, and tag remain unchanged.