---
license: apache-2.0
tags:
  - serl
  - reinforcement-learning
  - qwen2.5
  - checkpoints
---

# SeRL Training Checkpoints

Compressed checkpoints from SeRL (Self-Evolving Reinforcement Learning) experiments.
Files use **ZipNN lossless compression** (~33% smaller, transparent loading).

## Quick Start

```bash
pip install zipnn huggingface_hub transformers
```

```python
# Enable ZipNN transparent loading
from zipnn import zipnn_hf
zipnn_hf()

from huggingface_hub import snapshot_download
from transformers import AutoModelForCausalLM, AutoTokenizer

# Download specific checkpoint
path = snapshot_download(
    "AshwinKM2005/serl-checkpoints",
    allow_patterns="serl_arce_qwen25_1_5b/huggingface/*"
)

# Load model (auto-decompresses .znn files)
model = AutoModelForCausalLM.from_pretrained(
    f"{path}/serl_arce_qwen25_1_5b/huggingface/global_step200_hf"
)
```

## Experiments

| Experiment | Base Model | Dataset |
|------------|-----------|---------|
| serl_arcc_qwen25_0_5b | Qwen2.5-0.5B | ARC-Challenge |
| serl_ARC-c_qwen25_1_5b | Qwen2.5-1.5B | ARC-Challenge |
| serl_arce_qwen25_0_5b | Qwen2.5-0.5B | ARC-Easy |
| serl_arce_qwen25_1_5b | Qwen2.5-1.5B | ARC-Easy |

## Structure

```
serl-checkpoints/
├── serl_arcc_qwen25_0_5b/
│   ├── huggingface/global_step100_hf/
│   └── deepspeed/global_step100/
├── serl_ARC-c_qwen25_1_5b/
│   └── ...
└── ...
```

## Compression

Files ending in `.safetensors.znn` are ZipNN compressed.
The `zipnn_hf()` hook enables transparent loading.