File size: 726 Bytes
48ecd01
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
# FRANKENSTALLM 3B — Optimization Restart Guide

## Quick restart (all optimizations applied automatically):
```bash
bash scripts/apply_optimizations.sh
```

## Validate only (no restart):
```bash
bash scripts/apply_optimizations.sh --test-only
```

## Manual steps if auto-migration fails:
1. Stop: `kill $(cat checkpoints/korean_3b_fp8_run1/train.pid)`
2. Migrate: `python3 scripts/migrate_qkv_checkpoint.py checkpoints/korean_3b_fp8_run1/checkpoint-XXXXX`
3. Restart: `bash scripts/launch_3b_pretrain.sh`

## Rollback (undo QKV fusion):
```bash
CKPT=checkpoints/korean_3b_fp8_run1/checkpoint-XXXXX
cp ${CKPT}/model.pt.backup_pre_qkv ${CKPT}/model.pt
git checkout model/attention.py  # restore original attention code
```