Commit History

Allow checkpoint resume across shorter context configs
99e3c47
verified

zotowata commited on

Pass eval and curriculum controls to RunPod pods
d6978c9
verified

zotowata commited on

Expose eval and curriculum controls in RunPod trainer
cc59f3f
verified

zotowata commited on

Ensure at least one masked token per sample
8ea617a
verified

zotowata commited on

Add eval, sharding, and curriculum controls
fc1c409
verified

zotowata commited on

Pass pretrain shuffle controls to RunPod pods
5b1ac6a
verified

zotowata commited on

Expose pretrain shuffle controls in RunPod trainer
e2bde7a
verified

zotowata commited on

Add buffered shuffle to pretrain streams
b6a7818
verified

zotowata commited on

Pass TensorBoard settings to RunPod pods
16381b6
verified

zotowata commited on

Launch TensorBoard in RunPod trainer
75e3d84
verified

zotowata commited on

Add TensorBoard training metrics
4b1a5dd
verified

zotowata commited on

Install git-lfs when missing and skip LFS smudge
bbfe93e
verified

zotowata commited on

Propagate tokenizer setting to RunPod pods
6e1af37
verified

zotowata commited on

Use SmolLM tokenizer by default and validate vocab
73c832f
verified

zotowata commited on

Pass tokenizer explicitly in RunPod training script
f1b003b
verified

zotowata commited on

Add idle-start debug mode for RunPod
6fc7b7d
verified

zotowata commited on

Enable global networking for RunPod pods
55a50b2
verified

zotowata commited on

Remove HF token literal from RunPod bootstrap
b4b1f9c
verified

zotowata commited on

Require explicit RunPod GPU type
b180e83
verified

zotowata commited on

Fix RunPod GPU default
26e8ba2
verified

zotowata commited on

Sync RunPod launcher and 2B trainer
3343c67
verified

zotowata commited on

Sync 2B training job files
2a5274f
verified

zotowata commited on

Multi-GPU via Local SGD: split batch across GPUs, average params each step
f2306ae

Zae Claude Opus 4.6 (1M context) commited on

Remove DataParallel (incompatible with unified mode in-place updates)
e20d10c

Zae Claude Opus 4.6 (1M context) commited on

Unified PC training: fix energy normalization, add task signal to all blocks
77345ce

Zae Claude Opus 4.6 (1M context) commited on

ric
49589ef

Zae commited on

PC-SHO-DLM: full architecture with MSA integration
c2d8a57

Zae commited on

Upload src/msa.py with huggingface_hub
24af195
unverified

zotowata commited on

Upload train_2b.py with huggingface_hub
e0cb0d3
unverified

zotowata commited on

Upload src/model.py with huggingface_hub
ac4f4fa
unverified

zotowata commited on

Upload checkpoints/pretrain_step5000.pt with huggingface_hub
d0ee226
unverified

zotowata commited on

Upload checkpoints/pretrain_step4000.pt with huggingface_hub
6adbb5a
unverified

zotowata commited on

Upload checkpoints/pretrain_step3000.pt with huggingface_hub
bf27427
unverified

zotowata commited on

Upload checkpoints/pretrain_step2000.pt with huggingface_hub
a87994d
unverified

zotowata commited on

Upload checkpoints/pretrain_step1000.pt with huggingface_hub
a2b23e5
unverified

zotowata commited on

initial commit
a292020
unverified

zotowata commited on