echoctx's picture
sn38 2016 unique nanochrono + quality SFT2
bdcfcd9 verified
|
Raw
History Blame Contribute Delete
647 Bytes
---
license: mit
tags:
- sn38
- chronollm
- causal-lm
---
# sn38-chrono-2016-sft2
Round-7 / cutoff-2016 candidate for Bittensor SN38.
- Arch: `sn38-nanochrono`, 2,018,511,234 params
- Init: `anacoluthe89/chrono-2015@3062e6d0` then SV-jitter sigma=0.08 (SVD 0.019 vs init)
- Then completion-only SFT on 113 timeless incomplete-sentence pairs (no post-2016 dumps)
- Official SVD vs UID 131 still **0.01905 >= 0.01**
- Greedy generation_config; trust_remote_code=False
- Held-out completions are shorter and more factual than the 2015 champion on a 20-prompt set
- Proxy leak unknown-recognition rose (year-token items); TEE self-test not yet run