echoctx's picture
sn38 2016 unique nanochrono + quality SFT2
bdcfcd9 verified
|
Raw
History Blame Contribute Delete
647 Bytes
metadata
license: mit
tags:
  - sn38
  - chronollm
  - causal-lm

sn38-chrono-2016-sft2

Round-7 / cutoff-2016 candidate for Bittensor SN38.

  • Arch: sn38-nanochrono, 2,018,511,234 params
  • Init: anacoluthe89/chrono-2015@3062e6d0 then SV-jitter sigma=0.08 (SVD 0.019 vs init)
  • Then completion-only SFT on 113 timeless incomplete-sentence pairs (no post-2016 dumps)
  • Official SVD vs UID 131 still 0.01905 >= 0.01
  • Greedy generation_config; trust_remote_code=False
  • Held-out completions are shorter and more factual than the 2015 champion on a 20-prompt set
  • Proxy leak unknown-recognition rose (year-token items); TEE self-test not yet run