thefinalboss/atom-ai

ATOM

Atom-native model. UTF-8 Atomizer packets go into a toroidal field, integrated with RK4. Not a transformer. No attention, no BPE, no GPT-2 tokenizer on the main path.

Siren is the post this field is meant to hold. It does not hold it yet.

Chat Space: thefinalboss/atom-chat. It loads the highest-step checkpoint, skipping RELEASE, smoke, pair probes, and role-loss probes. The 12.1M file below is a role-loss run, so the Space may still bind the 10.7M corpus tip.

Updated 2026-10-09. Superseded checkpoints were removed from this repo.

Tip

checkpoints/bi_d64_ansbank/atom_native_step_12100000_bi_d64_ansbank.pt

Uploaded 2026-10-02 11:28 UTC. Step 12,100,000. d=64, 64 modes. Resumed from the 10.7M Fractus-dataset tip. Planned target in the checkpoint was 13.5M ticks. Stopped at 12.1M.

Recipe saved in the file:

• batched byte-tick, device=cuda, batch_size=1920, fast=compile, TF32 on
• field_bptt=256, leak frozen at 0.05, last_atom_dropout=0.5, role_loss=True
• episode 8000, atom flush 64, seed 20260913
• data: data/answers/train_answers.txt (answer bank, not the full Fractus jsonl)
• Atomizer atomizer-v1-byte-span, max_span_bytes=1, MERGE off, payload-copy off, hard obligatory readout, last-atom on
• bytes_seen=23,558,400,000 (step × batch, not 12.1M raw bytes)
• AdamW in the file. Saved arg LR is 5e-4; the optimizer group says 2e-3

This is next-byte under teacher force plus a role-loss probe. It is not speech.

Parents, kept

• checkpoints/bi_d64_fds/atom_native_step_10700000_bi_d64_fds.pt — corpus tip the 12.1M run resumed from. French + English, plus thefinalboss/fractus-datasets converted to Utilisateur: / Assistant: text (2,265,000 pairs, 7.5 Go). Train CE fell from ~1.81 at 9.5M to ~1.54 at 10.6M.
• checkpoints/bi_d64_day/atom_native_step_9500000_bi_d64_day.pt — parent of the 10.7M file.

Last published generation

Generation at 10.6M, greedy, T=0.3, top-k=2. Not re-probed at 12.1M:

• Bonjour, comment ça va ? → C'est de la fait pas de la famille de la fait d
• Qui es-tu ? → Je veux vie trais ? then a pasted Utilisateur:
• Il était une fois → C'est pas se sag
• The cat sat on the → The dis
• Ouvre Siren. → Alle se

The field learned the dialogue file as text. It did not learn that the reply has to answer the prompt.

Removed 2026-10-09

66 .pt files. Pod mirrors (gpu_bi_d64_*), role and leak probes, smoke, the d32 byte-tick line, RELEASE/ (pre root-cause, including the 2.9M noise tip), and the 11.0M / 11.4M / 11.7M cuts of this same ansbank run. The 11.7M file was the same d=64 brain with optimizer state; the tip is 12.1M.

What this is not

Not a product. Not Siren. Not a tool-caller. Weights are operable. Fluency is the gap between teacher-forced next-byte and a reply that depends on the prompt.