N8Programs commited on
Commit
e0caee4
·
verified ·
1 Parent(s): ee8ba9a

Add model card

Browse files
Files changed (1) hide show
  1. README.md +30 -0
README.md ADDED
@@ -0,0 +1,30 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ library_name: transformers
4
+ tags:
5
+ - arc-agi
6
+ - test-time-training
7
+ - muon
8
+ - causal-lm
9
+ ---
10
+
11
+ # ARC Tiny Transformer checkpoints
12
+
13
+ Hugging Face checkpoints for [N8python/arc-tiny-transformer](https://github.com/N8python/arc-tiny-transformer).
14
+
15
+ | Folder | Parameters | Optimized tokens | Public evaluation, identity greedy |
16
+ |---|---:|---:|---:|
17
+ | `7m-3.4b` | 7,094,784 | 3,399,843,840 | 4.375% |
18
+ | `50m-100m` | 50,372,096 | 100,073,472 | 0.750% |
19
+ | `50m-500m` | 50,372,096 | 500,072,448 | 2.625% |
20
+ | `50m-1.13b` | 50,372,096 | 1,133,150,208 | 5.125% |
21
+ | `50m-3.0b` | 50,372,096 | 2,999,844,864 | 9.000% |
22
+ | `50m-3.4b` | 50,372,096 | 3,399,843,840 | 8.500% |
23
+ | `440m-0.8b` | 440,506,368 | 799,801,344 | 9.250% |
24
+
25
+ The headline test-time-training experiments use `50m-3.0b`. One full-model TTT replica plus 128 greedy augmented candidates reaches 47.75% top-2 task-macro accuracy on the 400-task ARC-AGI-1 public evaluation; pooling three independently adapted replicas reaches 51.50%.
26
+
27
+ `verifier-50m-epoch4` is the auxiliary binary classifier trained on correct, perturbed, and on-policy sequences. It is included for reproduction but did not improve the headline vote aggregation.
28
+
29
+ All causal-LM folders are standard Transformers/Qwen3-format checkpoints with the custom 19-token tokenizer. See the GitHub repository for exact tokenizer semantics, training code, model hashes, and evaluation commands.
30
+