Instructions to use N8Programs/arc-tiny-transformer-models with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use N8Programs/arc-tiny-transformer-models with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("N8Programs/arc-tiny-transformer-models", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Add model card
Browse files
README.md
ADDED
|
@@ -0,0 +1,30 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: mit
|
| 3 |
+
library_name: transformers
|
| 4 |
+
tags:
|
| 5 |
+
- arc-agi
|
| 6 |
+
- test-time-training
|
| 7 |
+
- muon
|
| 8 |
+
- causal-lm
|
| 9 |
+
---
|
| 10 |
+
|
| 11 |
+
# ARC Tiny Transformer checkpoints
|
| 12 |
+
|
| 13 |
+
Hugging Face checkpoints for [N8python/arc-tiny-transformer](https://github.com/N8python/arc-tiny-transformer).
|
| 14 |
+
|
| 15 |
+
| Folder | Parameters | Optimized tokens | Public evaluation, identity greedy |
|
| 16 |
+
|---|---:|---:|---:|
|
| 17 |
+
| `7m-3.4b` | 7,094,784 | 3,399,843,840 | 4.375% |
|
| 18 |
+
| `50m-100m` | 50,372,096 | 100,073,472 | 0.750% |
|
| 19 |
+
| `50m-500m` | 50,372,096 | 500,072,448 | 2.625% |
|
| 20 |
+
| `50m-1.13b` | 50,372,096 | 1,133,150,208 | 5.125% |
|
| 21 |
+
| `50m-3.0b` | 50,372,096 | 2,999,844,864 | 9.000% |
|
| 22 |
+
| `50m-3.4b` | 50,372,096 | 3,399,843,840 | 8.500% |
|
| 23 |
+
| `440m-0.8b` | 440,506,368 | 799,801,344 | 9.250% |
|
| 24 |
+
|
| 25 |
+
The headline test-time-training experiments use `50m-3.0b`. One full-model TTT replica plus 128 greedy augmented candidates reaches 47.75% top-2 task-macro accuracy on the 400-task ARC-AGI-1 public evaluation; pooling three independently adapted replicas reaches 51.50%.
|
| 26 |
+
|
| 27 |
+
`verifier-50m-epoch4` is the auxiliary binary classifier trained on correct, perturbed, and on-policy sequences. It is included for reproduction but did not improve the headline vote aggregation.
|
| 28 |
+
|
| 29 |
+
All causal-LM folders are standard Transformers/Qwen3-format checkpoints with the custom 19-token tokenizer. See the GitHub repository for exact tokenizer semantics, training code, model hashes, and evaluation commands.
|
| 30 |
+
|