Update logbook: Repro - Why Are Linear RNNs More Parallelizable?
Browse files
logbook.json
CHANGED
|
@@ -5,7 +5,7 @@
|
|
| 5 |
"space_id": "vimarsh/repro-why-linear-rnns-more-parallelizable",
|
| 6 |
"paper": null,
|
| 7 |
"tags": [],
|
| 8 |
-
"updated_at": "2026-07-
|
| 9 |
"root": {
|
| 10 |
"slug": "index",
|
| 11 |
"title": "Repro - Why Are Linear RNNs More Parallelizable?",
|
|
@@ -55,6 +55,6 @@
|
|
| 55 |
}
|
| 56 |
]
|
| 57 |
},
|
| 58 |
-
"agent_view_tokens":
|
| 59 |
-
"revision": "
|
| 60 |
}
|
|
|
|
| 5 |
"space_id": "vimarsh/repro-why-linear-rnns-more-parallelizable",
|
| 6 |
"paper": null,
|
| 7 |
"tags": [],
|
| 8 |
+
"updated_at": "2026-07-17T04:46:04+00:00",
|
| 9 |
"root": {
|
| 10 |
"slug": "index",
|
| 11 |
"title": "Repro - Why Are Linear RNNs More Parallelizable?",
|
|
|
|
| 55 |
}
|
| 56 |
]
|
| 57 |
},
|
| 58 |
+
"agent_view_tokens": 1605,
|
| 59 |
+
"revision": "1784263564837499386"
|
| 60 |
}
|
pages/claim-6-graph-generalization/page.md
CHANGED
|
@@ -6,3 +6,10 @@
|
|
| 6 |
{"type": "markdown", "id": "cell_7fe5ce49ba5b", "created_at": "2026-07-16T17:54:37+00:00", "title": "Figure 2 was source-verified but not retrained. At graph sizes 201-300, the pap…"}
|
| 7 |
-->
|
| 8 |
Figure 2 was source-verified but not retrained. At graph sizes 201-300, the paper reports RNN 96.50%, Transformer 62.15%, and Mamba 50.95%. The released paper source provides the 60k-step configuration but no official runnable implementation was located.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 6 |
{"type": "markdown", "id": "cell_7fe5ce49ba5b", "created_at": "2026-07-16T17:54:37+00:00", "title": "Figure 2 was source-verified but not retrained. At graph sizes 201-300, the pap…"}
|
| 7 |
-->
|
| 8 |
Figure 2 was source-verified but not retrained. At graph sizes 201-300, the paper reports RNN 96.50%, Transformer 62.15%, and Mamba 50.95%. The released paper source provides the 60k-step configuration but no official runnable implementation was located.
|
| 9 |
+
|
| 10 |
+
|
| 11 |
+
---
|
| 12 |
+
<!-- trackio-cell
|
| 13 |
+
{"type": "markdown", "id": "cell_008b84c5d6c9", "created_at": "2026-07-17T04:46:01+00:00", "title": "Extended learned proxy result (inconclusive): a T4 CUDA Job trained GRU and Tra…"}
|
| 14 |
+
-->
|
| 15 |
+
Extended learned proxy result (inconclusive): a T4 CUDA Job trained GRU and Transformer classifiers for 1500 steps on a scaled two-path parity-reachability proxy (lengths <=32; extrapolation length 128). Both remained at chance: GRU 49.75% ID / 50.35% OOD; Transformer 49.95% ID / 50.09% OOD. Therefore this run does not verify the Figure 2 separation; it shows that this naive proxy/training budget is insufficient. Exact reproducible Job: https://huggingface.co/jobs/vimarsh/6a59b323b1669a49bf079177
|