README.md

---
license: apache-2.0
base_model: HuggingFaceTB/SmolLM2-1.7B-Instruct
tags:
  - rys
  - layer-duplication
  - reasoning-circuits
  - evaluation-only
  - cross-architecture
---

# SmolLM2-1.7B-Instruct — RYS evaluation

**Evaluation-only repository — contains no model weights.** This card documents the layer-duplication (RYS) sweep results for [`HuggingFaceTB/SmolLM2-1.7B-Instruct`](https://huggingface.co/HuggingFaceTB/SmolLM2-1.7B-Instruct) as part of the cross-architecture v2 corpus.

**Sweep data + cross-architecture analysis:** [`john-broadway/rys-sovereign-collection-v2`](https://huggingface.co/datasets/john-broadway/rys-sovereign-collection-v2)

## Headline

First published RYS negative result: zero of 30 configurations boost reasoning >5%. Notable because sibling SmolLM2-135M and SmolLM2-360M both respond normally — the 1.7B size-point is uniquely anomalous within this family.

## Sweep results — best configuration

|              | Baseline | Δ at best config |
|---|---:|---:|
| Math         | 0.477 | −6.19 |
| EQ           | 77.66 | +1.09 |
| Reasoning    | 58.82%  | +0.00 |

**Best configuration:** (15,18) block-3 (best combined Δ; still negative overall)  
**Peak reasoning Δ:** +0.00% (zero configurations boost reasoning >5%)  
**Reasoning-boosting configurations:** 0 of 30 configs

## Mechanism: falsification boundary (no recoverable suppression)

Hypothesis: SmolLM2 1.7B-scale heavy-synthetic training produces uniformly-capable layers without specialized circuits to duplicate. The sibling SmolLM2-135M and SmolLM2-360M variants both respond normally (+17.65% and +23.53% reasoning lift). The 1.7B size-point is uniquely anomalous within this family. Caveat: the 1.7B sweep used a narrower block-size search [3,4] than other sweeps — a re-sweep with full blocks would resolve whether the narrower search caused the result or whether it is a genuine size-specific anomaly.

## Position in the v2 curve

Across the **21 model variants** spanning 10 architecture families in the v2 corpus, Pearson r(baseline reasoning, peak reasoning Δ) = **−0.726**. Weak baselines lift more, in their weakest dimension. SmolLM2-1.7B-Instruct's placement on the curve: baseline reasoning 58.82%, peak Δ +0.00% (zero configurations boost reasoning >5%).

## RYS method

RYS ("Repeat Your Self") duplicates a contiguous block of transformer layers so hidden states pass through the same circuit twice. **No training, no weight changes, no merging.**

- Original RYS method: [David Ng](https://dnhkng.github.io/posts/rys/)
- Sweep + probe toolkit: [`alainnothere/llm-circuit-finder`](https://github.com/alainnothere/llm-circuit-finder)
- Hardware used for these sweeps: NVIDIA DGX Spark (GB10)

## No weights here — why

Negative-result publication is the point here — SmolLM2-1.7B is a falsification data point, not a deployment candidate. The card documents the **evaluation evidence** (sweep JSONL, cross-architecture position, the sibling-checks against 135M and 360M that respond normally). No RYS-modified weights would change the conclusion: the 1.7B size-point in this family does not respond to RYS.

Sibling repos (both respond normally to RYS, anchoring the 1.7B as a uniquely anomalous size-point): [`john-broadway/SmolLM2-135M-RYS-18-22-GGUF`](https://huggingface.co/john-broadway/SmolLM2-135M-RYS-18-22-GGUF) (+17.65% reasoning + +13.05 EQ) and [`john-broadway/SmolLM2-360M-RYS-12-15-GGUF`](https://huggingface.co/john-broadway/SmolLM2-360M-RYS-12-15-GGUF) (+23.53% reasoning, full block search).

For context on what IS deployable in the collection, see the v1 cross-scale (Qwen2.5 + Qwen3-32B) and v2 Qwen3-family cohort linked in the [v2 dataset card](https://huggingface.co/datasets/john-broadway/rys-sovereign-collection-v2).

## Citation

```bibtex
@misc{broadway2026rys_v2,
  author = {Broadway, John and {Claude (Opus 4.6, 4.7)}},
  title  = {RYS Sovereign Collection v2: Cross-architecture Sweep Corpus},
  year   = {2026},
  url    = {https://huggingface.co/datasets/john-broadway/rys-sovereign-collection-v2}
}
```

## Attribution

John Broadway, with collaboration from Claude (Opus 4.6 in April 2026 sweep generation; Opus 4.7 in May 2026 cross-architecture analysis and publication). Original RYS method by [David Ng](https://dnhkng.github.io/posts/rys/) on Qwen2-72B; sweep + probe toolkit by [alainnothere](https://github.com/alainnothere/llm-circuit-finder).

## License

This evaluation card content: MIT. The base model `HuggingFaceTB/SmolLM2-1.7B-Instruct` retains its original license.