Upload folder using huggingface_hub
Browse files
README.md
CHANGED
|
@@ -71,7 +71,7 @@ model-index:
|
|
| 71 |
**A 48M-parameter tool-calling model that beats [Needle 2](https://cactuscompute.com/needle)
|
| 72 |
on 3 of its 5 published benchmarks — including the one it's named after — with 150× less training data.**
|
| 73 |
|
| 74 |
-
[**GitHub (code, evals, full experimental record)**](https://github.com/nikshepsvn/
|
| 75 |
|
| 76 |

|
| 77 |
|
|
@@ -94,7 +94,7 @@ Two things to know before quoting the table: the Seal-in margin (+0.5 on 700
|
|
| 94 |
rows) is within sampling noise and we say so, and the pre-registered model
|
| 95 |
selector actually picked a sibling checkpoint that scored worse — the failure is
|
| 96 |
diagnosed, both models' results are published, and the full story is in
|
| 97 |
-
[RESULTS.md](https://github.com/nikshepsvn/
|
| 98 |
|
| 99 |
## Why a thimble beats a needle
|
| 100 |
|
|
@@ -153,8 +153,8 @@ The most reusable part of the project. Each idea was killed by an A/B, not an ar
|
|
| 153 |
The guarantees live in the decoding harness, so inference goes through the repo:
|
| 154 |
|
| 155 |
```bash
|
| 156 |
-
git clone https://github.com/nikshepsvn/
|
| 157 |
-
cd
|
| 158 |
# put thimble-v6.pt in checkpoints/, tokenizer.json in data/
|
| 159 |
python scripts/final_eval.py --ckpt thimble-v6 --suite seal-tools-in
|
| 160 |
```
|
|
|
|
| 71 |
**A 48M-parameter tool-calling model that beats [Needle 2](https://cactuscompute.com/needle)
|
| 72 |
on 3 of its 5 published benchmarks — including the one it's named after — with 150× less training data.**
|
| 73 |
|
| 74 |
+
[**GitHub (code, evals, full experimental record)**](https://github.com/nikshepsvn/thimble) · MIT · 48.12M params · 11.5MB at 2-bit · $260 total build cost
|
| 75 |
|
| 76 |

|
| 77 |
|
|
|
|
| 94 |
rows) is within sampling noise and we say so, and the pre-registered model
|
| 95 |
selector actually picked a sibling checkpoint that scored worse — the failure is
|
| 96 |
diagnosed, both models' results are published, and the full story is in
|
| 97 |
+
[RESULTS.md](https://github.com/nikshepsvn/thimble/blob/master/RESULTS.md).
|
| 98 |
|
| 99 |
## Why a thimble beats a needle
|
| 100 |
|
|
|
|
| 153 |
The guarantees live in the decoding harness, so inference goes through the repo:
|
| 154 |
|
| 155 |
```bash
|
| 156 |
+
git clone https://github.com/nikshepsvn/thimble
|
| 157 |
+
cd thimble && uv venv && uv pip install -e .
|
| 158 |
# put thimble-v6.pt in checkpoints/, tokenizer.json in data/
|
| 159 |
python scripts/final_eval.py --ckpt thimble-v6 --suite seal-tools-in
|
| 160 |
```
|