Spaces:
Running
Running
Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
|
@@ -68,7 +68,7 @@ to **6e-08**, so these are apples-to-apples.
|
|
| 68 |
|
| 69 |
| | DaisyChain | Carbon-500M |
|
| 70 |
|---|---|---|
|
| 71 |
-
| **Routing accuracy** (held-out) | **
|
| 72 |
| **Likelihood β base-pair bits/base** (β) | **1.876** | **1.787** |
|
| 73 |
| Seq-recovery, eukaryote (FNS, β) | 31.5% | 38.9% |
|
| 74 |
| Seq-recovery, bacteria (FNS, β) | 40.9% | 54.1% |
|
|
@@ -89,7 +89,7 @@ benchmarks" β so it's a fair, achievable target, not the 3B/8B flagships.
|
|
| 89 |
We build in the open, mistakes included. This project's honest history:
|
| 90 |
|
| 91 |
**What worked**
|
| 92 |
-
- **Per-domain specialists + a learned router** reached **
|
| 93 |
- **Snapshot-then-pick-best** distillation: snapshot every few thousand steps, deploy the snapshot with the
|
| 94 |
best *held-out* score, never the last one. This caught over-distillation (models that memorize the distill
|
| 95 |
cache and regress on held-out data) and made every round regression-guarded.
|
|
|
|
| 68 |
|
| 69 |
| | DaisyChain | Carbon-500M |
|
| 70 |
|---|---|---|
|
| 71 |
+
| **Routing accuracy** (held-out) | **100.0%** | β |
|
| 72 |
| **Likelihood β base-pair bits/base** (β) | **1.876** | **1.787** |
|
| 73 |
| Seq-recovery, eukaryote (FNS, β) | 31.5% | 38.9% |
|
| 74 |
| Seq-recovery, bacteria (FNS, β) | 40.9% | 54.1% |
|
|
|
|
| 89 |
We build in the open, mistakes included. This project's honest history:
|
| 90 |
|
| 91 |
**What worked**
|
| 92 |
+
- **Per-domain specialists + a learned router** reached **100%** held-out routing β one ~74M model active per query.
|
| 93 |
- **Snapshot-then-pick-best** distillation: snapshot every few thousand steps, deploy the snapshot with the
|
| 94 |
best *held-out* score, never the last one. This caught over-distillation (models that memorize the distill
|
| 95 |
cache and regress on held-out data) and made every round regression-guarded.
|