AutoResearch Agent commited on
Commit ·
a02bf7a
1
Parent(s): a38491d
add transfer affinity matrix to README
Browse files
README.md
CHANGED
|
@@ -42,6 +42,19 @@ Autonomous discovery of optimal training curricula for biomedical NER, using Kar
|
|
| 42 |
| Baseline (bc5cdr_chem only) | 0.8090 ± 0.005 | — |
|
| 43 |
| + 3-stage curriculum (jnlpba→disease→chem) | 0.8195 ± 0.002 | **+1.3%** |
|
| 44 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 45 |
### Key Discovery: Asymmetric Transfer
|
| 46 |
|
| 47 |
| Direction | Improvement | Pretrain Budget |
|
|
|
|
| 42 |
| Baseline (bc5cdr_chem only) | 0.8090 ± 0.005 | — |
|
| 43 |
| + 3-stage curriculum (jnlpba→disease→chem) | 0.8195 ± 0.002 | **+1.3%** |
|
| 44 |
|
| 45 |
+
### Transfer Affinity Matrix (ΔF1 from 50/50 pretrain→finetune)
|
| 46 |
+
|
| 47 |
+
Source ↓ · Target → | **ncbi_disease** | **bc5cdr_chem**
|
| 48 |
+
:--|:--:|:--:
|
| 49 |
+
*No pretrain (baseline)* | *0.8033* | *0.8090*
|
| 50 |
+
**bc5cdr_chem** | **+0.044** | —
|
| 51 |
+
**ncbi_disease** | — | -0.001
|
| 52 |
+
**jnlpba** | +0.013 | -0.004
|
| 53 |
+
**bc2gm** | -0.007 | -0.001
|
| 54 |
+
**linnaeus** | -0.033 | +0.001
|
| 55 |
+
|
| 56 |
+
**Reading the matrix:** each cell shows the F1 change when pretraining on the source (row) before fine-tuning on the target (column). Bold = significant positive transfer.
|
| 57 |
+
|
| 58 |
### Key Discovery: Asymmetric Transfer
|
| 59 |
|
| 60 |
| Direction | Improvement | Pretrain Budget |
|