remove provenance
Browse files- README.md +5 -5
- classification/config.json +0 -6
- classification/model.safetensors +2 -2
- regression/config.json +0 -6
- regression/model.safetensors +2 -2
README.md
CHANGED
|
@@ -49,16 +49,16 @@ RT-J is a Relational Transformer foundation model for **in-context / few-shot en
|
|
| 49 |
prediction** over multi-table relational databases (no per-task gradient training).
|
| 50 |
This repository hosts both task-head variants:
|
| 51 |
|
| 52 |
-
| Variant | Folder | Task | Metric |
|
| 53 |
-
|---|---|---|---|
|
| 54 |
-
| Classifier | [`classification/`](./tree/main/classification) | binary entity classification | AUROC ↑ (mean 0.7310 on 12 RelBench tasks) |
|
| 55 |
-
| Regressor | [`regression/`](./tree/main/regression) | entity regression | MAE ↓ (mean 0.2677 on 9 RelBench tasks, Z-scored) |
|
| 56 |
|
| 57 |
Both variants share the same architecture and training recipe:
|
| 58 |
~85.6M params · bfloat16 · 12 blocks, d_model 512, 8 heads, d_ff 2048 ·
|
| 59 |
text columns embedded with `all-MiniLM-L12-v2` (d_text 384).
|
| 60 |
Each folder contains `model.safetensors` (weights) and `config.json`
|
| 61 |
-
(dims + text-embedding model
|
| 62 |
|
| 63 |
## Usage
|
| 64 |
|
|
|
|
| 49 |
prediction** over multi-table relational databases (no per-task gradient training).
|
| 50 |
This repository hosts both task-head variants:
|
| 51 |
|
| 52 |
+
| Variant | Folder | Task | Metric |
|
| 53 |
+
|---|---|---|---|
|
| 54 |
+
| Classifier | [`classification/`](./tree/main/classification) | binary entity classification | AUROC ↑ (mean 0.7310 on 12 RelBench tasks) |
|
| 55 |
+
| Regressor | [`regression/`](./tree/main/regression) | entity regression | MAE ↓ (mean 0.2677 on 9 RelBench tasks, Z-scored) |
|
| 56 |
|
| 57 |
Both variants share the same architecture and training recipe:
|
| 58 |
~85.6M params · bfloat16 · 12 blocks, d_model 512, 8 heads, d_ff 2048 ·
|
| 59 |
text columns embedded with `all-MiniLM-L12-v2` (d_text 384).
|
| 60 |
Each folder contains `model.safetensors` (weights) and `config.json`
|
| 61 |
+
(dims + text-embedding model).
|
| 62 |
|
| 63 |
## Usage
|
| 64 |
|
classification/config.json
CHANGED
|
@@ -12,11 +12,5 @@
|
|
| 12 |
"num_heads": 8,
|
| 13 |
"d_ff": 2048,
|
| 14 |
"materialize_attn_masks": true
|
| 15 |
-
},
|
| 16 |
-
"provenance": {
|
| 17 |
-
"run_id": "pjbmgvu2",
|
| 18 |
-
"swa_step": 58000,
|
| 19 |
-
"project": "2026-04-17",
|
| 20 |
-
"recipe": "real_mixed_v6_5_486t"
|
| 21 |
}
|
| 22 |
}
|
|
|
|
| 12 |
"num_heads": 8,
|
| 13 |
"d_ff": 2048,
|
| 14 |
"materialize_attn_masks": true
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 15 |
}
|
| 16 |
}
|
classification/model.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:939efed28467b2a18071be76aa52de6c18892bb95931cdd87063101762b10a8f
|
| 3 |
+
size 171169918
|
regression/config.json
CHANGED
|
@@ -12,11 +12,5 @@
|
|
| 12 |
"num_heads": 8,
|
| 13 |
"d_ff": 2048,
|
| 14 |
"materialize_attn_masks": true
|
| 15 |
-
},
|
| 16 |
-
"provenance": {
|
| 17 |
-
"run_id": "fsuj4wdl",
|
| 18 |
-
"swa_step": 18000,
|
| 19 |
-
"project": "2026-04-17",
|
| 20 |
-
"recipe": "real_mixed_v6_5_486t"
|
| 21 |
}
|
| 22 |
}
|
|
|
|
| 12 |
"num_heads": 8,
|
| 13 |
"d_ff": 2048,
|
| 14 |
"materialize_attn_masks": true
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 15 |
}
|
| 16 |
}
|
regression/model.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:81758f9575877c701a8d7f4a6cc2141c7d21fde55d0021249aa571e24ad00e22
|
| 3 |
+
size 171169918
|