rishabh-ranjan commited on
Commit
1d2c7d4
·
verified ·
1 Parent(s): 1f552a7

remove provenance

Browse files
README.md CHANGED
@@ -49,16 +49,16 @@ RT-J is a Relational Transformer foundation model for **in-context / few-shot en
49
  prediction** over multi-table relational databases (no per-task gradient training).
50
  This repository hosts both task-head variants:
51
 
52
- | Variant | Folder | Task | Metric | Selected checkpoint |
53
- |---|---|---|---|---|
54
- | Classifier | [`classification/`](./tree/main/classification) | binary entity classification | AUROC ↑ (mean 0.7310 on 12 RelBench tasks) | SWA @ step 58,000 (best val AUROC) |
55
- | Regressor | [`regression/`](./tree/main/regression) | entity regression | MAE ↓ (mean 0.2677 on 9 RelBench tasks, Z-scored) | SWA @ step 18,000 (best val MAE) |
56
 
57
  Both variants share the same architecture and training recipe:
58
  ~85.6M params · bfloat16 · 12 blocks, d_model 512, 8 heads, d_ff 2048 ·
59
  text columns embedded with `all-MiniLM-L12-v2` (d_text 384).
60
  Each folder contains `model.safetensors` (weights) and `config.json`
61
- (dims + text-embedding model + provenance).
62
 
63
  ## Usage
64
 
 
49
  prediction** over multi-table relational databases (no per-task gradient training).
50
  This repository hosts both task-head variants:
51
 
52
+ | Variant | Folder | Task | Metric |
53
+ |---|---|---|---|
54
+ | Classifier | [`classification/`](./tree/main/classification) | binary entity classification | AUROC ↑ (mean 0.7310 on 12 RelBench tasks) |
55
+ | Regressor | [`regression/`](./tree/main/regression) | entity regression | MAE ↓ (mean 0.2677 on 9 RelBench tasks, Z-scored) |
56
 
57
  Both variants share the same architecture and training recipe:
58
  ~85.6M params · bfloat16 · 12 blocks, d_model 512, 8 heads, d_ff 2048 ·
59
  text columns embedded with `all-MiniLM-L12-v2` (d_text 384).
60
  Each folder contains `model.safetensors` (weights) and `config.json`
61
+ (dims + text-embedding model).
62
 
63
  ## Usage
64
 
classification/config.json CHANGED
@@ -12,11 +12,5 @@
12
  "num_heads": 8,
13
  "d_ff": 2048,
14
  "materialize_attn_masks": true
15
- },
16
- "provenance": {
17
- "run_id": "pjbmgvu2",
18
- "swa_step": 58000,
19
- "project": "2026-04-17",
20
- "recipe": "real_mixed_v6_5_486t"
21
  }
22
  }
 
12
  "num_heads": 8,
13
  "d_ff": 2048,
14
  "materialize_attn_masks": true
 
 
 
 
 
 
15
  }
16
  }
classification/model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:7cb245539b3f3fb7d019d998d51bcf2b6235b04488a382e1ee4efb52179b5820
3
- size 171169942
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:939efed28467b2a18071be76aa52de6c18892bb95931cdd87063101762b10a8f
3
+ size 171169918
regression/config.json CHANGED
@@ -12,11 +12,5 @@
12
  "num_heads": 8,
13
  "d_ff": 2048,
14
  "materialize_attn_masks": true
15
- },
16
- "provenance": {
17
- "run_id": "fsuj4wdl",
18
- "swa_step": 18000,
19
- "project": "2026-04-17",
20
- "recipe": "real_mixed_v6_5_486t"
21
  }
22
  }
 
12
  "num_heads": 8,
13
  "d_ff": 2048,
14
  "materialize_attn_masks": true
 
 
 
 
 
 
15
  }
16
  }
regression/model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ad8e76d7fbcdb380368a03a21ad40eb0267afdb6b39f97b6aca571432330c6dd
3
- size 171169942
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:81758f9575877c701a8d7f4a6cc2141c7d21fde55d0021249aa571e24ad00e22
3
+ size 171169918