everythingchalna commited on
Commit
74e98eb
·
verified ·
1 Parent(s): 3828e1e

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +7 -5
README.md CHANGED
@@ -27,16 +27,18 @@ Minimal JAX/Flax transformer for catalyst structure generation with single-param
27
  | Depth | 8 (n_embd=512, n_layer=8, n_head=8) |
28
  | Vocab size | 186 (WordLevel, 2-digit pair encoding) |
29
  | Training data | 174K OC20 structures |
30
- | Training time | 96 min on TPU v5p-8 |
31
  | Framework | JAX / Flax |
32
 
33
  ## Results (CuPt3 + OH, T=0.8, top_k=40, 100 samples)
34
 
35
  | Metric | Result |
36
  |--------|--------|
37
- | Generation Validity | 95/100 (95.0%) |
38
- | Uniqueness | 95/95 (100.0%) |
39
- | Novelty | 95/95 (100.0%) |
 
 
40
 
41
  ## Usage
42
 
@@ -54,7 +56,7 @@ config = CatalystConfig.load(ckpt_path / "config.json")
54
 
55
  ## Training
56
 
57
- Trained on 174K structures from the OC20 S2EF dataset using a TPU v5p-8 (Google TRC program). 20 epochs, WSD learning rate schedule, AdamW optimizer.
58
 
59
  ## Files
60
 
 
27
  | Depth | 8 (n_embd=512, n_layer=8, n_head=8) |
28
  | Vocab size | 186 (WordLevel, 2-digit pair encoding) |
29
  | Training data | 174K OC20 structures |
30
+ | Training time | 97 min on TPU v6e-8 |
31
  | Framework | JAX / Flax |
32
 
33
  ## Results (CuPt3 + OH, T=0.8, top_k=40, 100 samples)
34
 
35
  | Metric | Result |
36
  |--------|--------|
37
+ | Parseable | 96/100 |
38
+ | Element Match | 96/100 |
39
+ | Generation Validity | 83/100 (83.0%) |
40
+ | Uniqueness | 83/83 (100.0%) |
41
+ | Novelty | 83/83 (100.0%) |
42
 
43
  ## Usage
44
 
 
56
 
57
  ## Training
58
 
59
+ Trained on 174K structures from the OC20 S2EF dataset using a TPU v6e-8 (Google TRC program). 20 epochs, WSD learning rate schedule, AdamW optimizer. Final val_loss=0.9518.
60
 
61
  ## Files
62