Hugging Face's logo

sgao-academics
/
causalscale

PyTorch
English
causalscale
causal-discovery
genomics
dag
low-rank
structure-learning
benchmark
python
pretrained
multi-engine
Model card Files
xet
 Community
sgao-academics commited on
Commit
c4bfa9e
·
verified ·
1 Parent(s): 7e5ae28

Upload benchmarks/sota_bench.json with huggingface_hub

Browse files
Files changed (1) hide show
  1. benchmarks/sota_bench.json +127 -0
benchmarks/sota_bench.json ADDED
@@ -0,0 +1,127 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ [
2
+ {
3
+ "d": 30,
4
+ "n": 200,
5
+ "true_edges": 88,
6
+ "notears": {
7
+ "edges": 82,
8
+ "f1": 0.035,
9
+ "precision": 0.037,
10
+ "recall": 0.034,
11
+ "time_s": 23.2
12
+ },
13
+ "sscagate": {
14
+ "base": 82,
15
+ "gate": 109,
16
+ "delta": 27,
17
+ "time_s": 72.1
18
+ },
19
+ "lowrank_gnn": {
20
+ "edges": 593,
21
+ "f1": 0.991,
22
+ "precision": 0.981,
23
+ "recall": 1.0,
24
+ "time_s": 0.1
25
+ }
26
+ },
27
+ {
28
+ "d": 50,
29
+ "n": 300,
30
+ "true_edges": 252,
31
+ "notears": {
32
+ "edges": 264,
33
+ "f1": 0.023,
34
+ "precision": 0.023,
35
+ "recall": 0.024,
36
+ "time_s": 179.0
37
+ },
38
+ "sscagate": {
39
+ "base": 276,
40
+ "gate": 460,
41
+ "delta": 184,
42
+ "time_s": 69.0
43
+ },
44
+ "lowrank_gnn": {
45
+ "edges": 1992,
46
+ "f1": 0.99,
47
+ "precision": 0.98,
48
+ "recall": 1.0,
49
+ "time_s": 0.1
50
+ }
51
+ },
52
+ {
53
+ "d": 100,
54
+ "n": 400,
55
+ "true_edges": 730,
56
+ "notears": {
57
+ "edges": 188,
58
+ "f1": 0.011,
59
+ "precision": 0.027,
60
+ "recall": 0.007,
61
+ "time_s": 984.1
62
+ },
63
+ "sscagate": {
64
+ "base": 1144,
65
+ "gate": 1453,
66
+ "delta": 309,
67
+ "time_s": 152.2
68
+ },
69
+ "lowrank_gnn": {
70
+ "edges": 7539,
71
+ "f1": 0.985,
72
+ "precision": 0.971,
73
+ "recall": 1.0,
74
+ "time_s": 0.1
75
+ }
76
+ },
77
+ {
78
+ "d": 150,
79
+ "n": 500,
80
+ "true_edges": 1152,
81
+ "notears": {
82
+ "edges": 57,
83
+ "f1": 0.002,
84
+ "precision": 0.018,
85
+ "recall": 0.001,
86
+ "time_s": 122.7
87
+ },
88
+ "sscagate": {
89
+ "base": 1174,
90
+ "gate": 1069,
91
+ "delta": -105,
92
+ "time_s": 154.1
93
+ },
94
+ "lowrank_gnn": {
95
+ "edges": 18995,
96
+ "f1": 0.983,
97
+ "precision": 0.966,
98
+ "recall": 1.0,
99
+ "time_s": 0.1
100
+ }
101
+ },
102
+ {
103
+ "d": 200,
104
+ "n": 600,
105
+ "true_edges": 1631,
106
+ "notears": {
107
+ "edges": 5,
108
+ "f1": 0.001,
109
+ "precision": 0.2,
110
+ "recall": 0.001,
111
+ "time_s": 34.9
112
+ },
113
+ "sscagate": {
114
+ "base": 0,
115
+ "gate": 0,
116
+ "delta": 0,
117
+ "time_s": 2.9
118
+ },
119
+ "lowrank_gnn": {
120
+ "edges": 35950,
121
+ "f1": 0.991,
122
+ "precision": 0.983,
123
+ "recall": 1.0,
124
+ "time_s": 0.1
125
+ }
126
+ }
127
+ ]