promotion commited on
Commit
f826415
·
verified ·
1 Parent(s): 65d6249

Upload summaries/summary.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. summaries/summary.md +31 -0
summaries/summary.md ADDED
@@ -0,0 +1,31 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # PolyEdit multi-objective Hypervolume and MIP
2
+
3
+ Values are five-seed means with 95% t confidence intervals.
4
+
5
+ | Method | Hypervolume | MIP | Preference regret | Near-optimal | Unique |
6
+ |---|---:|---:|---:|---:|---:|
7
+ | sft | 0.326 ± 0.009 | 0.554 ± 0.012 | 0.034 ± 0.012 | 0.782 ± 0.091 | 2.091 ± 0.176 |
8
+ | random | 0.328 ± 0.005 | 0.500 ± 0.000 | 0.088 ± 0.000 | 0.448 ± 0.019 | 4.409 ± 0.279 |
9
+ | greedy_verifier | 0.337 ± 0.004 | 0.568 ± 0.003 | 0.019 ± 0.003 | 0.833 ± 0.021 | 2.011 ± 0.129 |
10
+ | oracle_grid | 0.355 ± 0.000 | 0.588 ± 0.000 | 0.000 ± 0.000 | 1.000 ± 0.000 | 1.977 ± 0.000 |
11
+
12
+ ## Direction breakdown
13
+
14
+ | Direction | Method | Hypervolume | MIP |
15
+ |---|---|---:|---:|
16
+ | up_up | sft | 0.555 ± 0.006 | 0.717 ± 0.009 |
17
+ | up_up | random | 0.530 ± 0.011 | 0.623 ± 0.004 |
18
+ | up_up | greedy_verifier | 0.542 ± 0.010 | 0.710 ± 0.005 |
19
+ | up_up | oracle_grid | 0.572 ± 0.000 | 0.731 ± 0.000 |
20
+ | up_down | sft | 0.266 ± 0.010 | 0.532 ± 0.005 |
21
+ | up_down | random | 0.277 ± 0.004 | 0.499 ± 0.004 |
22
+ | up_down | greedy_verifier | 0.281 ± 0.004 | 0.549 ± 0.002 |
23
+ | up_down | oracle_grid | 0.300 ± 0.000 | 0.562 ± 0.000 |
24
+ | down_up | sft | 0.268 ± 0.017 | 0.534 ± 0.017 |
25
+ | down_up | random | 0.274 ± 0.004 | 0.501 ± 0.004 |
26
+ | down_up | greedy_verifier | 0.283 ± 0.009 | 0.549 ± 0.004 |
27
+ | down_up | oracle_grid | 0.286 ± 0.000 | 0.569 ± 0.000 |
28
+ | down_down | sft | 0.216 ± 0.015 | 0.433 ± 0.020 |
29
+ | down_down | random | 0.231 ± 0.007 | 0.377 ± 0.004 |
30
+ | down_down | greedy_verifier | 0.244 ± 0.003 | 0.466 ± 0.003 |
31
+ | down_down | oracle_grid | 0.261 ± 0.000 | 0.489 ± 0.000 |