loubnabnl HF Staff commited on
Commit
bc2257f
·
verified ·
1 Parent(s): ac0ca80

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +8 -8
README.md CHANGED
@@ -245,15 +245,15 @@ Below we highlight the three short-context probes for which we report headline n
245
 
246
  ### Downstream tasks
247
 
248
- | Category | Metric | Carbon 3B | GENERator-v2 3B | Evo2 7B (1M) |
249
  |---|---|---|---|---|
250
- | Generative | SR eukaryote % | **61.50** | 55.72 | <u>59.80</u> |
251
- | Variant effect prediction | BRCA2 AUROC | **0.8464** | 0.8057 | <u>0.8352</u> |
252
- | | TraitGym Mendelian AUPRC by-chrom | <u>0.3424</u> | 0.2068 | **0.3736** |
253
- | | ClinVar coding AUROC (48 kb) | <u>0.9330</u> | 0.9198 | **0.9370** |
254
- | | ClinVar non-coding AUROC (48 kb) | **0.9156** | <u>0.9061</u> | 0.9003 |
255
- | Perturbation | TATA v2 % | **65.94** | 49.82 | <u>63.78</u> |
256
- | | SYN v2 % | <u>82.78</u> | 74.08 | **84.90** |
257
 
258
  Carbon-3B is competitive with Evo2-7B while being much faster to run.
259
  > TODO update TATA v2 and SYN v2 scores with teh new results!
 
245
 
246
  ### Downstream tasks
247
 
248
+ | Category | Metric (%) | Carbon 3B | GENERator-v2 3B | Evo2 7B (1M) |
249
  |---|---|---|---|---|
250
+ | Generative | SR eukaryote | **61.50** | 55.72 | <u>59.80</u> |
251
+ | Variant effect prediction | BRCA2 AUROC | **84.64** | 80.57 | <u>83.52</u> |
252
+ | | TraitGym Mendelian AUPRC by-chrom | <u>34.24</u> | 20.68 | **37.36** |
253
+ | | ClinVar coding AUROC, 48 kb | <u>93.30</u> | 91.98 | **93.70** |
254
+ | | ClinVar non-coding AUROC, 48 kb | **91.56** | <u>90.61</u> | 90.03 |
255
+ | Perturbation | TATA v2 | **65.94** | 49.82 | <u>63.78</u> |
256
+ | | SYN v2 | <u>82.78</u> | 74.08 | **84.90** |
257
 
258
  Carbon-3B is competitive with Evo2-7B while being much faster to run.
259
  > TODO update TATA v2 and SYN v2 scores with teh new results!