appvoid commited on
Commit
9703482
·
verified ·
1 Parent(s): 3982c4d

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -2
README.md CHANGED
@@ -11,7 +11,7 @@ tags:
11
 
12
  # arco lite
13
 
14
- arco lite is a passthrough arco model based on danube outputs to keep generality, even though its performance decreased, it's stil competitive to qwen2 at most benchmarks.
15
 
16
  #### benchmarks
17
 
@@ -19,8 +19,9 @@ zero-shot evaluations performed on current sota ~0.5b models.
19
 
20
  | Parameters | Model | MMLU | ARC | HellaSwag | PIQA | Winogrande | Average |
21
  | -----------|--------------------------------|-------|-------|-----------|--------|------------|---------|
 
22
  | 494m | qwen2 |**44.13**| 28.92| 49.05 | 69.31 | 56.99 | 49.68 |
23
- | 488m | arco-lite | 23.22 | **33.45** | 0 | **69.70** | **59.19**| 49.66 |
24
 
25
  #### Configuration
26
 
 
11
 
12
  # arco lite
13
 
14
+ arco lite is a passthrough arco model based on danube outputs to keep generality, even though its performance decreased, it's stil competitive to qwen2 at most benchmarks, being mmlu the only reason why is better on average.
15
 
16
  #### benchmarks
17
 
 
19
 
20
  | Parameters | Model | MMLU | ARC | HellaSwag | PIQA | Winogrande | Average |
21
  | -----------|--------------------------------|-------|-------|-----------|--------|------------|---------|
22
+ | 488m | arco-lite | 23.22 | **33.45** | **56.55**| **69.70** | **59.19**| 48.46 |
23
  | 494m | qwen2 |**44.13**| 28.92| 49.05 | 69.31 | 56.99 | 49.68 |
24
+
25
 
26
  #### Configuration
27