appvoid commited on
Commit
3982c4d
·
verified ·
1 Parent(s): 2f03b9b

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -11,7 +11,7 @@ tags:
11
 
12
  # arco lite
13
 
14
- arco lite is a passthrough arco model based on danube outputs to keep generality, even though its performance decreased, it's stil better than qwen2 at most benchmarks.
15
 
16
  #### benchmarks
17
 
@@ -20,7 +20,7 @@ zero-shot evaluations performed on current sota ~0.5b models.
20
  | Parameters | Model | MMLU | ARC | HellaSwag | PIQA | Winogrande | Average |
21
  | -----------|--------------------------------|-------|-------|-----------|--------|------------|---------|
22
  | 494m | qwen2 |**44.13**| 28.92| 49.05 | 69.31 | 56.99 | 49.68 |
23
- | 488m | arco-lite | - | **33.45** | 0 | **69.70** | **59.19**| 49.66 |
24
 
25
  #### Configuration
26
 
 
11
 
12
  # arco lite
13
 
14
+ arco lite is a passthrough arco model based on danube outputs to keep generality, even though its performance decreased, it's stil competitive to qwen2 at most benchmarks.
15
 
16
  #### benchmarks
17
 
 
20
  | Parameters | Model | MMLU | ARC | HellaSwag | PIQA | Winogrande | Average |
21
  | -----------|--------------------------------|-------|-------|-----------|--------|------------|---------|
22
  | 494m | qwen2 |**44.13**| 28.92| 49.05 | 69.31 | 56.99 | 49.68 |
23
+ | 488m | arco-lite | 23.22 | **33.45** | 0 | **69.70** | **59.19**| 49.66 |
24
 
25
  #### Configuration
26