quazim commited on
Commit
349a24b
·
verified ·
1 Parent(s): 78cc4d8

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -4
README.md CHANGED
@@ -134,10 +134,10 @@ Benchmarking is one of the most important procedures during model acceleration.
134
 
135
  | Metric/Model | S | M | L | XL | Original | W8A8, int8 |
136
  |---------------|---|---|---|----|----------|------------|
137
- | arc_challenge | 49.10 | 50.10 | 53.20 | 52.60 | 52.60 | 49.70 | - |
138
- | mmlu | 71.70 | 73.00 | 74.10 | 73.50 | 73.50 | 71.60 | - |
139
- | piqa | 77.00 | 78.20 | 78.80 | 79.50 | 79.50 | 77.10 | - |
140
- | winogrande | 66.20 | 69.10 | 71.50 | 70.60 | 70.60 | 66.10 | - |
141
 
142
 
143
 
 
134
 
135
  | Metric/Model | S | M | L | XL | Original | W8A8, int8 |
136
  |---------------|---|---|---|----|----------|------------|
137
+ | arc_challenge | 49.10 | 50.10 | 53.20 | 52.60 | 52.60 | 41.70 | - |
138
+ | mmlu | 71.70 | 73.00 | 74.10 | 73.50 | 73.50 | 64.60 | - |
139
+ | piqa | 77.00 | 78.20 | 78.80 | 79.50 | 79.50 | 67.10 | - |
140
+ | winogrande | 66.20 | 69.10 | 71.50 | 70.60 | 53.60 | 66.10 | - |
141
 
142
 
143