Commit
·
702785a
1
Parent(s):
759ae19
:octopus: sharing prompts
Browse files
README.md
CHANGED
|
@@ -59,6 +59,19 @@ On December 25, 2022, in New York City, the sun will rise at 07:16 AM and set at
|
|
| 59 |
```
|
| 60 |
|
| 61 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 62 |
## Usage
|
| 63 |
|
| 64 |
Suggested use is:
|
|
|
|
| 59 |
```
|
| 60 |
|
| 61 |
|
| 62 |
+
## Evaluation
|
| 63 |
+
|
| 64 |
+
Evaluations are on part with Qwen3:
|
| 65 |
+
|
| 66 |
+
```
|
| 67 |
+
| Tasks |Version|Filter|n-shot| Metric | |Value | |Stderr|
|
| 68 |
+
|---------|------:|------|-----:|--------|---|-----:|---|-----:|
|
| 69 |
+
|hellaswag| 1|none | 10|acc |↑ |0.3961|± |0.0049|
|
| 70 |
+
| | |none | 10|acc_norm|↑ |0.4991|± |0.0050|
|
| 71 |
+
```
|
| 72 |
+
|
| 73 |
+
_Currently running more evaluatiomns_
|
| 74 |
+
|
| 75 |
## Usage
|
| 76 |
|
| 77 |
Suggested use is:
|