Spaces:
Sleeping
Sleeping
File size: 869 Bytes
e835fbd 94c4a6b 964a7ac e835fbd 964a7ac e835fbd 94c4a6b 964a7ac 94c4a6b 964a7ac 94c4a6b 964a7ac 94c4a6b 964a7ac 94c4a6b 964a7ac 94c4a6b 964a7ac 94c4a6b | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 | ---
title: Arc Easy
emoji: 📊
colorFrom: blue
colorTo: purple
sdk: docker
sdk_version: "latest"
pinned: false
---
# arc_easy
This eval was run using [evaljobs](https://github.com/dvsrepo/evaljobs).
## Command
```bash
evaljobs inspect_evals/arc_easy \
--model hf-inference-providers/openai/gpt-oss-20b:fastest,hf-inference-providers/openai/gpt-oss-120b:fastest \
--name test-local \
--limit 1
```
## Run with other models
To run this eval with a different model, use:
```bash
evaljobs inspect_evals/arc_easy \
--model <your-model> \
--name <your-name> \
--flavor cpu-basic
```
## Inspect eval command
The eval was executed with:
```bash
inspect eval-set inspect_evals/arc_easy \
--model hf-inference-providers/openai/gpt-oss-20b:fastest,hf-inference-providers/openai/gpt-oss-120b:fastest \
--limit 1 \
--log-shared \
--log-buffer 100
```
|