README.md

---
title: Arc Easy
emoji: 📊
colorFrom: blue
colorTo: purple
sdk: docker
sdk_version: "latest"
pinned: false
---

# arc_easy

This eval was run using [evaljobs](https://github.com/dvsrepo/evaljobs).

## Command

```bash
evaljobs inspect_evals/arc_easy \
  --model hf-inference-providers/openai/gpt-oss-20b:fastest,hf-inference-providers/openai/gpt-oss-120b:fastest \
  --name test-local \
  --limit 1
```

## Run with other models

To run this eval with a different model, use:

```bash
evaljobs inspect_evals/arc_easy \
  --model <your-model> \
  --name <your-name> \
  --flavor cpu-basic
```

## Inspect eval command

The eval was executed with:

```bash
inspect eval-set inspect_evals/arc_easy \
  --model hf-inference-providers/openai/gpt-oss-20b:fastest,hf-inference-providers/openai/gpt-oss-120b:fastest \
  --limit 1 \
  --log-shared \
  --log-buffer 100
```