README.md

---
title: Simpleqa Verified Custom
emoji: 📊
colorFrom: blue
colorTo: purple
sdk: docker
sdk_version: "latest"
pinned: false
---

# simpleqa_verified_custom

This eval was run using [evaljobs](https://github.com/dvsrepo/evaljobs).

## Command

```bash
evaljobs examples/simpleqa_verified_custom.py \
  --model hf-inference-providers/openai/gpt-oss-20b:cheapest \
  --name simpleqa_verified-sample \
  --limit 10
```

## Run with other models

To run this eval with a different model, use:

```bash
evaljobs https://huggingface.co/spaces/dvilasuero/simpleqa_verified-sample \
  --model <your-model> \
  --name <your-name> \
  --flavor cpu-basic
```

## Inspect eval command

The eval was executed with:

```bash
inspect eval eval.py \
  --model hf-inference-providers/openai/gpt-oss-20b:cheapest \
  --limit 10 \
  --log-shared \
  --log-buffer 100
```