Spaces:
Sleeping
Sleeping
File size: 855 Bytes
e835fbd 852e47b 601cc29 e835fbd 601cc29 e835fbd 852e47b 601cc29 852e47b 601cc29 852e47b 601cc29 852e47b 601cc29 852e47b 601cc29 852e47b 601cc29 852e47b |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 |
---
title: Simpleqa Verified Custom
emoji: 📊
colorFrom: blue
colorTo: purple
sdk: docker
sdk_version: "latest"
pinned: false
---
# simpleqa_verified_custom
This eval was run using [evaljobs](https://github.com/dvsrepo/evaljobs).
## Command
```bash
evaljobs examples/simpleqa_verified_custom.py \
--model hf-inference-providers/openai/gpt-oss-20b:cheapest \
--name simpleqa_verified-sample \
--limit 10
```
## Run with other models
To run this eval with a different model, use:
```bash
evaljobs https://huggingface.co/spaces/dvilasuero/simpleqa_verified-sample \
--model <your-model> \
--name <your-name> \
--flavor cpu-basic
```
## Inspect eval command
The eval was executed with:
```bash
inspect eval eval.py \
--model hf-inference-providers/openai/gpt-oss-20b:cheapest \
--limit 10 \
--log-shared \
--log-buffer 100
```
|