lighteval/pr_1027/en/available-tasks.md

Available tasks

Browse and inspect tasks available in LightEval.

List all tasks:

lighteval tasks list

Extract tasks details:

lighteval tasks dump

Store the tasks details in a JSON file:

lighteval tasks dump > tasks.json

Inspect specific tasks

Inspect a task to view its config, metrics, and requirements:

lighteval tasks inspect 

Example:

lighteval tasks inspect truthfulqa:mc