mindXtrain / mindxtrain /config /eval_default.json
Gregory-L's picture
fork mindXtrain from GitHub (Professor-Codephreak/mindXtrain@661bd41) as the mindX-specific line
dfb775d verified
Raw
History Blame Contribute Delete
364 Bytes
{
"$schema": "mindxtrain.eval",
"_comment": "Runtime defaults for `mindxtrain eval`; ${ENV} interpolation per ml-intern style.",
"tasks": [
"lighteval/mmlu",
"lighteval/gsm8k",
"bfcl/v4_simple"
],
"out_dir": "${MINDXTRAIN_OUT_DIR:-./out/eval}",
"persona_baseline": "${MINDXTRAIN_PERSONA_BASELINE:-}",
"agenda": "${MINDXTRAIN_AGENDA:-}"
}